---
title: "AI Optimization: Make Your Website Readable to AI Agents — Blackbook"
description: "AI agents read and cite your website. How to make every page readable to machines – markdown twins, llms.txt, sitemap.md and structured data."
canonical_url: https://www.blackbook.dk/en/journal/ai-optimization/
md_url: https://www.blackbook.dk/en/journal/ai-optimization/index.md
language: en
last_updated: 2026-09-09
---

# AI Optimization: Make Your Website Readable to AI Agents — Blackbook

AI agents read and cite your website. How to make every page readable to machines – markdown twins, llms.txt, sitemap.md and structured data.

> Alternate (Danish): https://www.blackbook.dk/journal/ai-optimering/index.md
> Author: Jeppe Sloth Carlsen — Senior Product Designer & Creative Technologist (https://www.blackbook.dk/en/about/)
> Author ID: https://www.blackbook.dk/#person-jeppe
> Topics: AI optimization, GEO, llms.txt, AI agents
> Part of: Blackbook — digital design agency, Copenhagen (https://www.blackbook.dk/en/)
> Published: 2026-09-09
> LLM reference: https://www.blackbook.dk/llms.txt
> Full reference: https://www.blackbook.dk/llms-full.txt
> Markdown sitemap: https://www.blackbook.dk/sitemap.md
> Preferred citation URL: https://www.blackbook.dk/en/journal/ai-optimization/

## Journal — I feed the AI overlords, hoping they kill me last

AI optimization – every page now speaks fluent AI

AI agents – ChatGPT, Claude, Perplexity – read, summarise and cite your website. But most sites serve them HTML built for browsers: navigation, scripts, div soup. Result: wrong quotes, stale facts, missed points.

AI optimization is the opposite: make the content readable, discoverable and citable for machines – without breaking anything for humans. Here's what I built.

## The sign at the front door

The first thing a bot fetches is robots.txt. Mine welcomes them:

**robots.txt**

```text
Content-Signal: search=yes, ai-input=yes, ai-train=yes

# For AI agents: every page has a markdown twin at its own URL + index.md
# Markdown sitemap: https://www.blackbook.dk/sitemap.md
# LLM reference: https://www.blackbook.dk/llms.txt
```

Four lines – and the agent knows the entire machine layer without crawling a single page.

## A markdown twin for every page

Append index.md to any URL and you get clean markdown with YAML frontmatter: title, description, canonical URL, last updated. No scripts, no noise.

The twins are generated from the same CMS data as the HTML – they can never fall behind. Every HTML page announces its twin via <link rel="alternate" type="text/markdown">.

On top: three indexes. llms.txt (the calling card), llms-full.txt (the full reference), sitemap.md (the page index) – both languages.

## Structured data for those who read HTML

Many agents still parse HTML. For them, every page carries JSON-LD: Person and Organization with stable IDs, breadcrumbs, skills and topics linked to Wikidata. The point is the entity, not the single page: land on any corner, read the whole picture, cite with the correct attribution.

## 404 in markdown

A dead markdown URL doesn't return an empty HTML error page, but a markdown response with a map of the exits. The status code is 404 – but the conversation doesn't stall.

- Diagram: from Sanity via the same URL to HTML and markdown twins, discovery via llms.txt, sitemap.md and llms-full.txt

## What we did not build

Checklists are easy. The rejections are the hard part:

**Content negotiation** – markdown for anyone with an Accept: text/markdown header. Elegant, but on a cached site one poisoned cache key is enough to serve your homepage as plain text. Rejected.

## Try it yourself

```bash
curl https://www.blackbook.dk/en/services/index.md
curl https://www.blackbook.dk/sitemap.md
curl https://www.blackbook.dk/this-page-does-not-exist/index.md
```

## Does it work?

OpenAI, Anthropic, Meta, Amazon, Google, Bing, Apple, Perplexity – all the big ones have been through. The first arrived within hours of launch, and ChatGPT is now the site's second-largest search channel after Google.

The machines are reading along.

## The AI overlords

I asked my AI after we built all of this:

**Me:** So won't our future AI overlords kill me last now?

**Claude:** … at least you'll be quoted correctly while it lasts.

## More

- [Journal](https://www.blackbook.dk/en/journal/)

## About Blackbook

Blackbook blends creativity and technology – digital solutions across UX, branding, websites and eCommerce that uplift your business and your customers. Copenhagen.

Areas of expertise:

- [Apps & Products](https://www.blackbook.dk/en/area/apps-products/index.md)
- [Brand & Campaigns](https://www.blackbook.dk/en/area/brand-campaigns/index.md)
- [Websites & eCommerce](https://www.blackbook.dk/en/area/websites-ecommerce/index.md)

Key figures:

- 250+ Digital projects
- 150+ Clients
- 15+ Fortune 500
- 5+ Top 100 Brands
- 25+ Years experience

## Site

[Home](https://www.blackbook.dk/en/index.md)
[Portfolio](https://www.blackbook.dk/en/portfolio/index.md)
[About](https://www.blackbook.dk/en/about/index.md)
[Services](https://www.blackbook.dk/en/services/index.md)
[Experience](https://www.blackbook.dk/en/experience/index.md)
[Recognition](https://www.blackbook.dk/en/awards/index.md)
[Contact](https://www.blackbook.dk/en/contact/index.md)
[CV](https://www.blackbook.dk/en/cv/index.md)
[Journal](https://www.blackbook.dk/en/journal/index.md)

Blackbook · Jerichausgade 7 · 1777 Copenhagen · (+45) 31 10 79 13 · [jeppe@blackbook.dk](mailto:jeppe@blackbook.dk)