legit:

```console
$ curl -s https://blog.cloudflare.com/markdown-for-agents/ -H "Accept: text/markdown" | head
---
description: The way content is discovered online is shifting, from traditional search engines to AI agents that need structured data from a Web built for humans. It’s time to consider not just human visitors, but start to treat agents as first-class citizens. Markdown for Agents automatically converts any HTML page requested from our network to markdown.
title: Introducing Markdown for Agents
image: https://cf-assets.www.cloudflare.com/zkvhlag99gkb/6Df02zjRb4inGPazW51EyD/278afaa16719f1080f12936c35a6c0ef/BLOG-3162_OG.png
---

 # Introducing Markdown for Agents

 2026-02-12
```

----

Turned out that not making it visit 6 million links but doing it in stages with "agents" worked a lot better:

1. Fetch shit and rewrite prompt
2. Reset context and answer the rewritten prompt

This was built in to search bots, but also Claude Code months ago and remains one of the primary reasons why there's been so much improvement.

optimism

The way content and businesses are discovered online is changing rapidly. In the past, traffic originated from traditional search engines, and SEO determined who got found first. Now the traffic is increasingly coming from AI crawlers and agents that demand structured data within the often-unstructured Web that was built for humans.

As a business, to continue to stay ahead, now is the time to consider not just human visitors, or traditional wisdom for SEO-optimization, but start to treat agents as first-class citizens.

> The way content and businesses are discovered online is changing rapidly. In the past, traffic originated from traditional search engines, and SEO determined who got found first. Now the traffic is increasingly coming from AI crawlers and agents that demand structured data within the often-unstructured Web that was built for humans.
>
> As a business, to continue to stay ahead, now is the time to consider not just human visitors, or traditional wisdom for SEO-optimization, but start to treat agents as first-class citizens. 
>
> ## Why markdown is important
> ## Convert HTML to markdown, automatically
> ## Content Signals Policy
> ## Try it with the Cloudflare Blog & Developer Documentation 
> ## Other ways to convert to Markdown
> ## Tracking markdown usage
> ## Start using today
>
> [**...read more at blog.cloudflare.com**](https://blog.cloudflare.com/markdown-for-agents/)

Why markdown is importantWhy markdown is important

Convert HTML to markdown, automaticallyConvert HTML to markdown, automatically

Content Signals PolicyContent Signals Policy

Try it with the Cloudflare Blog & Developer DocumentationTry it with the Cloudflare Blog & Developer Documentation

Other ways to convert to MarkdownOther ways to convert to Markdown

Tracking markdown usageTracking markdown usage

Start using todayStart using today