$ curl -s https://blog.cloudflare.com/markdown-for-agents/ -H "Accept: text/markdown" | head
---
description: The way content is discovered online is shifting, from traditional search engines to AI agents that need structured data from a Web built for humans. It’s time to consider not just human visitors, but start to treat agents as first-class citizens. Markdown for Agents automatically converts any HTML page requested from our network to markdown.
title: Introducing Markdown for Agents
image: https://cf-assets.www.cloudflare.com/zkvhlag99gkb/6Df02zjRb4inGPazW51EyD/278afaa16719f1080f12936c35a6c0ef/BLOG-3162_OG.png
---
# Introducing Markdown for Agents
2026-02-12
Turned out that not making it visit 6 million links but doing it in stages with "agents" worked a lot better:
Fetch shit and rewrite prompt
Reset context and answer the rewritten prompt
This was built in to search bots, but also Claude Code months ago and remains one of the primary reasons why there's been so much improvement.
legit:
$ curl -s https://blog.cloudflare.com/markdown-for-agents/ -H "Accept: text/markdown" | head --- description: The way content is discovered online is shifting, from traditional search engines to AI agents that need structured data from a Web built for humans. It’s time to consider not just human visitors, but start to treat agents as first-class citizens. Markdown for Agents automatically converts any HTML page requested from our network to markdown. title: Introducing Markdown for Agents image: https://cf-assets.www.cloudflare.com/zkvhlag99gkb/6Df02zjRb4inGPazW51EyD/278afaa16719f1080f12936c35a6c0ef/BLOG-3162_OG.png --- # Introducing Markdown for Agents 2026-02-12Turned out that not making it visit 6 million links but doing it in stages with "agents" worked a lot better:
This was built in to search bots, but also Claude Code months ago and remains one of the primary reasons why there's been so much improvement.