Publisher and Retailer Content Economics

Cloudflare's Bot Preference Sync makes robots.txt an output of the edge, not a policy of its own

Bot Preference Sync writes Cloudflare's AI bot settings into your robots.txt from the Free tier up. The file becomes a rendering of dashboard state, and Cloudflare's bot database decides what it says.