Cloudfare

Cloudflare Sets New Rules for AI Web Crawlers with Default Blocking and Pay-Per-Crawl Model

Cloudflare now blocks AI crawlers by default, introducing a groundbreaking "Pay Per Crawl" beta program. This shift puts publishers in control of their content and requires AI companies to explicitly seek permission. Major publishers like Reddit, The Atlantic, and Gannett are backing this change.