Cloudflare to block cynical search-and-scrape bots from ad-supported web pages

Cloudflare will block mixed-use crawlers from ad-supported websites by default starting September 15, 2026, affecting Apple, Google, and Microsoft's Bing crawlers. The move aims to give publishers control over AI data harvesting, as these crawlers combine search indexing and content scraping for AI training.