Cloudflare 2026年起預設攔截混合AI爬蟲
cloudflare將於2026年9月預設攔截混合用途爬蟲，迫使ai公司將訓練爬蟲與搜索分離，或通過按需付費模式向發布者付費。
cloudflare announced a september 2026 deadline to block mixed-use crawlers from ad-supported pages unless site owners opt-in, targeting bots that bundle search indexing with ai training. the policy responds to non-human traffic surpassing human traffic and aims to stop ai companies from scraping intellectual property for free. cloudflare is also evolving its pay per crawl marketplace into pay per use, partnering with ceramic.ai and you.com to let publishers charge when content generates value. this forces ai providers to clarify bot intent or establish commercial agreements to access training data.