Articles

Cloudflare to Block AI Crawlers From Scraping Websites Unless They Pay

Cloudflare to Block AI Crawlers From Scraping Websites Unless They Pay

PCMag
As publishers grapple with declining traffic thanks to AI, Cloudflare changes the default to 'block AI crawlers unless they pay creators' via a new system it's calling 'pay per crawl.'

Cloudflare has introduced a new way for websites to stop AI crawlers from stealing their content without permission—and to potentially get them to pay up.

Cloudflare is an internet infrastructure service that helps websites manage and secure their traffic, such as fending off Distributed Denial of Service …