Cloudflare Introduces AI Crawler Blocking Feature and Pay-Per-Crawl System

Reported about 17 hours ago

On July 1, Cloudflare launched a new AI Crawler Blocking feature that allows website owners to decide whether to allow or block AI models from accessing their content. This initiative, along with the new 'pay per crawl' model, empowers publishers to charge AI crawlers for content access, enhancing content security. The feature builds on a previously existing tool for blocking crawlers and is accompanied by the release of Cloudflare Log Explorer, which provides insights into security and performance.

Source: YAHOO

View details

You may also interested in these wikis

Back to all Wikis