Digital Publishing News.Search

What is Cloudflare Pay Per Crawl? Paid AI crawler access

Cloudflare Pay Per Crawl is a feature for charging participating AI crawlers when they retrieve content from a publisher’s site.

Cloudflare’s documentation, checked November 2, 2026, lists the feature as closed beta and describes charging for successful content retrievals. Access to a beta and a configured price do not establish that a crawler will buy content. (Cloudflare Pay Per Crawl announcement ↗ · Cloudflare Pay Per Crawl: current product documentation · Cloudflare: set a Pay Per Crawl price)

Jump to a section

Testing the assumptions behind a payment forecast

Illustrative scenario only, not a live Cloudflare offer: assume 10,000 crawler requests, a $0.01 rate, and only 10% meeting the hypothetical billable rules. That is 1,000 billable requests × $0.01 = $10 gross before collection and operating costs. The publisher needs an actual buyer, terms and paid receipt before treating any amount as revenue.

An announced mechanism is not proven demand

Track attempted requests, requests eligible for the chosen arrangement, billable retrievals and money received separately. A traffic log counts activity; a payment record establishes collection. Operating costs still need to be deducted before calling the result profit.

Estimate the threshold before choosing a pilot

If a pilot costs $100 a month to operate and you keep one cent per paid request, 10,000 paid requests cover that cost. Count paid requests separately from all automated traffic. The difference determines whether the pilot can clear its operating hurdle.

How we research and edit definitions

Continue with a practical guide