# What is Cloudflare Pay Per Crawl? Paid AI crawler access

Cloudflare Pay Per Crawl is a feature for charging participating AI crawlers when they retrieve content from a publisher’s site.

Cloudflare’s documentation, checked November 2, 2026, lists the feature as closed beta and describes charging for successful content retrievals. Access to a beta and a configured price do not establish that a crawler will buy content.

## Testing the assumptions behind a payment forecast

Illustrative scenario only, not a live Cloudflare offer: assume 10,000 crawler requests, a $0.01 rate, and only 10% meeting the hypothetical billable rules. That is 1,000 billable requests × $0.01 = $10 gross before collection and operating costs. The publisher needs an actual buyer, terms and paid receipt before treating any amount as revenue.

## An announced mechanism is not proven demand

Track attempted requests, requests eligible for the chosen arrangement, billable retrievals and money received separately. A traffic log counts activity; a payment record establishes collection. Operating costs still need to be deducted before calling the result profit.

## Estimate the threshold before choosing a pilot

If a pilot costs $100 a month to operate and you keep one cent per paid request, 10,000 paid requests cover that cost. Count paid requests separately from all automated traffic. The difference determines whether the pilot can clear its operating hurdle.

## Related terms

[robots.txt](https://digitalpublishingnews.com/dictionary/robots-txt/)

## Continue reading

[Cloudflare Pay Per Crawl: calculate potential revenue from paid crawler requests](https://digitalpublishingnews.com/articles/cloudflare-pay-per-crawl/): It explains the current beta state, chargeable responses and payout setup.

## Sources

https://blog.cloudflare.com/introducing-pay-per-crawl/

https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/

https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/set-a-pay-per-crawl-price/

Editorial method: https://digitalpublishingnews.com/how-we-use-ai/

Canonical: https://digitalpublishingnews.com/dictionary/pay-per-crawl/