AI Crawl Control - Pay Per Crawl (Private beta) - Discovery API, custom pricing, and advanced configuration
BetaUnverifiedAdded Sep 24, 2026
Pay Per Crawl is introducing enhancements for both AI crawler operators and site owners, focusing on programmatic discovery, flexible pricing models, and granular configuration control. For AI crawler operators Discovery API A new authenticated API endpoint allows verified crawlers to programmatically discover domains participating in Pay Per Crawl.
Topics: Security, Pricing, Developer tools
More Cloudflare developer platform releases
Every Cloudflare developer platform release| Date | Release | Type |
|---|---|---|
| Dec 10 | WAF - WAF Release - 2025-12-10 - Emergencyunverified Update | Update |
| Dec 11 | Logs - SentinelOne as Logpush destinationunverified Update | Update |
| Dec 11 | WAF - WAF Release - 2025-12-11 - Emergencyunverified Update | Update |
| Dec 9 | Cloudflare One Client - WARP client for Windows (version 2025.10.118.1)unverified Beta | Beta |
| Dec 9 | Cloudflare One Client - WARP client for macOS (version 2025.10.118.1)unverified Beta | Beta |
| Dec 12 | Durable Objects, Workers - Billing for SQLite Storageunverified Pricing | Pricing |
| Dec 12 | R2 SQL - R2 SQL now supports aggregations and schema discoveryunverified Update | Update |
| Dec 8 | Workers - Python cold start improvementsunverified Update | Update |
Also shipped on Dec 10, 2025
Cloudflare in December 2025| Date | Company | Release | Product | Type |
|---|---|---|---|---|
| Dec 10 |  New Relic | Introducing the Cross-cluster UI Public Previewunverified | New Relic | Preview |
| Dec 10 |  Okta | Requesting App for Cross App Access (XAA) is now available in Betaunverified | Auth0 | Beta |
| Dec 10 |  Cerebras | Added support for prompt caching, which automatically stores and reuses prompt prefixes to reduce latency and...unverified | Cerebras Inference | Update |
| Dec 10 |  Deepgram | Container Images (release 251210)unverified | Deepgram | Update |
| Dec 10 | Deepgram | This Release Contains The Following Changesunverified | Deepgram | Update |
| Dec 10 |  Tailscale | Tailscale v1.92.1unverified | Tailscale | Update |
Sources: each vendor's own release notes, changelogs and GitHub releases, read daily to monthly by how often it posts. Logos via logo.dev; trademarks belong to their owners.