AI Crawl Control - Introducing Redirects for AI Training
UpdateUnverifiedAdded Sep 24, 2026
Cloudflare's network now supports redirecting verified AI training crawlers to canonical URLs when they request deprecated or duplicate pages. When enabled via AI Crawl Control > Quick Actions , AI training crawlers that request a page with a canonical tag pointing elsewhere receive a 301 redirect to the canonical version.
Topics: AI agents, Governance, Pricing
More Cloudflare developer platform releases
Every Cloudflare developer platform release| Date | Release | Type |
|---|---|---|
| Apr 17 | Access - Homepage and sign-out for MCP server portalsunverified Update | Update |
| Apr 17 | AI Crawl Control - Tools to prepare your site for the agentic Internetunverified Update | Update |
| Apr 17 | Cache - Smart Tiered Cache optimizes public cloud originsunverified Update | Update |
| Apr 17 | Radar - AI Insights updates on Cloudflare Radarunverified Update | Update |
| Apr 16 | AI Search - AI Search instances now include built-in storage and namespace Workers Bindingsunverified Update | Update |
| Apr 16 | AI Search - AI Search now has hybrid search and relevance boostingunverified Update | Update |
| Apr 16 | Artifacts - Artifacts now in beta: versioned filesystem with Git accessunverified Beta | Beta |
| Apr 16 | Email Service - Email Sending now in public betaunverified Beta | Beta |
Also shipped on Apr 17, 2026
Cloudflare in April 2026| Date | Company | Release | Product | Type |
|---|---|---|---|---|
| Apr 17 |  Google Cloud | The Pub/Sub remote MCP server is generally available (GA)unverified | Pub/Sub | GA |
| Apr 17 |  Sigma Computing | What's new in Sigmaunverified | Sigma | Beta |
| Apr 17 |  Microsoft | TypeScript 6.0.3unverified | TypeScript | Update |
| Apr 17 |  Neon | Neon Postgres plugin for OpenAI Codex, snapshot API size fields, Singapore region networking, and more release - Apr 17, 2026unverified | Neon | Update |
| Apr 17 |  Tobiko Data | SQLMesh 0.234.1unverified | SQLMesh | Update |
| Apr 17 |  Railway | Remote MCP, Railway Agent in the CLI, one-command skills installunverified | Railway | Update |
Sources: each vendor's own release notes, changelogs and GitHub releases, read daily to monthly by how often it posts. Logos via logo.dev; trademarks belong to their owners.