AI Search - AI Search support for crawling login protected website content
UpdateUnverifiedAdded Sep 24, 2026
AI Search now supports custom HTTP headers for website crawling, solving a common problem where valuable content behind authentication or access controls could not be indexed. Previously, AI Search could only crawl publicly accessible pages, leaving knowledge bases, documentation, and other protected content out of your search results.
Topics: Security, Developer tools
More Cloudflare developer platform releases
Every Cloudflare developer platform release| Date | Release | Type |
|---|---|---|
| Nov 20 | Cloudflare Fundamentals, Terraform - Terraform v5.13.0 now availableunverified Update | Update |
| Nov 18 | Email security - Adjustment to Final Disposition Columnunverified Update | Update |
| Nov 21 | Containers, R2 - Mount R2 buckets in Containersunverified Update | Update |
| Nov 21 | Containers - New CPU Pricing for Containers and Sandboxesunverified Pricing | Pricing |
| Nov 21 | Security Center - Threat insights are now available in the Threat Events platformunverified Update | Update |
| Nov 21 | WAF - WAF Release - 2025-11-21unverified Update | Update |
| Nov 21 | Workers - Environment variable limits increase for Workers Buildsunverified Update | Update |
| Nov 21 | Workers - Better local deployment flow for Cloudflare Workersunverified Update | Update |
Also shipped on Nov 19, 2025
Cloudflare in November 2025| Date | Company | Release | Product | Type |
|---|---|---|---|---|
| Nov 19 | Metrics in Open Beta for JS and Pythonunverified | Sentry | Beta | |
| Nov 19 | Build dynamic, content-rich websites with Figma Sites CMS, now in public betaunverified | Figma | Beta | |
| Nov 19 | Gemini 3 Pro is liveunverified | Notion | Update | |
| Nov 19 | Tailscale v1.90.8unverified | Tailscale | Update | |
| Nov 19 | Tailscale container image v1.90.8unverified | Tailscale | Update | |
| Nov 19 | Tailscale Kubernetes operator v1.90.8unverified | Tailscale | Update |
Sources: each vendor's own release notes, changelogs and GitHub releases, read daily to monthly by how often it posts. Logos via logo.dev; trademarks belong to their owners.