Process large-scale inference workloads asynchronously with the new Batch API and Files API
Process large-scale inference workloads asynchronously with the new Batch API and Files API. Submit up to 50,000 requests in a single batch job and get 50% cost savings. Learn more in our Batch guide.
Also shipped Dec 18, 2025Cerebras in December 2025 →
Response Healing: Reduce JSON Defects by 80%+
Response Healing is a new feature that automatically corrects malformed JSON responses from LLMs before they reach the application.
WAF Release - 2025-12-18
This week's release focuses on improvements to existing detections to enhance coverage. Key Findings Existing rule enhancements have been deployed to improve detection resilience against broad classes of web attacks and strengthen behavioral coverage.
December Release Spotlight
OpenRouter released updates including Response Healing for structured outputs, chatroom notifications, and long-context model rankings.
AI Crawl Control - New AI Crawl Control Overview tab
The Overview tab is now the default view in AI Crawl Control. The previous default view with controls for individual AI crawlers is available in the Crawlers tab. What's new Executive summary , Monitor total requests, volume change, most common status code, most popular path, and high-volume activity Operator grouping , Track crawlers by their operating...
Analytics - Improved accuracy of cached request classification in analytics
The cached/uncached classification logic used in Zone Overview analytics has been updated to improve accuracy. Previously, requests were classified as "cached" based on an overly broad condition that included blocked 403 responses, Snippets requests, and other non-cache request types.
More from Cerebras InferenceEvery Cerebras Inference release →
Added support for parallel tool calling, allowing models to request multiple tool invocations simultaneously...
Added support for parallel tool calling, allowing models to request multiple tool invocations simultaneously in a single response. This reduces latency when handling queries that require multiple independent operations. Learn more in our Tool Calling guide.
Streaming Support Streaming is now supported for all models, including with structured output requests...
Streaming Support Streaming is now supported for all models, including with structured output requests (response_format, tools). Reasoning Format Controls Added reasoning_format parameter for reasoning models, giving you control over how reasoning text appears in responses.
Added support for prompt caching, which automatically stores and reuses prompt prefixes to reduce latency and...
Added support for prompt caching, which automatically stores and reuses prompt prefixes to reduce latency and improve time to first token for similar requests. Learn more in our Prompt Caching guide.
Constrained Decoding Generally Available Constrained decoding has moved to General Availability (GA) with...
Constrained Decoding Generally Available Constrained decoding has moved to General Availability (GA) with expanded capabilities. Supported models Structured Outputs and Tool Calling with strict: true are now available on the following models: gpt-oss-120b llama-3.1-8b qwen-3-235b-a22b-instruct-2507 qwen-3-32b zai-glm-4.6 zai-glm-4.7 New capabilities...
We now support Predicted Outputs for faster generation when large portions of the output are known in advance
We now support Predicted Outputs for faster generation when large portions of the output are known in advance. Provide a draft of the expected response via the prediction field, and the model will efficiently reuse unchanged tokens while regenerating only those that differ. Ideal for code editing, document revisions, and template-based responses.
Prioritize requests to the API to balance latency sensitivity and resource allocation across your workloads...
Prioritize requests to the API to balance latency sensitivity and resource allocation across your workloads with the new Service Tiers feature. Learn more in our Service Tiers guide.
API Version 2 Available for Testing API version 2 is now available for testing via the...
API Version 2 Available for Testing API version 2 is now available for testing via the X-Cerebras-Version-Patch header. This version introduces stricter validation and breaking changes.