Releasesby Glyphdeveloper Message Role (gpt-oss-120b) The Chat Completions API now supports the developer message role for...
developer Message Role (gpt-oss-120b) The Chat Completions API now supports the developer message role for gpt-oss-120b, aligning with the OpenAI API message format. The developer role is functionally equivalent to system , the system role remains supported for backwards compatibility. Other models do not support the developer role.
Also shipped Mar 26, 2026Cerebras in March 2026 →
Mutual Exclusivity
What it is: Grouping guides and surveys into a mutual exclusivity set ensures each end-user sees at most one from the group. The primary use case is platform-specific announcements: create a version for iOS and another for Android, add both to the group, and users see only the version that matches their device.
TTS speak speed (Early Access)
You can now control the speaking rate of Deepgram TTS in the Voice Agent API using the agent.speak.provider.speed parameter. This parameter accepts a float value between 0.7 and 1.5 , with 1.0 as the default.
Updated LLM models
New OpenAI models , Two new models are now available in the Standard pricing tier: gpt-5.4-nano gpt-5.4-mini Gemini 2.0 Flash deprecated , The gemini-2.0-flash model is now deprecated. We recommend migrating to gemini-2.5-flash or a newer Gemini model. See the Google models table for alternatives.
Access - Code Mode for MCP server portals
MCP server portals support Code Mode MCP server patterns , a technique that reduces context window usage by replacing individual tool definitions with a single code execution tool. Code Mode is turned on by default on all portals. To turn it off, edit the portal in Access controls > AI controls and turn off Code Mode under Basic information .
Access - Context optimization for MCP server portals
MCP server portals support two context optimization options that reduce how many tokens tool definitions consume in the model's context window. Both options are activated by appending the optimize_context query parameter to the portal URL. minimize_tools Strips tool descriptions and input schemas from all upstream tools, leaving only their names.
Containers - Easily connect Containers and Sandboxes to Workers
Containers and Sandboxes now support connecting directly to Workers over HTTP. This allows you to call Workers functions and bindings , like KV or R2 , from within the container at specific hostnames. Run Worker code Define an outbound handler to capture any HTTP request or use outboundByHost to capture requests to individual hostnames and IPs.
More from Cerebras InferenceEvery Cerebras Inference release →
Temperature Parameter: Increased Maximum The maximum allowed value for the temperature parameter for Chat...
Temperature Parameter: Increased Maximum The maximum allowed value for the temperature parameter for Chat Completions has been increased from 1.5 to 2.0. This aligns with the range supported by OpenAI, Fireworks, and other major LLM providers. Higher temperature values produce more random and creative outputs.
Rolling out selective 4-bit weight-only quantization for supported models, targeting non-sensitive layers...
Rolling out selective 4-bit weight-only quantization for supported models, targeting non-sensitive layers while preserving full precision for sensitive layers, in line with industry standards. Learn more in Supported Models.
Logprob Consistency Logprobs are now computed from the model's raw output, before applying temperature scaling
Logprob Consistency Logprobs are now computed from the model's raw output, before applying temperature scaling. Previously, logprob values would vary with temperature , they now remain consistent regardless of the temperature used. This aligns with standard behavior across major inference providers and vLLM. Sampled outputs are unaffected.
Deprecating disable_reasoning parameter for zai-glm-4.7 The disable_reasoning parameter is deprecated and...
Deprecating disable_reasoning parameter for zai-glm-4.7 The disable_reasoning parameter is deprecated and will no longer be supported after July 21, 2026. Migrate to reasoning_effort="none" to disable reasoning on zai-glm-4.7. See the Reasoning guide and Chat Completions API reference for details.
Streaming: Server-Sent Events (SSE) Streaming responses for Chat Completions (/v1/chat/completions) and...
Streaming: Server-Sent Events (SSE) Streaming responses for Chat Completions (/v1/chat/completions) and Completions (/v1/completions) now emit a standard data: [DONE] SSE event at the end of the stream, following the SSE standard (see the living specification). The [DONE] marker is guaranteed to appear exactly once and is always the last event in the stream.
New Sampling Parameters The following parameters are now available on all models: - frequency_penalty –...
New Sampling Parameters The following parameters are now available on all models: frequency_penalty – Reduces repetition by penalizing tokens based on how often they have appeared so far presence_penalty – Reduces repetition by penalizing tokens that have appeared at least once logit_bias – Adjusts the likelihood of specific tokens appearing in the response
Payload Optimization: msgpack and gzip /v1/chat/completions and /v1/completions now accept request bodies...
Payload Optimization: msgpack and gzip /v1/chat/completions and /v1/completions now accept request bodies encoded with msgpack (Content-Type: application/vnd.msgpack) and/or compressed with gzip (Content-Encoding: gzip). This can significantly reduce payload size and improve TTFT for requests with long prompts.
New parameter: prompt_cache_key /v1/chat/completions and /v1/completions now accept an optional...
New parameter: prompt_cache_key /v1/chat/completions and /v1/completions now accept an optional prompt_cache_key parameter. Requests that share the same key are routed together so they reuse the same prompt cache, increasing cache hits and reducing time to first token.