Monitor your dedicated inference endpoints with the new Metrics API, providing Prometheus-compatible metrics for requests, tokens, latency percentiles, and endpoint health. Metrics are aggregated at the minute level and integrate directly with Prometheus. Learn more in our Metrics guide.
API Version 2 Available for Testing API version 2 is now available for testing via the X-Cerebras-Version-Patch header. This version introduces stricter validation and breaking changes.
Prioritize requests to the API to balance latency sensitivity and resource allocation across your workloads with the new Service Tiers feature. Learn more in our Service Tiers guide.
Constrained Decoding Generally Available Constrained decoding has moved to General Availability (GA) with expanded capabilities. Supported models Structured Outputs and Tool Calling with strict: true are now available on the following models: gpt-oss-120b llama-3.1-8b qwen-3-235b-a22b-instruct-2507 qwen-3-32b zai-glm-4.6 zai-glm-4.7 New capabilities...
Releasesby Glyph