New dedicated models: GLM 5, GLM 5.1, and Kimi K2.6 Z.AI's GLM 5 and GLM 5.1 and Moonshot AI's Kimi K2.6 are now supported on Dedicated Endpoints.
Validation Errors Now Return 400 Instead of 422 API requests that fail validation now return HTTP 400 Bad Request instead of 422 Unprocessable Entity, aligning the HTTP status code with standard behavior across major inference providers.
New parameter: prompt_cache_key /v1/chat/completions and /v1/completions now accept an optional prompt_cache_key parameter. Requests that share the same key are routed together so they reuse the same prompt cache, increasing cache hits and reducing time to first token.
Payload Optimization: msgpack and gzip /v1/chat/completions and /v1/completions now accept request bodies encoded with msgpack (Content-Type: application/vnd.msgpack) and/or compressed with gzip (Content-Encoding: gzip). This can significantly reduce payload size and improve TTFT for requests with long prompts.
Releasesby Glyph