4 releases · 1 product · 1 Deprecation
Added support for retrieving log probabilities via the logprobs parameter for the Completions endpoint. Set to an integer (0-20) to return the most likely alternative tokens at each position, or null to disable.
We're gradually introducing multi-token streaming across our models. Instead of sending tokens individually, we'll now deliver them in batches through 200 evenly-spaced events per second. This change eliminates the artificial delays that occurred with single-token streaming.
Updated support for OpenAI GPT-OSS (gpt-oss-120b) Tool calling with strict: true (constrained decoding) Response format with json_schema when using strict=true Response format with json_object when using strict=true tool_choice: none Updated JSON Schema limitations: Nested levels increases from 5 to 10 Max properties increases from 100 to 500 Enabled...
Releasesby Glyph