Releasesby GlyphWe now support Predicted Outputs for faster generation when large portions of the output are known in advance
We now support Predicted Outputs for faster generation when large portions of the output are known in advance. Provide a draft of the expected response via the prediction field, and the model will efficiently reuse unchanged tokens while regenerating only those that differ. Ideal for code editing, document revisions, and template-based responses.