Fireworks AI releases Training Cookbook on PyPI and migrates repository
Fireworks AI published fireworks-training-cookbook 2026.11.5.1 on PyPI for Python 3.11+ and migrated its training cookbook to fw-ai-external/cookbook.
46 releases · 3 this month
Fireworks AI published fireworks-training-cookbook 2026.11.5.1 on PyPI for Python 3.11+ and migrated its training cookbook to fw-ai-external/cookbook.
Inference New Serverless mode: Ultra-fast (Preview) Ultra-fast is a new high-speed Serverless mode, now in Preview, for highly latency-sensitive applications. Ultra-fast variants aim for 6-8x generation speed, and up to 10x for agentic coding tasks. Like Fast, it is not a different model, so output quality is the same.
Training Serverless Training deprecation: DeepSeek V4 Flash (0731) DeepSeek V4 Flash (0731) is removed from the shared Serverless Training pool effective November 2, 2026. Migrate Serverless Training workloads to DeepSeek V4.1 Flash 1017 . This change applies only to Serverless Training.
Fireworks AI has added the Rune 26B-A4B model to its Serverless platform. This decision model processes documents and questions to return calibrated probabilities without generating text, and is billed based on input tokens only.
Fireworks AI updated its error reporting to provide more granular source identification for failures, including new error codes for parsing and transport issues.
Before 1.2.27, the sidecar returned HTTP 502 for two failures that weren't server-side: tito_model_malformed_output (unparseable model output) and tito_upstream_error (any sampling exception, including client timeouts and dropped connections). They are replaced by: tito_sdk_parse_error (422): the output couldn't be parsed into an assistant or tool message.
If you use any of the models below on serverless, migrate to a recommended replacement before November 7, 2026 . After that date, they will no longer be available via serverless endpoints.
Training Upcoming Serverless Training deprecation: DeepSeek V4 Flash (0731) On November 2, 2026 , DeepSeek V4 Flash (0731) will be removed from the shared Serverless Training pool. This change applies only to Serverless Training. If you train DeepSeek V4 Flash (0731) on Serverless Training, migrate to DeepSeek V4.1 Flash 1017 before November 2, 2026.
Training Upcoming Serverless Training deprecation: DeepSeek V4 Flash (0731) On November 2, 2026 , DeepSeek V4 Flash (0731) will be removed from the shared Serverless Training pool. This change applies only to Serverless Training. If you train DeepSeek V4 Flash (0731) on Serverless Training, migrate to DeepSeek V4.1 Flash 1017 before November 2, 2026.
Inference Doubled serverless rate limits for Small models We doubled the adaptive rate-limit ceilings for Small serverless models (less than 600B total parameters). The Small tier now has these ceilings: Total Prompt TPM: 216M Uncached Prompt TPM: 54M Generated TPM: 2.16M Medium and Large model ceilings are unchanged.
Inference Higher serverless rate limits for Small models We increased the adaptive rate-limit ceilings for Small serverless models and expanded the Small tier to cover models with less than 600B total parameters .
Training New Serverless Training model: GLM 5.3 Flash GLM 5.3 Flash is now available for LoRA workloads on the shared Serverless Training pool, with up to 200K context and both text and vision inputs. See the Serverless Training guide for setup and the training model catalog for current availability.
- DeepSeek V4 Pro (0813) , migrate to DeepSeek V4.1 Flash DeepSeek V4 Flash (0731) , migrate to DeepSeek V4.1 Flash DeepSeek V4 Flash Vision Exp , migrate to DeepSeek V4.1 Flash Muse Glimmer 30B , migrate to NVIDIA Nemotron 3.5 Lightning 30B A3B Kimi K2.6 , migrate to GLM 5.3 or Kimi K3 Kimi K2.7 Code , migrate to GLM 5.3 or Kimi K3 GLM 5.2 , including GLM...
Inference Serverless pricing update: DeepSeek V4.1 Flash On October 1, 2026 at 00:00 UTC , serverless pricing for DeepSeek V4.1 Flash changes (uncached input / cached input / output price per 1M tokens): Standard: $0.22 / $0.007 / $0.66 → $0.30 / $0.006 / $1.20 Priority: $0.275 / $0.00875 / $0.825 → $0.375 / $0.0075 / $1.50 This adjustment brings our...
If you use any of the models below on serverless, migrate to a recommended replacement before September 25, 2026 . After that date, they will no longer be available via serverless endpoints.
Training Training cost estimator The new training cost estimator helps you estimate what a training job will cost before you run it. Managed and Serverless estimates use published per-token rates. Dedicated estimates use allocated GPU-hour rates. Planning estimates are not quotes.
Platform Deployment tags and annotation API changes Deployment tags are customer-managed entries stored in a deployment's annotations map. firectl presents logical keys such as environment ; the REST API represents the same key as custom/environment . firectl: Version 1.8.3 adds deployment tag set , unset , and list , including atomic batch operations.
Inference Serverless rate limit ceilings now scale by model size Serverless adaptive rate limit ceilings now vary by model size tier. Smaller models ( Serverless rate limits for tier thresholds and ceiling values.
Training New Serverless Training models: DeepSeek V4 Flash 0731, Qwen 3.8 27B, and Muse Glimmer 30B The following models are now available for LoRA workloads on the shared Serverless Training pool: DeepSeek V4 Flash 0731 with up to 262K context Qwen 3.8 27B with up to 128K context Muse Glimmer 30B with up to 128K context See the Serverless Training guide...
- MiniMax M2.7 , migrate to MiniMax M3 GPT OSS 20B , migrate to GPT OSS 120B or Qwen3 8B for lower-latency workloads Kimi K2.6 Turbo / Fast , migrate to Kimi K2.6 (standard mode) Kimi K2.7 Code Fast , migrate to Kimi K2.7 Code (standard mode) DeepSeek V4 Pro , migrate to DeepSeek V4 Pro (0813)
Training Serverless Training deprecation: Qwen 3.5 9B and Qwen 3.6 27B Qwen 3.5 9B and Qwen 3.6 27B are deprecated from Serverless Training effective August 26, 2026. Migrate new and existing Serverless Training workloads to Qwen 3.8 27B . This change applies to the shared Serverless Training pool.
Platform SSO documentation: IdP-initiated SAML Updated the Custom SSO guide. IdP-initiated SAML is supported as an opt-in ( --enable-idp-initiated-sso ); the previous troubleshooting copy that said Fireworks only supported SP-initiated login was incorrect.
Inference Serverless deprecation: DeepSeek V4 Flash DeepSeek V4 Flash is deprecated from serverless. Migrate to DeepSeek V4 Flash (0731) .
Training SFT learning rate scheduler documentation Documented learning rate scheduler settings for supervised fine-tuning jobs, including constant , linear , and cosine schedules via firectl and the REST API lrScheduler object.
Inference, fine-tuning and deployments.
| Release-notes page | Site | Feed |
|---|---|---|
| Changelog docs.fireworks.ai | docs.fireworks.ai | None |