vLLM 0.34.0
v0.34.0 1,061 commits from 412 contributors (120 new). Thank you! TL;DR - 10 new models (Mistral Large 4, MiniMax-M3.1-Flash, Nemotron-3.5-Transcribe, and more!) - Extensible KV cache is on by default: vLLM sizes the KV cache from memory actually free after warmup, so most models get a bigger cache and more throughput - in most cases you should now remove...
Also shipped Nov 16, 2026vLLM in November 2026 →
Deferred tier for asynchronous model calls on the Interactions API
Google Cloud announced general availability for the Deferred tier on the Gemini Enterprise Agent Platform. It offers a 50% discount compared to Standard PayGo rates for asynchronous Gemini model calls, providing a 24-hour completion window and 7-day state retention.
DeepSeek-V4.1-Flash-1017 is available in Public Preview
DeepSeek-V4.1-Flash-1017 is available in public preview as a fully managed model in Vertex AI Model Garden. The updated model features improved reasoning, coding, agentic, and visual capabilities, supporting multimodal inputs with up to 1M context tokens.
OpenAI CSAM Image Classifier is now available at no cost for approved organizations
OpenAI made its CSAM Image Classifier available at no cost to approved organizations. The tool returns separate classification signals for potential child sexual abuse material and potential AI-generated CSAM to assist human review processes.
Budget limit increased to 40,000 budgets per account
GitHub increased the maximum budget limit for GitHub Enterprise Cloud accounts from 10,000 to 40,000 budgets. The limit applies automatically on github.com and GHE.com to support organizations managing spending across many users and cost centers.
Workforce Identity Federation is GA for Looker Google Cloud core instances
Workforce Identity Federation is now generally available as the primary authentication method for Looker (Google Cloud core) instances using public secure, private, or hybrid connections. It can be configured using the Google Cloud console or gcloud CLI during instance creation or updates.
GitHub Copilot models deprecated on November 16, 2026
GitHub deprecated Claude Opus 4.8, Claude Opus 5, and GPT-5.6 Terra across most GitHub Copilot features. Alternative models including Claude Opus 5.5 and GPT-6 variants are automatically enabled for Copilot Enterprise and Business subscriptions under standard settings.
More from vLLMEvery vLLM release →
vLLM 0.32.0
v0.32.0 Highlights This release features 814 commits from 363 contributors (121 new)! - Structured decisions and generic parsers: the new POST /v1/systemone endpoint answers choice, noul and score questions over a structured state , is served by default (#60677, #60696), and also runs on Cloudflare/clef-omni , LiquidAI/d1-3B and DiffusionGemma .
vLLM 0.31.0
v0.31.0 Highlights This release features 717 commits from 307 contributors (96 new)! - DeepSeek-V4.1-Flash performance: FlashMLA mega attention with the V4.1 NVFP4 compressed KV cache is now the SM100 default ; DeepGEMM sparse MQA logits for the indexer and Mega-Gate fusing the gate GEMM with expert selection ; decoder boundaries fuse the TP all-reduce, mHC...
vLLM 0.30.0
v0.30.0 Highlights This release features 762 commits from 315 contributors (104 new)! New models : DeepSeek-V4.1-Flash ( #56214 , #56228 , #56208 ) with the whole KV stored in MXFP8 through the FlashMLA V4.1 record on SM100 ( #56893 ), DeepGEMM Mega-mHC ( #56962 ), and async Engram prefetch with Engram DP sharding ( #56512 ); DeepSeek-V4-Flash-Vision-Exp (...
vLLM 0.29.0
v0.29.0 Highlights This release features 594 commits from 277 contributors (91 new)! Model Runner V2 is now the default for all models ( #53183 ), completing the rollout that began with pooling models ( #48290 ).