Data and AI releases

548 this month · 176 companies

vLLM 0.29.0

UpdateNot yet verified

v0.29.0 Highlights This release features 594 commits from 277 contributors (91 new)! Model Runner V2 is now the default for all models ( #53183 ), completing the rollout that began with pooling models ( #48290 ).

Performance

Read on github.com

Also shipped Sep 10, 2026vLLM in September 2026 →

External secret providers (Preview)

External secret providers are now in preview. If your organization already keeps API keys, database passwords, and similar values in AWS Secrets Manager, Azure Key Vault, or Google Cloud Secret Manager, Snowflake can read those values when a query needs them, so you don't have to maintain a second copy in a Snowflake secret .

Preview
Source ↗

More from vLLMEvery vLLM release →

vLLM 0.30.0

v0.30.0 Highlights This release features 762 commits from 315 contributors (104 new)! New models : DeepSeek-V4.1-Flash ( #56214 , #56228 , #56208 ) with the whole KV stored in MXFP8 through the FlashMLA V4.1 record on SM100 ( #56893 ), DeepGEMM Mega-mHC ( #56962 ), and async Engram prefetch with Engram DP sharding ( #56512 ); DeepSeek-V4-Flash-Vision-Exp (...

Update
Source ↗

vLLM 0.31.0

v0.31.0 Highlights This release features 717 commits from 307 contributors (96 new)! - DeepSeek-V4.1-Flash performance: FlashMLA mega attention with the V4.1 NVFP4 compressed KV cache is now the SM100 default ; DeepGEMM sparse MQA logits for the indexer and Mega-Gate fusing the gate GEMM with expert selection ; decoder boundaries fuse the TP all-reduce, mHC...

Update
Source ↗

vLLM 0.32.0

v0.32.0 Highlights This release features 814 commits from 363 contributors (121 new)! - Structured decisions and generic parsers: the new POST /v1/systemone endpoint answers choice, noul and score questions over a structured state , is served by default (#60677, #60696), and also runs on Cloudflare/clef-omni , LiquidAI/d1-3B and DiffusionGemma .

Update
Source ↗