Data and AI releases

This month1,182Companies169

1,182 this month · 169 companies

Databricks AI Runtime SDK replaces serverless_gpu

Update2 days agoUnverifiedAdded Oct 15, 2026

Starting in GPU environment version 6, the Databricks AI Runtime SDK ( databricks-sdk-air ) replaces the deprecated serverless_gpu package. It provides the @distributed and ray_init APIs and the databricks.air.data utilities under the databricks.air namespace. The gpus and gpu_type arguments are renamed to num_accelerators and accelerator_type .

Topics: Developer tools

Databricks's release notes

More Databricks Data Intelligence Platform releases

Every Databricks Data Intelligence Platform release
GAunverified

On-demand state repartitioning is now generally available

On-demand state repartitioning is now generally available. You can resize the number of shuffle partitions for a stateful Structured Streaming query or Lakeflow pipeline without losing checkpoint state. See On-demand state repartitioning for stateful streaming queries .

GAunverified

Feature Views are now generally available

Feature Views are now generally available for batch, streaming, and request-time data. They will be enabled for compliance security profile workspaces in mid-November 2026. See Feature Views .

Also shipped on Oct 13, 2026

Databricks in October 2026
Betaunverified

What's included:

- Three training methods: Supervised fine-tuning (SFT) , direct preference optimization (DPO) , and reinforcement learning with group relative policy optimization (GRPO) . Each method trains a low-rank adapter (LoRA) or the full model weights. Custom loss functions : Train with any objective you compute in PyTorch from the model's log-probabilities.