Shared Serverless for Asset Bundles (Beta)
Beta2 days agoUnverifiedAdded Oct 24, 2026
With Shared Serverless for Asset Bundles, notebooks and files in the same bundle can share serverless compute and an environment defined in the bundle-root pyproject.toml file. Workspace admins can enable Project-Scoped Shared Compute on the Previews page . See Shared Serverless for Asset Bundles .
Topics: Notebooks
More Databricks Data Intelligence Platform releases
Every Databricks Data Intelligence Platform releaseDataFrame caching on serverless compute is now in Public Preview
Databricks now supports DataFrame caching on serverless compute via df.cache() or df.persist(), allowing users to reuse results within a session.
Databricks Runtime 19: October 19, 2026
Behavioral changes Spark Connect DataFrame execution metrics now hide internal operators and metrics associated with row filters and column masks. This protects information about policy execution when inspecting df.executionInfo.metrics , including its text representation. The boundary of the protected portion of the plan and its own metrics remain visible.
Filter data per end user with OAuth custom identity claims
You can now add a custom identity claim to a service principal's OAuth token and filter rows by it in a dynamic view or ABAC policy. Serve many end users through one service principal while each sees only their own data. See Filter data per end user with OAuth custom identity claims .
DeepSeek V4.1 Flash is scheduled for retirement
DeepSeek V4.1 Flash will be retired on November 19, 2026. DeepSeek V4.1 Flash (1017) is the recommended replacement. See Deprecated and retired models for migration guidance.
ADBC driver for Power BI is now generally available
The Arrow Database Connectivity (ADBC) driver for the Databricks connector for Power BI is now generally available. ADBC is the default driver for new connections in Power BI Desktop and the Power BI service. See Configure ADBC or ODBC driver for Power BI .
On-demand state repartitioning is now generally available
On-demand state repartitioning is now generally available. You can resize the number of shuffle partitions for a stateful Structured Streaming query or Lakeflow pipeline without losing checkpoint state. See On-demand state repartitioning for stateful streaming queries .
AI Runtime will soon be available by default for workspaces with the compliance security profile enabled
AI Runtime is scheduled to become generally available on October 15, 2026, on AWS and Azure for workspaces without the compliance security profile enabled. AI Runtime will be available by default for eligible workspaces with the compliance security profile enabled in mid November. Availability depends on the supported compliance standards and regions.
Databricks AI Runtime SDK replaces serverless_gpu
Starting in GPU environment version 6, the Databricks AI Runtime SDK ( databricks-sdk-air ) replaces the deprecated serverless_gpu package. It provides the @distributed and ray_init APIs and the databricks.air.data utilities under the databricks.air namespace. The gpus and gpu_type arguments are renamed to num_accelerators and accelerator_type .
Also shipped on Oct 22, 2026
Databricks in October 2026Trace and evaluate Cursor agents with Langfuse, powered by ClickHouse
Users can now connect Cursor to Langfuse to trace agent turns and analyze model and tool calls, with ClickHouse providing the underlying analytics infrastructure.
The AI.TRANSLATE function lets you translate text strings between languages
The AI.TRANSLATE function lets you translate text strings between languages. AI.TRANSLATE supports standard Neural Machine Translation (NMT) workloads and Translation LLM (TLLM) capabilities. This function is generally available (GA).
Replit Monitoring Agent: Your very own software engineering team
Replit Monitoring Agent is an autonomous tool that investigates production alerts, identifies causes, applies fixes, and deploys them to production for internal apps.
You can configure Direct VPC ingress for Cloud Run instances ( Preview )
You can configure Direct VPC ingress for Cloud Run instances ( Preview ). Direct VPC ingress lets Cloud Run instances on a VPC network use their own ephemeral private IP address to communicate with each other and with other resources on the VPC network.
Gemini Enterprise: Single-user quota limits
Gemini Enterprise administrators can configure single-user quota limits on the Usage & Spending > Usage page in the Google Cloud console to prevent an individual user from using all of an edition's shared subscription quota pool.
Optimize AI costs with Agent Observability
Datadog introduced Agent Observability to help engineers identify applications driving AI spend, prioritize savings, and validate cost changes against performance.