Releasesby IbisFilter data per end user with OAuth custom identity claims
Update5 days agoUnverifiedAdded Oct 21, 2026
You can now add a custom identity claim to a service principal's OAuth token and filter rows by it in a dynamic view or ABAC policy. Serve many end users through one service principal while each sees only their own data. See Filter data per end user with OAuth custom identity claims .
Topics: Governance, Security
More Databricks Data Intelligence Platform releases
Every Databricks Data Intelligence Platform releaseDatabricks Runtime 19: October 19, 2026
Behavioral changes Spark Connect DataFrame execution metrics now hide internal operators and metrics associated with row filters and column masks. This protects information about policy execution when inspecting df.executionInfo.metrics , including its text representation. The boundary of the protected portion of the plan and its own metrics remain visible.
DeepSeek V4.1 Flash is scheduled for retirement
DeepSeek V4.1 Flash will be retired on November 19, 2026. DeepSeek V4.1 Flash (1017) is the recommended replacement. See Deprecated and retired models for migration guidance.
DataFrame caching on serverless compute is now in Public Preview
DataFrame caching on serverless compute is now in Public Preview . You can cache a DataFrame with df.cache() or df.persist() on serverless compute to reuse an expensive result for the rest of your session.
ADBC driver for Power BI is now generally available
The Arrow Database Connectivity (ADBC) driver for the Databricks connector for Power BI is now generally available. ADBC is the default driver for new connections in Power BI Desktop and the Power BI service. See Configure ADBC or ODBC driver for Power BI .
On-demand state repartitioning is now generally available
On-demand state repartitioning is now generally available. You can resize the number of shuffle partitions for a stateful Structured Streaming query or Lakeflow pipeline without losing checkpoint state. See On-demand state repartitioning for stateful streaming queries .
AI Runtime will soon be available by default for workspaces with the compliance security profile enabled
AI Runtime is scheduled to become generally available on October 15, 2026, on AWS and Azure for workspaces without the compliance security profile enabled. AI Runtime will be available by default for eligible workspaces with the compliance security profile enabled in mid November. Availability depends on the supported compliance standards and regions.
Databricks AI Runtime SDK replaces serverless_gpu
Starting in GPU environment version 6, the Databricks AI Runtime SDK ( databricks-sdk-air ) replaces the deprecated serverless_gpu package. It provides the @distributed and ray_init APIs and the databricks.air.data utilities under the databricks.air namespace. The gpus and gpu_type arguments are renamed to num_accelerators and accelerator_type .
Feature Views will soon be available by default for workspaces with the compliance security profile enabled
Feature Views are now generally available. They will be automatically enabled for workspaces with the compliance security profile enabled in mid-November 2026. Define and compute features declaratively from batch or streaming data, then use them for model training and online serving. See Feature Views .
Also shipped on Oct 19, 2026
Databricks in October 2026Training Upcoming Serverless Training deprecation: DeepSeek V4 Flash (0731) On November 2, 2026 , DeepSeek V4...
Training Upcoming Serverless Training deprecation: DeepSeek V4 Flash (0731) On November 2, 2026 , DeepSeek V4 Flash (0731) will be removed from the shared Serverless Training pool. This change applies only to Serverless Training. If you train DeepSeek V4 Flash (0731) on Serverless Training, migrate to DeepSeek V4.1 Flash 1017 before November 2, 2026.
Cloud Workload Security is now available in Beta
Cloud Workload Security (CWS) is now available in Beta. Apply policy controls to cloud API requests before they reach your cloud provider. Define policies with request filters and Rego checks. For example, block requests that would make an R2 bucket public. Use workloads and policy sets to target your cloud environments.
Copilot model policy API for enterprise, orgs, and teams
You can now use the REST API to retrieve and update Copilot model policies for enterprises, enterprise teams, enterprise apps, and organizations. What’s new GET and PATCH endpoints are now generally available for model policies at four levels: Enterprise: /enterprises/{enterprise}/copilot/model-policies Enterprise teams...
GitHub Copilot models deprecated on October 19, 2026
As of today, October 19, 2026, we have deprecated the following models across most GitHub Copilot experiences (including Copilot Chat, inline edits, ask and agent modes, and code completions). These deprecations were announced on September 18, 2026 .
Postgres wait events, now in Query Insights
Query Insights for ClickHouse Managed Postgres now includes wait event breakdowns, blocked-session charts, and lock-wait charts. These metrics are also available in Prometheus.
Send OpenTelemetry traces to Agent Observability, no SDK required
You can now send OpenTelemetry traces straight to Agent Observability, without the SDK. If your agents already emit OpenTelemetry generative AI spans, from your framework, an instrumentation library, or spans you write yourself, keep your existing route through Grafana Alloy or an OpenTelemetry Collector and opt in your AI spans with a single attribute.