Data and AI releases

548 this month · 176 companies

Databricks Data Intelligence Platform Release notes from Databricks

118 releases · 4 this month

Official notes RSS

Data quality monitoring anomaly detection is now generally available

Anomaly detection for data quality monitoring is now generally available. Enable it at the schema level to monitor the freshness and completeness of every table in the schema, based on historical data patterns. Results for all monitored tables are stored in the system.data_quality_monitoring.table_results system table, which is also now generally available.

Shared Serverless (Beta)

Shared Serverless allows notebooks and files within the same bundle to share serverless compute resources and environment configurations defined in a pyproject.toml file.

Beta
2 releases →

ADBC driver for Power BI is now generally available

The Arrow Database Connectivity (ADBC) driver for the Databricks connector for Power BI is now generally available. ADBC is the default driver for new connections in Power BI Desktop and the Power BI service. See Configure ADBC or ODBC driver for Power BI .

GA
Source ↗

Bundled BigQuery JDBC driver removal in Databricks Runtime 20

Starting with Databricks Runtime 20, Databricks Runtime no longer includes the bundled BigQuery JDBC driver, while Databricks Runtime 19 and earlier continue to include it. Classic compute workloads that use Spark JDBC with a jdbc:bigquery: URL fail with a driver-not-found error unless a BigQuery JDBC driver is installed.

Update
Source ↗

The counter_diff SQL window function is now available

The counter_diff window function calculates differences between consecutive cumulative counter values and handles counter resets, for time-series analysis of counter data. It is available in Databricks SQL and Databricks Runtime 19 and above. See counter_diff analytic window function .

Update
Source ↗

The Databricks Excel Add-in is now generally available

The Databricks Excel Add-in is now generally available. Connect Microsoft Excel to your Databricks workspace to browse and import governed Unity Catalog tables and views, run SQL queries, build pivot tables, use custom functions, and write data back to Unity Catalog.

GA
Source ↗

Git Folder Serverless is in Beta

You can now use Git Folder Serverless to share serverless compute and a pyproject.toml -managed environment across notebooks and files in a Git folder. See Git Folder Serverless .

Automatic change data feed is now generally available

Automatic change data feed (Auto CDF) computes row-level changes at query time using row tracking, without requiring you to manually enable change data feed on each Delta Lake or Apache Iceberg v3 table. Auto CDF removes write-time overhead and makes MERGE and UPDATE operations about 15% faster on tables that you query for changes.

ai_transcribe function (Beta)

The ai_transcribe() SQL function transcribes an audio file into text. It returns the transcript as time-stamped segments, and labels each segment with a speaker when speaker diarization is enabled for your workspace. The output is a VARIANT value, so you can chain it into other AI Functions. This feature is in Beta . See ai_transcribe function .

Beta
3 releases →

Query text is now masked by default in system tables and APIs

Because SQL statements can contain sensitive information, Databricks now masks query text in the following places: statement_text in system.query.history returns . query_text in the Query History API and the List Queries API returns . Keys in request_params in system.access.audit that contain SQL definitions are omitted.

Update
Source ↗

ai_prep_search supports plain text and markdown input (Beta)

The ai_prep_search() SQL function now accepts plain text and markdown STRING content in addition to the structured VARIANT output of ai_parse_document . You can now chunk and prepare text that you already have as a string for AI Search indexing and retrieval-augmented generation (RAG) pipelines, without first running it through document parsing.

Beta
Source ↗

Private network gateway is in Private Preview

Private network gateway is in Private Preview . A private network gateway connects Databricks serverless compute to resources in your VPC, on-premises systems, and the internet through a single managed gateway, reusing your existing network connectivity configuration (NCC).

Preview
2 releases →

Upcoming end of life for the Supervisor API

The Supervisor API (Beta) reaches end of life on September 30, 2026. After that date, the API is no longer available. Databricks recommends migrating to custom agents on Databricks Apps . See Supervisor API (Beta) (deprecated) .

Deprecation
Source ↗

Write data back to Databricks from Google Sheets

The Databricks Connector for Google Sheets now lets you write data from Google Sheets back to a Unity Catalog table. You can create a new table or overwrite an existing table without leaving Google Sheets. See Write data back to Databricks from Google Sheets .

Update
Source ↗

Manage project environments with %uv commands

You can now use %uv init , %uv add , and %uv sync in serverless notebooks running environment version 5 or above to create a Python project, add dependencies, and sync its environment. See Create reproducible project environments with %uv .

Update
Source ↗

Cross-workspace access for serverless (Beta)

You can now control serverless network traffic between Databricks workspaces. Account admins use cross-workspace access to set which source workspaces can reach a workspace (ingress) and which destination workspaces a workspace's serverless workloads can send traffic to (egress).

Beta
5 releases →

Databricks Runtime 19: August 10, 2026

New features and improvements collect_union aggregate function : SQL and the Scala and Python DataFrame APIs now support collect_union , which returns the distinct union of the elements in arrays within each group.

Update
Source ↗

ai_search function (Beta)

The ai_search() SQL function retrieves information from one or more AI Search indexes configured as knowledge sources. Given a natural-language query, the function generates optimized search queries, retrieves and deduplicates results across sources, reranks them by relevance, and returns the most relevant documents.

Beta
Source ↗

JAR tasks on serverless compute are now generally available

Package Scala or Java code as a JAR and run it as a task in a Lakeflow Job on serverless compute. Your JAR must match the Scala, Java Development Kit (JDK), and Databricks Connect versions of your serverless environment version. See Create and run JARs on serverless compute .

GA
Source ↗

Search and replace text across files

You can now search and replace text across files in a Databricks Git folder or Declarative Automation Bundles project from the Search pane. See Search and replace across files .

Update
Source ↗

Databricks Runtime maintenance updates (08/04)

New maintenance updates are available for supported Databricks Runtime versions. These updates include bug fixes, security patches, and performance improvements. For details, see: Databricks Runtime 18 LTS Databricks Runtime 18.2 Databricks Runtime 18.1 Databricks Runtime 17.3 LTS Databricks Runtime 16.4 LTS Databricks Runtime 15.4 LTS Databricks Runtime...

Update
Source ↗

Serverless compute access control is now generally available

Serverless compute access control is now generally available. Workspace admins can govern who runs serverless workloads through two built-in serverless compute objects: Default Interactive Compute (governs access to notebooks and Databricks Connect) and Default Automated Compute (governs access to jobs and Spark Declarative Pipelines on Lakeflow).

Web terminal on serverless GPU compute (AI Runtime) is in Public Preview

The web terminal in notebooks connected to serverless GPU compute (AI Runtime) is now in Public Preview . Use it to run shell commands, monitor GPU usage with nvidia-smi , install libraries, and manage files directly on the compute. This requires serverless GPU environment version 5 or above. See Run shell commands in Databricks web terminal .

Preview
Source ↗

Git CLI commands in Git folders are now in Public Preview

Git CLI commands in Git folders are now in Public Preview . Git folders that you create from the UI automatically get Git CLI access when your workspace is eligible, so you can run standard Git commands such as git stash , interactive rebase, pre-commit hooks, Git submodules, and Large File Storage (LFS) directly from a Databricks terminal.

Preview
3 releases →

Agentic code converter is in Beta

The agentic code converter is in Beta . Use it to convert legacy SQL dialects, such as T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata, to ANSI SQL in migration projects in your workspace.

Beta
Source ↗

AI Search High QPS is now generally available

AI Search High QPS is now generally available for standard endpoints. Set a target QPS on standard AI Search endpoints to power high-throughput, real-time workloads like search bars, recommendation systems, and entity matching. High QPS is enabled by default, but existing endpoints are not affected.

Allowlist partner platform IPs in context-based ingress control (Beta)

Context-based ingress control now supports Partner Platforms as a network source. Select a partner platform to allowlist the IPs that third-party apps use to connect to Databricks, including Power BI, Tableau Cloud, and dbt platform. Databricks manages and updates these IP lists automatically. See Network sources .

Beta
Source ↗

View warehouse activity details (General Availability)

The Activity details toggle in the SQL warehouse monitoring UI is now generally available. View color-coded annotations on the Running clusters chart that explain why a warehouse remains active, including query activity, fetching queries, open sessions, and idle states.

Object metadata column is now in Public Preview

The _object_metadata column is now in Public Preview. The _object_metadata column is a hidden metadata column that exposes object-level properties for objects in cloud storage, including MIME type, ETag, user-defined key-value metadata, system-defined metadata, and object tags. It is available starting from Databricks Runtime 18.1.

Preview
2 releases →

July 6, 2026

This serverless compute release includes updates from Databricks Runtime 18 . New features Spark Declarative Pipelines on Lakeflow streaming query ID : Spark Declarative Pipelines on Lakeflow can now set the streaming query ID on demand.

Preview
3 releases →
About and activity

Workspaces, compute, notebooks and platform administration.

Other Databricks products: Agent Bricks and Mosaic AI, AI/BI and Genie, Databricks Apps, Databricks SQL, Delta Lake, Lakebase, Lakeflow, MLflow, Unity Catalog

Releases per month
6Jun
28Jul
24Aug
26Sep
30Oct
4Nov
Official release-notes pages 14
Release-notes pageFeed
AI/BI (dashboards, Genie)
docs.databricks.com
None
Databricks CLI releases
github.com
RSS
Databricks Connect
docs.databricks.com
None
Databricks Runtime
docs.databricks.com
None
Declarative Automation Bundles
docs.databricks.com
None
Developer tools (CLI, SDK, Terraform)
docs.databricks.com
None
Feature Store
docs.databricks.com
None
Platform release notes (AWS)
docs.databricks.com
RSS
Python SDK releases
github.com
RSS
Serverless compute
docs.databricks.com
None
Serverless environment versions
docs.databricks.com
None
Terraform provider releases
github.com
RSS
Unity AI Gateway
docs.databricks.com
None
What's coming
docs.databricks.com
None