Data and AI releases

548 this month · 176 companies

Override the REPLACE WHERE predicate for a single refresh

UpdateVerified

You can now override a standalone streaming table's defined REPLACE WHERE predicate for a single refresh by adding a WHERE clause to the REFRESH STREAMING TABLE command. The override applies only to that refresh and doesn't change the table definition, which is useful for one-time backfills and corrections.

StreamingDeveloper tools

Read on docs.databricks.com

Also shipped Jul 22, 2026Databricks in July 2026 →

AI Gateway now supports streaming transcription

AI Gateway now supports streaming transcription . Previously, transcription required a complete audio file and returned the full transcript in a single response. Now you can stream audio in as it's captured and get transcript updates back as the model produces them, keeping latency low for uses like live captioning and voice input.

Beta
Source ↗

More from LakeflowEvery Lakeflow release →

Reddit Ads connector is now available in Beta

The managed Reddit Ads connector in Lakeflow Connect is now available in Beta. You can use the connector to ingest advertising campaign data and performance metrics from Reddit Ads into Databricks. See Reddit Ads connector .

Beta
Source ↗

Lakeflow Designer Summer Release

The Lakeflow Designer Summer Release adds new operators, expands the Output and Join operators, and improves the canvas editing experience. The following updates are now available: Prepare operator : Use the new Prepare operator for common data-cleansing tasks, including changing text case and data types, replacing values, and applying formulas.

Update
Source ↗

Unit testing for pipelines (Beta)

You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming tables, expectations, and append flows.

Beta
Source ↗

Anthropic managed ingestion connector (Beta)

The Anthropic connector in Lakeflow Connect is now available in Beta. The connector allows you to ingest Compliance API data , audit activity, organizations, users, roles, groups, settings, and Claude chats and messages , from Anthropic into Databricks. See Anthropic connector .

Beta
Source ↗

OpenAI connector (Beta)

The OpenAI connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the OpenAI Organization Admin API to ingest organization administration data, such as users, projects, API keys, usage, costs, and audit logs, from OpenAI into Databricks.

Beta
Source ↗