Data and AI releases

548 this month · 176 companies

Lakeflow Designer Summer Release

UpdateVerified

The Lakeflow Designer Summer Release adds new operators, expands the Output and Join operators, and improves the canvas editing experience. The following updates are now available: Prepare operator : Use the new Prepare operator for common data-cleansing tasks, including changing text case and data types, replacing values, and applying formulas.

GovernanceBIObservability

Read on docs.databricks.com

Also shipped Jul 24, 2026Databricks in July 2026 →

Skill and plugin sharing in CoCo (Public Preview)

Skill and plugin sharing is now available in public preview. Share, discover, and govern CoCo skills and plugins across your Snowflake account. Publish them as Cortex Extension objects that teammates can find and install, with administrator certification, access control, and usage telemetry. For more information, see Share skills and plugins .

Preview
Source ↗

More from LakeflowEvery Lakeflow release →

Unit testing for pipelines (Beta)

You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming tables, expectations, and append flows.

Beta
Source ↗

Override the REPLACE WHERE predicate for a single refresh

You can now override a standalone streaming table's defined REPLACE WHERE predicate for a single refresh by adding a WHERE clause to the REFRESH STREAMING TABLE command. The override applies only to that refresh and doesn't change the table definition, which is useful for one-time backfills and corrections.

Update
Source ↗

Reddit Ads connector is now available in Beta

The managed Reddit Ads connector in Lakeflow Connect is now available in Beta. You can use the connector to ingest advertising campaign data and performance metrics from Reddit Ads into Databricks. See Reddit Ads connector .

Beta
Source ↗

OpenAI connector (Beta)

The OpenAI connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the OpenAI Organization Admin API to ingest organization administration data, such as users, projects, API keys, usage, costs, and audit logs, from OpenAI into Databricks.

Beta
Source ↗

Anthropic managed ingestion connector (Beta)

The Anthropic connector in Lakeflow Connect is now available in Beta. The connector allows you to ingest Compliance API data , audit activity, organizations, users, roles, groups, settings, and Claude chats and messages , from Anthropic into Databricks. See Anthropic connector .

Beta
Source ↗

Environment variables for serverless jobs are in Beta

Environment variables for serverless Lakeflow Jobs tasks are in Beta . You can define named environment variable entries at the job level and select one for each task to pass deployment-specific configuration to your application code. A workspace admin must enable the preview from the workspace Previews page.

Beta
Source ↗