Data and AI releases

548 this month · 176 companies

Lakeflow Connect row filtering is now generally available

Generally availableVerified

Row filtering in Lakeflow Connect is now generally available. Row filtering allows you to ingest only the rows you need by applying conditions similar to a SQL WHERE clause, improving performance and minimizing data duplication.

SQLData integrationPerformance

Read on docs.databricks.com

Also shipped Jul 2, 2026Databricks in July 2026 →

VARIANT data type on Delta Direct tables (General availability)

With this release, Snowflake supports the VARIANT data type on Iceberg tables created from Delta table files in object storage (Delta Direct). When your Delta tables include variant columns, Snowflake maps them to the Snowflake VARIANT data type. You can query semi-structured data using VARIANT functions and dot or bracket notation.

GA
Source ↗

Upcoming deprecation of Gemini 2.5 Pro and Gemini 3 Flash

We will deprecate Gemini 2.5 Pro and Gemini 3 Flash across all GitHub Copilot experiences (including Copilot Chat, inline edits, ask and agent modes, and code completions) on July 31st, 2026: Model Deprecation date Suggested alternative Gemini 2.5 Pro 7-31-2026 Gemini 3.1 Pro Gemini 3 Flash 7-31-2026 Gemini 3.5 Flash Please update your workflows and...

Deprecation
Source ↗

More from LakeflowEvery Lakeflow release →

Veeva Vault connector (Beta)

The Veeva Vault connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses Veeva's Direct Data API to ingest all standard objects, custom objects, system tables, and audit trail tables from your Vault instance into Databricks.

Beta
Source ↗

MySQL integrated CDC pipeline is now in Beta

The integrated CDC pipeline for MySQL is now in Beta . An integrated CDC pipeline ingests change data from MySQL into Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway.

Beta
Source ↗

Run a subset of job tasks with their dependencies

When you run a subset of a job's tasks, you can now expand your selection to include each task's dependencies. Add the + modifier to a task key to also run its upstream tasks ( +my_task ), its downstream tasks ( my_task+ ), or both ( +my_task+ ). Start a partial run from the UI, the REST API, the Databricks CLI, the SDKs, or Declarative Automation Bundles.

Update
Source ↗

SQL alert task in Lakeflow Jobs is now generally available

The SQL alert task in Lakeflow Jobs is now generally available. Use the task to evaluate a Databricks SQL alert as part of a Lakeflow Job. The task returns its evaluation state as a task output value, so downstream tasks can branch on the result. See SQL alert task for jobs .

GA
Source ↗

REPLACE WHERE flows are now generally available

REPLACE WHERE flows for pipelines and standalone streaming tables are now generally available. Use them to replace only rows matching a predicate on each refresh, without reprocessing the full table history. See Batch processing with REPLACE WHERE flows .

GA
Source ↗

Excel file format support is now available by default

Excel file format support is now available by default for all workspaces. You can ingest, parse, and query .xls , .xlsx , and .xlsm files directly using built-in support, without external libraries or manual conversions. See Read and stream Excel files .

Update
Source ↗

Behavior changes for continuous jobs and pipelines

In early August 2026, continuous Lakeflow pipelines and jobs will receive updates to simplify configuration. You will be able to configure a continuous schedule directly from the pipeline page, including job-level settings such as performance mode . Configuring a continuous schedule this way wraps the pipeline in a continuous job.

Update
Source ↗