Lakeflow Connect row filtering is now generally available
Row filtering in Lakeflow Connect is now generally available. Row filtering allows you to ingest only the rows you need by applying conditions similar to a SQL WHERE clause, improving performance and minimizing data duplication.
Also shipped Jul 2, 2026Databricks in July 2026 →
VARIANT data type on Delta Direct tables (General availability)
With this release, Snowflake supports the VARIANT data type on Iceberg tables created from Delta table files in object storage (Delta Direct). When your Delta tables include variant columns, Snowflake maps them to the Snowflake VARIANT data type. You can query semi-structured data using VARIANT functions and dot or bracket notation.
Metadata-based sensitive data classification recommendations (Public Preview)
Snowflake is rolling out metadata-based sensitive data classification recommendations in Snowsight to help you identify databases that are likely to contain sensitive data and enable classification with one click.
[Launched] Generally available: Anthropic Claude Sonnet 5 on Azure Databricks
Azure Databricks now supports Anthropic Claude Sonnet 5 through Azure Databricks AI Model Serving. Claude Sonnet 5 is Anthropic's most agentic Sonnet model to date, delivering near-Opus-level intelligence with Sonnet's cost efficiency and speed. Designed
agent-memory-2026-07-22 beta header changes memory store listing behavior
With the new header, listing memories returns a stable server-defined order, depth accepts only 0 or 1, and path_prefix must end with / and match whole segments. Page cursors issued without the header are not valid with it.
Public preview: Restore a backup to a different region
You can now restore a serverless backup into a different region on the same cloud provider. Use the unstable version of the create index endpoint, specifying the backup as source_backup_id within spec.serverless and the target region there.
Upcoming deprecation of Gemini 2.5 Pro and Gemini 3 Flash
We will deprecate Gemini 2.5 Pro and Gemini 3 Flash across all GitHub Copilot experiences (including Copilot Chat, inline edits, ask and agent modes, and code completions) on July 31st, 2026: Model Deprecation date Suggested alternative Gemini 2.5 Pro 7-31-2026 Gemini 3.1 Pro Gemini 3 Flash 7-31-2026 Gemini 3.5 Flash Please update your workflows and...
More from LakeflowEvery Lakeflow release →
Veeva Vault connector (Beta)
The Veeva Vault connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses Veeva's Direct Data API to ingest all standard objects, custom objects, system tables, and audit trail tables from your Vault instance into Databricks.
MySQL integrated CDC pipeline is now in Beta
The integrated CDC pipeline for MySQL is now in Beta . An integrated CDC pipeline ingests change data from MySQL into Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway.
Run a subset of job tasks with their dependencies
When you run a subset of a job's tasks, you can now expand your selection to include each task's dependencies. Add the + modifier to a task key to also run its upstream tasks ( +my_task ), its downstream tasks ( my_task+ ), or both ( +my_task+ ). Start a partial run from the UI, the REST API, the Databricks CLI, the SDKs, or Declarative Automation Bundles.
SQL alert task in Lakeflow Jobs is now generally available
The SQL alert task in Lakeflow Jobs is now generally available. Use the task to evaluate a Databricks SQL alert as part of a Lakeflow Job. The task returns its evaluation state as a task output value, so downstream tasks can branch on the result. See SQL alert task for jobs .
Standard performance mode is now supported for materialized view or streaming table refreshes in jobs
Materialized view and streaming table refreshes that are orchestrated through a SQL task in a Lakeflow job now respect the job's Performance optimized setting. When the setting is turned off, the refresh uses standard performance mode, which consumes fewer DBUs.
REPLACE WHERE flows are now generally available
REPLACE WHERE flows for pipelines and standalone streaming tables are now generally available. Use them to replace only rows matching a predicate on each refresh, without reprocessing the full table history. See Batch processing with REPLACE WHERE flows .
Excel file format support is now available by default
Excel file format support is now available by default for all workspaces. You can ingest, parse, and query .xls , .xlsx , and .xlsm files directly using built-in support, without external libraries or manual conversions. See Read and stream Excel files .
Behavior changes for continuous jobs and pipelines
In early August 2026, continuous Lakeflow pipelines and jobs will receive updates to simplify configuration. You will be able to configure a continuous schedule directly from the pipeline page, including job-level settings such as performance mode . Configuring a continuous schedule this way wraps the pipeline in a continuous job.