Releasesby GlyphIncremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available. Today, Lakeflow Connect ingests formula fields by taking a full snapshot on each pipeline run by default. When incremental formula field ingestion is generally available, full snapshots will no longer be the default.
Also shipped Sep 8, 2026Databricks in September 2026 →
Conversational analytics now supports predictive modeling questions using the AI.PREDICT function
Conversational analytics now supports predictive modeling questions using the AI.PREDICT function . This feature is in Preview .
Add and drop hybrid table constraints online (General availability)
With this release, you can add and drop UNIQUE and FOREIGN KEY constraints on an existing hybrid table by using alter table . Previously, you had to define these constraints when you created the table, so adding a foreign key to a table that was already serving a workload meant recreating and reloading the table.
Shadow traffic for gateways (Preview)
With this preview release, you can use a shadow traffic gateway to send all production requests to a primary service endpoint while mirroring a percentage of those requests to one or more shadow endpoints. Responses from shadow endpoints aren't returned to clients.
Second generation Openflow deployments and runtimes (General availability)
Second generation (gen 2) Openflow deployment and runtime SQL objects are now generally available on AWS and Azure. Create, modify, and remove gen 2 deployments and runtimes with CREATE , ALTER , DROP , SHOW , and DESCRIBE commands, or through the Openflow UI, with standard Snowflake RBAC on schema-scoped objects.
Gemini Enterprise: Semantic search support in Google Cloud Marketplace (Preview)
The agent search in Google Cloud Marketplace now supports semantic search, allowing you to find agents by describing their functionality (for example, "generate reports" or "translate text") without needing exact keyword matches. For more information, see Add and manage A2A agents from Google Cloud Marketplace .
OpenAI Prompt Cache Diagnostics is generally available in the Responses API
For GPT-5.6 and later, developers can compare cache reuse against a previous response, see reasons for cache misses and follow guidance to improve cache hit rates.
More from LakeflowEvery Lakeflow release →
Celigo connector (Beta)
The Celigo connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit log events, such as create, update, and delete operations on resources, from Celigo (integrator.io) into Databricks. Authentication uses a Celigo integrator.io API token.
Anysphere Organization connector (Beta)
The Anysphere Organization connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Organization Admin API to ingest organization members, groups, and group members into Databricks as daily snapshots.
Anaplan connector (Beta)
The Anaplan connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit trail events and user account records from your Anaplan tenant into Databricks. Authentication uses an Anaplan CA certificate and its paired private key. See Anaplan connector .
Zerobus Ingest into default storage is now in Public Preview
Ingesting into tables backed by default storage with Zerobus Ingest in Lakeflow Connect is now in Public Preview . See Create or identify the target table .
Managed tables in Lakeflow pipelines (Beta)
You can now create managed tables in Lakeflow pipelines and write to them with one or more append flows. This feature is in Beta . You can also use import_checkpoint on an append flow to migrate an existing Structured Streaming workload into a pipeline without reprocessing the source. See create_table , CREATE TABLE ... FLOW (pipelines) , and append_flow .
Maintenance windows for continuous pipelines
You can now set a maintenance window on a continuous Lakeflow pipeline to control when Databricks applies platform updates that require a restart, such as new runtime versions and serverless infrastructure maintenance. Select a day of the week, a start hour, and a time zone, and Databricks starts maintenance only within that one-hour window.
Standard performance mode is now available for one-time runs in the Jobs API
You can now set performance_target to STANDARD in the Jobs API. Apache Airflow's DatabricksSubmitRunOperator also supports this. See Create and trigger a one-time run and Select a performance mode .
Session restore for serverless jobs is in Public Preview
Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the entire job. Databricks captures the snapshot automatically for eligible runs. See Session restore for serverless jobs .