JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled
In early October 2026, running JAR tasks on serverless compute will be automatically enabled for workspaces with the compliance security profile enabled. Package your Java or Scala Spark code in a JAR and run it as a JAR task on serverless compute in a Lakeflow Job, without provisioning or managing clusters. See Create and run JARs on serverless compute .
Also shipped Sep 14, 2026Databricks in September 2026 →
Metadata for BigQuery Graph is automatically ingested and searchable in Knowledge Catalog
Metadata for BigQuery Graph is automatically ingested and searchable in Knowledge Catalog . This feature is available in preview .
BigQuery supports WHERE clauses inside aggregate function calls in preview
Aggregate function calls can now include a WHERE clause that filters their input with a boolean expression, simplifying conditional aggregation in SQL.
Multimodal AI_SUMMARIZE for automatic theme summarization (Public Preview)
Snowflake Cortex AI_SUMMARIZE is now available in public preview, enabling customers to summarize text and multimodal content, including images and documents, directly in Snowflake.
Zero-copy support for all table formats in interactive warehouses (General availability)
Support for all table formats in interactive warehouses is now generally available and is no longer in Preview .
Metadata for BigQuery Graph is now automatically ingested and searchable in Knowledge Catalog
Metadata for BigQuery Graph is now automatically ingested and searchable in Knowledge Catalog. This feature is available in preview . For more information, see Knowledge Catalog overview .
Gemini model deprecation and retirement date updates
The retirement and deprecation dates for the following Gemini models have been updated: Gemini 2.5 Flash Image ( gemini-2.5-flash-image ) : Deprecated and scheduled for retirement on March 15, 2027 (extended from October 2, 2026). Migrate to Gemini 3.1 Flash-Lite Image ( gemini-3.1-flash-lite-image ).
More from LakeflowEvery Lakeflow release →
Standard performance mode is now available for one-time runs in the Jobs API
You can now set performance_target to STANDARD in the Jobs API. Apache Airflow's DatabricksSubmitRunOperator also supports this. See Create and trigger a one-time run and Select a performance mode .
Session restore for serverless jobs is in Public Preview
Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the entire job. Databricks captures the snapshot automatically for eligible runs. See Session restore for serverless jobs .
Managed tables in Lakeflow pipelines (Beta)
You can now create managed tables in Lakeflow pipelines and write to them with one or more append flows. This feature is in Beta . You can also use import_checkpoint on an append flow to migrate an existing Structured Streaming workload into a pipeline without reprocessing the source. See create_table , CREATE TABLE ... FLOW (pipelines) , and append_flow .
Maintenance windows for continuous pipelines
You can now set a maintenance window on a continuous Lakeflow pipeline to control when Databricks applies platform updates that require a restart, such as new runtime versions and serverless infrastructure maintenance. Select a day of the week, a start hour, and a time zone, and Databricks starts maintenance only within that one-hour window.
Celigo connector (Beta)
The Celigo connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit log events, such as create, update, and delete operations on resources, from Celigo (integrator.io) into Databricks. Authentication uses a Celigo integrator.io API token.
Anysphere Organization connector (Beta)
The Anysphere Organization connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Organization Admin API to ingest organization members, groups, and group members into Databricks as daily snapshots.
Anaplan connector (Beta)
The Anaplan connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit trail events and user account records from your Anaplan tenant into Databricks. Authentication uses an Anaplan CA certificate and its paired private key. See Anaplan connector .
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available. Today, Lakeflow Connect ingests formula fields by taking a full snapshot on each pipeline run by default. When incremental formula field ingestion is generally available, full snapshots will no longer be the default.