Data and AI releases

548 this month · 176 companies

JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled

UpdateVerified

In early October 2026, running JAR tasks on serverless compute will be automatically enabled for workspaces with the compliance security profile enabled. Package your Java or Scala Spark code in a JAR and run it as a JAR task on serverless compute in a Lakeflow Job, without provisioning or managing clusters. See Create and run JARs on serverless compute .

GovernanceSecurity

Read on docs.databricks.com

Also shipped Sep 14, 2026Databricks in September 2026 →

More from LakeflowEvery Lakeflow release →

Session restore for serverless jobs is in Public Preview

Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the entire job. Databricks captures the snapshot automatically for eligible runs. See Session restore for serverless jobs .

Preview
Source ↗

Managed tables in Lakeflow pipelines (Beta)

You can now create managed tables in Lakeflow pipelines and write to them with one or more append flows. This feature is in Beta . You can also use import_checkpoint on an append flow to migrate an existing Structured Streaming workload into a pipeline without reprocessing the source. See create_table , CREATE TABLE ... FLOW (pipelines) , and append_flow .

Beta
Source ↗

Maintenance windows for continuous pipelines

You can now set a maintenance window on a continuous Lakeflow pipeline to control when Databricks applies platform updates that require a restart, such as new runtime versions and serverless infrastructure maintenance. Select a day of the week, a start hour, and a time zone, and Databricks starts maintenance only within that one-hour window.

Update
Source ↗

Celigo connector (Beta)

The Celigo connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit log events, such as create, update, and delete operations on resources, from Celigo (integrator.io) into Databricks. Authentication uses a Celigo integrator.io API token.

Beta
Source ↗

Anysphere Organization connector (Beta)

The Anysphere Organization connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Organization Admin API to ingest organization members, groups, and group members into Databricks as daily snapshots.

Beta
Source ↗

Anaplan connector (Beta)

The Anaplan connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit trail events and user account records from your Anaplan tenant into Databricks. Authentication uses an Anaplan CA certificate and its paired private key. See Anaplan connector .

Beta
Source ↗