Shift dates in Lakeflow Jobs parameters with date arithmetic (Beta)
Dynamic value references in Lakeflow Jobs can now shift a date by a duration before formatting it. For example, {{(job.start_time - 1.day).iso_date}} passes the date of the day before the run started to a task. Date arithmetic is in Beta . See Shift dates with date arithmetic .
Also shipped Nov 9, 2026Databricks in November 2026 →
The following AlloyDB AI features and improvements are generally available ( GA ): - Smart batching for AI...
The following AlloyDB AI features and improvements are generally available ( GA ): Smart batching for AI functions: AI function acceleration is generally available for ai.if , ai.rank , ai.analyze_sentiment , ai.summarize , ai.extract , ai.classify , and ai.generate on AlloyDB clusters running PostgreSQL 17 and later.
To support your FinOps practices, you can now opt in to compute cost attribution in BigQuery editions
To support your FinOps practices, you can now opt in to compute cost attribution in BigQuery editions. This feature attributes billed compute charges directly to the query projects that use your administration project's reservation capacity.
Query performance troubleshooting and job and system performance comparison in the BigQuery jobs explorer are...
Query performance troubleshooting and job and system performance comparison in the BigQuery jobs explorer are generally available (GA). For more information, see Troubleshoot job performance and Diagnose performance regressions by comparing jobs and systems .
When you create or schedule a pipeline, you can specify the maximum number of concurrently executed pipeline...
When you create or schedule a pipeline, you can specify the maximum number of concurrently executed pipeline tasks. This feature is generally available (GA).
You can use compression functions in GoogleSQL to compress or decompress bytes or string values by using the...
You can use compression functions in GoogleSQL to compress or decompress bytes or string values by using the Zstandard (Zstd) lossless data compression algorithm. The following functions are supported: ZSTD_COMPRESS ZSTD_DECOMPRESS_TO_BYTES ZSTD_DECOMPRESS_TO_STRING These functions are in Preview .
Fast mode for Anthropic Claude models is generally available
Fast mode for supported Anthropic Claude models, starting with Claude Fable 5.2 ( claude-fable-5-2 ), is available in General Availability (GA) . You can set "speed": "fast" in online pay-as-you-go prediction requests to accelerate output token generation for latency-sensitive agentic workflows.
More from LakeflowEvery Lakeflow release →
New jobs compute will soon default to Auto access mode for workspaces with the compliance security profile enabled
New jobs compute in Databricks will default to Auto access mode. This mode uses Standard access mode unless specific requirements like GPU instances or older runtimes are met.
New jobs compute defaults to Auto access mode
Databricks updated the default access mode for new jobs compute in the UI to Auto. This change automatically selects Standard access mode unless specific runtime or hardware configurations are required.
AI Function tasks for jobs (Beta)
Databricks jobs now support AI Function tasks for parsing, extracting, or classifying files and table rows without writing SQL, currently in beta.
Okta connector is available in Beta
The managed Okta connector is now available in Beta in Databricks Lakeflow Connect. Workspace admins can enable Lakeflow Connect for Okta on the Previews page . Use the connector to ingest identity and access data from Okta into Databricks, including users, groups, group memberships, app integrations, devices, policies, and administrator roles.
Trigger Lakeflow Jobs when upstream jobs complete (Beta)
You can now run a Lakeflow Job when one or more upstream jobs complete, including across workspaces attached to the same Unity Catalog metastore. Configure dependencies on the downstream job. See Trigger jobs when upstream jobs complete .
Start Lakeflow Designer workflows from suggested or recent tables
Start a visual data prep in Lakeflow Designer from suggested, favorite, or recently used tables on the welcome screen. See Browse existing tables .
Write Lakeflow Designer results to Google Drive or SharePoint
Write Lakeflow Designer results to Google Drive or SharePoint with the Output operator. Each run creates or replaces a file of up to 2.75 MiB. See Output .
Set checkpoints across a Lakeflow Designer file
Set checkpoint options across a visual data prep file with Set all to Auto or Set all to On . See Configure operator checkpoints .