Releasesby GlyphUse cleaned AI answers in Lakeflow Designer (Public Preview)
Clean supported AI Function outputs in Lakeflow Designer for downstream transformations. Cleaned results include answer values, error messages, and raw responses in separate columns. See AI Function .
Also shipped Nov 9, 2026Databricks in November 2026 →
AlloyDB AI smart batching and sentiment analysis are generally available
AlloyDB AI smart batching for AI functions and the ai.analyze_sentiment function are now generally available on PostgreSQL 17 and later. Smart batching improves query performance by offloading AI operations asynchronously.
BigQuery compute cost attribution is available in preview
BigQuery now supports compute cost attribution in preview, allowing users to track billed compute charges at the project level based on reservation capacity usage for FinOps reporting.
BigQuery jobs explorer performance troubleshooting is generally available
BigQuery jobs explorer now provides generally available tools for troubleshooting query performance and comparing job and system performance to diagnose regressions.
BigQuery pipeline task concurrency limits are generally available
Users can now specify the maximum number of concurrently executed tasks when creating or scheduling BigQuery pipelines.
BigQuery adds Zstandard compression functions in preview
BigQuery now supports Zstandard (Zstd) compression and decompression functions for bytes and string values in GoogleSQL, currently available in preview.
AWS Glue adds 100 new native connectors for popular SaaS applications
AWS Glue now includes 100 native connectors for SaaS and REST API applications, enabling data integration without custom code. These connectors allow teams to reuse connections across ETL jobs with existing permission models.
More from LakeflowEvery Lakeflow release →
New jobs compute will soon default to Auto access mode for workspaces with the compliance security profile enabled
New jobs compute in Databricks will default to Auto access mode. This mode uses Standard access mode unless specific requirements like GPU instances or older runtimes are met.
New jobs compute defaults to Auto access mode
Databricks updated the default access mode for new jobs compute in the UI to Auto. This change automatically selects Standard access mode unless specific runtime or hardware configurations are required.
Shift dates in Lakeflow Jobs parameters with date arithmetic (Beta)
Dynamic value references in Lakeflow Jobs can now shift a date by a duration before formatting it. For example, {{(job.start_time - 1.day).iso_date}} passes the date of the day before the run started to a task. Date arithmetic is in Beta . See Shift dates with date arithmetic .
Distinguish Lakeflow Designer Python previews from full runs (Public Preview)
Python operators in Lakeflow Designer now expose config["is_preview"] so your code can skip side effects during previews. See Python preview mode .
Calculate across rows in Lakeflow Designer (Public Preview)
Use the Multi-Row Formula operator in Lakeflow Designer for running totals, ranks, moving averages, and other calculations across ordered rows. See Multi-Row Formula .
AI Function tasks for jobs (Beta)
Databricks jobs now support AI Function tasks for parsing, extracting, or classifying files and table rows without writing SQL, currently in beta.
Add aggregations for several Lakeflow Designer columns (Public Preview)
Select multiple columns when adding an aggregation in Lakeflow Designer. The Aggregate operator creates a separate aggregation for each selected column. See Aggregate .
Create Lakeflow Designer parameters while configuring fields (Public Preview)
Create a parameter from a supported operator field in Lakeflow Designer, then use it in the field. See Reference a parameter from an operator .