Lakeflow pipelines system tables are now generally available (GA)
GA3 days agoUnverifiedAdded Oct 23, 2026
The lakeflow system tables pipelines and pipeline_update_timeline are now generally available. These tables record the pipelines and pipeline updates in your account. For a reference of these tables, see Jobs system table reference .
Topics: Data integration
More Lakeflow releases
Every Lakeflow releaseMicrosoft Entra ID connector is available in Beta
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks.
SurveyMonkey connector is available in Beta
The managed SurveyMonkey connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest surveys, survey structure, collectors, survey responses, and contacts from SurveyMonkey into Databricks.
Oracle Eloqua connector is available in Beta
The managed Oracle Eloqua connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest marketing data such as contacts, accounts, campaigns, email and form assets, form submissions, events, and website visitors from Oracle Eloqua into Databricks.
Asana connector is available in Beta
The managed Asana connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest work management data such as workspaces, teams, projects, tasks, portfolios, and goals from Asana into Databricks. The connector uses OAuth user-to-machine (U2M) authentication.
Box Audit Logs managed ingestion connector (Beta)
The Box Audit Logs connector in Lakeflow Connect is now available in Beta. Use the connector to ingest enterprise audit events from Box into Databricks. See Box Audit Logs connector .
Saving an unchanged job no longer adds rows to the jobs system tables
Saving a job without changing its settings no longer adds rows to system.lakeflow.jobs or system.lakeflow.job_tasks , and change_time stays at the last change. This applies to saves from the UI, the Jobs API, and Declarative Automation Bundles. See Jobs table schema .
Asynchronous processing with transformWithState is now generally available
Asynchronous processing for the Python row-based transformWithState API is now generally available. Run state operations and user logic concurrently for higher throughput with only minor code changes. See Asynchronous processing with transformWithState .
MySQL integrated CDC pipeline is now generally available
The integrated CDC pipeline for MySQL is now generally available. An integrated CDC pipeline ingests change data from MySQL into Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway.
Also shipped on Oct 21, 2026
Databricks in October 20262026.10.09
The voice catalog grows from about 390 to more than 1,400 voices. The 1,035 new voices span all five languages and 29 accents, for use cases from customer service to characters. Browse them in the Studio voice library or read the announcement . Also new in Studio : Preview samples: a voice can have several preview samples, each reading a different sentence.
The AI.CHUNK_DOCUMENT function is a table-valued function that splits unstructured documents into...
The AI.CHUNK_DOCUMENT function is a table-valued function that splits unstructured documents into semantically coherent text chunks optimized for vector embeddings and Retrieval-Augmented Generation (RAG) workflows. This function is generally available (GA).
Automated cataloging and ingestion of Looker (Google Cloud core) metadata with Knowledge Catalog is now...
Automated cataloging and ingestion of Looker (Google Cloud core) metadata with Knowledge Catalog is now generally available (GA). This includes support for additional granular metadata (including dimension/measure definitions, default queries, and relationships) and new asset types: LookML dashboards, LookML dashboard elements, and agents.
[Launched] Generally Available: Azure Cosmos DB Safe Key Rotation
Safe Key Rotation for Azure Cosmos DB is now generally available. You can view timestamp metadata showing when each account key was last used, helping you identify active keys before rotating or retiring credentials.This visibility helps reduce the risk o
OpenAI models are coming to Google Cloud
OpenAI frontier models and Codex workflows are now available in Google Cloud's Model Garden via the Google Cloud Marketplace.
ChatGPT Ads expands to 26 new countries as over 100,000 advertisers have used the platform
ChatGPT Ads is now available in 26 additional countries, allowing advertisers to reach users during product discovery and research.