Releasesby IbisAsynchronous processing with transformWithState is now generally available
GA5 days agoUnverifiedAdded Oct 21, 2026
Asynchronous processing for the Python row-based transformWithState API is now generally available. Run state operations and user logic concurrently for higher throughput with only minor code changes. See Asynchronous processing with transformWithState .
Topics: Developer tools, Performance
More Lakeflow releases
Every Lakeflow releaseSaving an unchanged job no longer adds rows to the jobs system tables
Saving a job without changing its settings no longer adds rows to system.lakeflow.jobs or system.lakeflow.job_tasks , and change_time stays at the last change. This applies to saves from the UI, the Jobs API, and Declarative Automation Bundles. See Jobs table schema .
SurveyMonkey connector is available in Beta
The managed SurveyMonkey connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest surveys, survey structure, collectors, survey responses, and contacts from SurveyMonkey into Databricks.
Oracle Eloqua connector is available in Beta
The managed Oracle Eloqua connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest marketing data such as contacts, accounts, campaigns, email and form assets, form submissions, events, and website visitors from Oracle Eloqua into Databricks.
Asana connector is available in Beta
The managed Asana connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest work management data such as workspaces, teams, projects, tasks, portfolios, and goals from Asana into Databricks. The connector uses OAuth user-to-machine (U2M) authentication.
Lakeflow pipelines system tables are now generally available (GA)
The lakeflow system tables pipelines and pipeline_update_timeline are now generally available. These tables record the pipelines and pipeline updates in your account. For a reference of these tables, see Jobs system table reference .
Microsoft Entra ID connector is available in Beta
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks.
Box Audit Logs managed ingestion connector (Beta)
The Box Audit Logs connector in Lakeflow Connect is now available in Beta. Use the connector to ingest enterprise audit events from Box into Databricks. See Box Audit Logs connector .
MySQL integrated CDC pipeline is now generally available
The integrated CDC pipeline for MySQL is now generally available. An integrated CDC pipeline ingests change data from MySQL into Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway.
Also shipped on Oct 19, 2026
Databricks in October 2026Training Upcoming Serverless Training deprecation: DeepSeek V4 Flash (0731) On November 2, 2026 , DeepSeek V4...
Training Upcoming Serverless Training deprecation: DeepSeek V4 Flash (0731) On November 2, 2026 , DeepSeek V4 Flash (0731) will be removed from the shared Serverless Training pool. This change applies only to Serverless Training. If you train DeepSeek V4 Flash (0731) on Serverless Training, migrate to DeepSeek V4.1 Flash 1017 before November 2, 2026.
Cloud Workload Security is now available in Beta
Cloud Workload Security (CWS) is now available in Beta. Apply policy controls to cloud API requests before they reach your cloud provider. Define policies with request filters and Rego checks. For example, block requests that would make an R2 bucket public. Use workloads and policy sets to target your cloud environments.
Copilot model policy API for enterprise, orgs, and teams
You can now use the REST API to retrieve and update Copilot model policies for enterprises, enterprise teams, enterprise apps, and organizations. What’s new GET and PATCH endpoints are now generally available for model policies at four levels: Enterprise: /enterprises/{enterprise}/copilot/model-policies Enterprise teams...
GitHub Copilot models deprecated on October 19, 2026
As of today, October 19, 2026, we have deprecated the following models across most GitHub Copilot experiences (including Copilot Chat, inline edits, ask and agent modes, and code completions). These deprecations were announced on September 18, 2026 .
Postgres wait events, now in Query Insights
Query Insights for ClickHouse Managed Postgres now includes wait event breakdowns, blocked-session charts, and lock-wait charts. These metrics are also available in Prometheus.
Send OpenTelemetry traces to Agent Observability, no SDK required
You can now send OpenTelemetry traces straight to Agent Observability, without the SDK. If your agents already emit OpenTelemetry generative AI spans, from your framework, an instrumentation library, or spans you write yourself, keep your existing route through Grafana Alloy or an OpenTelemetry Collector and opt in your AI spans with a single attribute.