Box Audit Logs managed ingestion connector (Beta)
BetayesterdayUnverifiedAdded Oct 23, 2026
The Box Audit Logs connector in Lakeflow Connect is now available in Beta. Use the connector to ingest enterprise audit events from Box into Databricks. See Box Audit Logs connector .
Topics: Data integration, Observability
More Lakeflow releases
Every Lakeflow releaseMicrosoft Entra ID connector is available in Beta
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks.
Lakeflow pipelines system tables are now generally available (GA)
The lakeflow system tables pipelines and pipeline_update_timeline are now generally available. These tables record the pipelines and pipeline updates in your account. For a reference of these tables, see Jobs system table reference .
SurveyMonkey connector is available in Beta
The managed SurveyMonkey connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest surveys, survey structure, collectors, survey responses, and contacts from SurveyMonkey into Databricks.
Oracle Eloqua connector is available in Beta
The managed Oracle Eloqua connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest marketing data such as contacts, accounts, campaigns, email and form assets, form submissions, events, and website visitors from Oracle Eloqua into Databricks.
Asana connector is available in Beta
The managed Asana connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest work management data such as workspaces, teams, projects, tasks, portfolios, and goals from Asana into Databricks. The connector uses OAuth user-to-machine (U2M) authentication.
Saving an unchanged job no longer adds rows to the jobs system tables
Saving a job without changing its settings no longer adds rows to system.lakeflow.jobs or system.lakeflow.job_tasks , and change_time stays at the last change. This applies to saves from the UI, the Jobs API, and Declarative Automation Bundles. See Jobs table schema .
Asynchronous processing with transformWithState is now generally available
Asynchronous processing for the Python row-based transformWithState API is now generally available. Run state operations and user logic concurrently for higher throughput with only minor code changes. See Asynchronous processing with transformWithState .
MySQL integrated CDC pipeline is now generally available
The integrated CDC pipeline for MySQL is now generally available. An integrated CDC pipeline ingests change data from MySQL into Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway.
Also shipped on Oct 23, 2026
Databricks in October 2026Retrieve Cortex Search (Public Preview)
Retrieve Cortex Search is now available in Public Preview. The CORTEX_SEARCH_RETRIEVE table function lets you run low-latency Cortex Search queries directly from SQL, either one query at a time or one query per input row with a LATERAL join. Use it for real-time workloads such as retrieval-augmented generation, chatbots, and in-app search.
GitHub Copilot in Visual Studio , September update
September 2026 brought deeper visibility into your work: explore pull requests without leaving chat, bring the AI model your team trusts, and fix vulnerable packages the moment Visual Studio flags them. Highlights Here’s what’s new with GitHub Copilot in Visual Studio 2026.
Flagship - Target Flagship feature flags with structured evaluation context
Flagship supports nested objects, arrays, and null in evaluation context. Pass user profiles and tag lists directly, then target nested attributes without flattening your application data. For example, pass a profile and tags when evaluating a flag through the Workers binding: const enabled = await env. FLAGS .
Responses API for the Cortex REST API (Preview)
You can now call OpenAI models through the OpenAI-compatible Responses API, in preview. Send requests to /api/v2/cortex/v1/responses on the Cortex REST API, or to /v1/responses on the Cortex AI Gateway, with the OpenAI SDK or any other client that uses the Responses API.
Manage Test Engine workflows with Terraform and the REST API
You can now manage Test Engine workflows with Terraform and the REST API instead of configuring each one in the UI. The new buildkite_test_suite_workflow resource in Buildkite Terraform provider v1.43.0 lets you define monitors, filters, and actions in code, and import existing workflows.
arize-phoenix: v20.25.0
20.25.0 (2026-10-22) Features factory: scaffold managed agents issue-to-PR factory (e5e360b) Bug Fixes factory: keep claude-lock.json on a factory-state branch instead of main (2e131a8) sandbox: keep teardown alive on cancellation (2779b46) server: format the ID in the experiments 404 error details (33ed20a) server: work around graphql-core 3.3.0 subfield...