Data and AI releases

2,002 this month · 180 companies

Deleting a Unity Catalog pipeline now retains tables by default

UpdateNot yet verified

When you delete a Unity Catalog pipeline that uses the default publishing mode, the UI and the Pipelines DELETE API retain associated materialized views, streaming tables, and views by default. The retained tables can be queried but cannot be updated until moved into an active pipeline.

StreamingGovernanceData integrationObservabilityDeveloper tools

Read on docs.databricks.com

Also shipped Sep 25, 2026Databricks in September 2026 →

CLI v0.8.1 | CLI

CLI v0.8.1 Continue local work in the cloud: Use cr code handoff --summary to start a new cloud Coding Agent task with your session summary, an optional plan, and an automatically discovered transcript when available. Clearer handoff results: See transfer progress, the branch and commit, transferred filenames, and a direct link to the cloud task.

Preview
Source ↗

More from LakeflowEvery Lakeflow release →

Workday Activity Logging connector (Beta)

The Workday Activity Logging connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector incrementally ingests Workday user activity log events into Databricks. Authentication uses an OAuth refresh token. See Workday Activity Logging connector .

Beta
Source ↗

Okta System Logs connector is available in Beta

The managed Okta System Logs connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to incrementally ingest audit and security events from the Okta System Log into Databricks. The connector uses SSWS API token authentication and supports Declarative Automation Bundles and API-based pipeline authoring.

Beta
Source ↗

Microsoft 365 Unified Audit Logs connector is available in Beta

The managed Microsoft 365 Unified Audit Logs connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest unified audit events from Microsoft Entra ID, Exchange, SharePoint, and other Microsoft 365 workloads into Databricks. The connector uses OAuth machine-to-machine authentication and supports incremental ingestion.

Beta
Source ↗

CrowdStrike Falcon Event Stream connector (Beta)

The CrowdStrike Falcon Event Stream connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests Falcon Event Stream events from CrowdStrike Falcon into Databricks.

Beta
Source ↗

Akamai WAF connector (Beta)

The Akamai WAF connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests web application firewall (WAF) security events from Akamai into Databricks. Authentication uses Akamai EdgeGrid API client credentials. See Akamai WAF connector .

Beta
Source ↗

1Password Event Logs connector (Beta)

The 1Password Event Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the 1Password Events API to ingest audit events, item usages, and sign-in attempts into Databricks. Authentication uses an Events Reporting bearer token.

Beta
Source ↗

Shopify connector (Beta)

The Shopify connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests e-commerce data such as products, orders, customers, inventory, fulfillments, and discounts from Shopify into Databricks. Authentication uses the Shopify OAuth client credentials grant.

Beta
Source ↗

Variant shredding will soon be enabled by default on new Variant tables

Starting November 18, 2026, Databricks will automatically add the variantShredding table feature to new tables that contain a column of the VARIANT type when they are created on Databricks Runtime 17.3 or above. Variant shredding stores frequently accessed fields in a typed, columnar layout to improve query performance.

Update
Source ↗