Data and AI releases

548 this month · 176 companies

Apache Arrow support for Zerobus Ingest is now generally available

Generally availableVerified

Apache Arrow support for Zerobus Ingest in Lakeflow Connect is now generally available. See Use Arrow Flight with Zerobus Ingest .

Data integration

Read on docs.databricks.com

Also shipped Sep 1, 2026Databricks in September 2026 →

More from LakeflowEvery Lakeflow release →

Pipeline events system table is in Beta

The pipeline_events system table is in Beta . This table records Lakeflow pipelines event log entries for pipelines in your account, capturing lifecycle transitions, flow progress, data quality metrics, errors, and other operational data across all pipelines and workspaces in a region.

Beta
Source ↗

Lakeflow Designer August Release

The Lakeflow Designer August release adds the Unique operator, expands the Aggregate, Select, and Python operators, and improves the canvas, preview, and version-history experience.

Preview
Source ↗

Atlassian Audit Logs connector (Beta)

The Atlassian Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit log events, such as user, security, and configuration changes, from Atlassian into Databricks. Authentication uses an Atlassian organization API key.

Beta
Source ↗

Anysphere Audit Logs connector (Beta)

The Anysphere Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Admin API to incrementally ingest team audit-log events into Databricks. Authentication uses a Cursor Admin API key. See Anysphere Audit Logs connector .

Beta
Source ↗

Celigo connector (Beta)

The Celigo connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit log events, such as create, update, and delete operations on resources, from Celigo (integrator.io) into Databricks. Authentication uses a Celigo integrator.io API token.

Beta
Source ↗