Releasesby GlyphPipeline events system table is in Beta
The pipeline_events system table is in Beta . This table records Lakeflow pipelines event log entries for pipelines in your account, capturing lifecycle transitions, flow progress, data quality metrics, errors, and other operational data across all pipelines and workspaces in a region.
Also shipped Aug 31, 2026Databricks in August 2026 →
You can now create, store , and manage pipelines in Git folders
You can now create, store , and manage pipelines in Git folders. This feature is in Preview .
BigQuery now supports TabFM , Google's pre-trained foundation model for tabular data
BigQuery now supports TabFM , Google's pre-trained foundation model for tabular data. TabFM enables zero-shot regression and classification through in-context learning. It delivers high-accuracy predictions on structured data without requiring model training or hyperparameter tuning.
You can now create an identity column , sometimes referred to as an auto-incrementing column, on a table
You can now create an identity column , sometimes referred to as an auto-incrementing column, on a table. You can use identity columns to create and maintain primary keys on your tables. When you insert a row into a table that has an identity column, BigQuery generates a unique integer value for that column. This feature is in Preview .
BigQuery Graph is generally available (GA)
BigQuery Graph is generally available (GA). BigQuery Graph now includes support for the CALL graph query statement , and the following path inspection GQL functions : IS_ACYCLIC IS_SIMPLE IS_TRAIL .
app.yml for Snowflake App Runtime (Preview)
Snowflake App Runtime projects use a single app.yml file to describe both deployment and the remote build. Include version: 2 at the top of the file. snow app setup writes this file for new projects.
More from LakeflowEvery Lakeflow release →
Apache Arrow support for Zerobus Ingest is now generally available
Apache Arrow support for Zerobus Ingest in Lakeflow Connect is now generally available. See Use Arrow Flight with Zerobus Ingest .
Lakeflow Designer August Release
The Lakeflow Designer August release adds the Unique operator, expands the Aggregate, Select, and Python operators, and improves the canvas, preview, and version-history experience.
Atlassian Audit Logs connector (Beta)
The Atlassian Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit log events, such as user, security, and configuration changes, from Atlassian into Databricks. Authentication uses an Atlassian organization API key.
Zerobus Ingest into streaming tables is now generally available
Ingesting into streaming tables with Zerobus Ingest in Lakeflow Connect is now generally available. Writing to a streaming table works the same way as writing to a managed Delta table, with the same limits and quotas. See Create or identify the target table .
Anysphere Audit Logs connector (Beta)
The Anysphere Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Admin API to incrementally ingest team audit-log events into Databricks. Authentication uses a Cursor Admin API key. See Anysphere Audit Logs connector .
Zerobus Ingest into default storage is now in Public Preview
Ingesting into tables backed by default storage with Zerobus Ingest in Lakeflow Connect is now in Public Preview . See Create or identify the target table .
Verkada connector (Beta)
The Verkada connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit logs and access users from your Verkada organization into Databricks. Authentication uses a Verkada organization API key. See Verkada connector .
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available
Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available. Today, Lakeflow Connect ingests formula fields by taking a full snapshot on each pipeline run by default. When incremental formula field ingestion is generally available, full snapshots will no longer be the default.