Data and AI releases

548 this month · 176 companies

Databricks, August 2026 new features

138 releases · 10 products · 31 GA · 11 Preview · 43 Beta · 3 Deprecation · 1 Pricing

Pipeline events system table is in Beta

The pipeline_events system table is in Beta . This table records Lakeflow pipelines event log entries for pipelines in your account, capturing lifecycle transitions, flow progress, data quality metrics, errors, and other operational data across all pipelines and workspaces in a region.

Beta
Source ↗

ai_transcribe function (Beta)

The ai_transcribe() SQL function transcribes an audio file into text. It returns the transcript as time-stamped segments, and labels each segment with a speaker when speaker diarization is enabled for your workspace. The output is a VARIANT value, so you can chain it into other AI Functions. This feature is in Beta . See ai_transcribe function .

Beta

Monitor and cap external provider costs

Unity Gateway can now track and cap spend on external model providers, such as Amazon Bedrock and Azure AI Foundry, not just Databricks-provided models. If your organization already has capacity commitments directly with a provider, Unity Gateway becomes the single point to track that usage and enforce spend limits across teams and use cases.

Beta
Source ↗

Unity Catalog Skills (Beta)

You can now publish, govern, and share agent skills with Unity Catalog. A skill is a first-class Unity Catalog securable ( catalog.schema.skill ) that follows the SKILL.md specification , so you register it once and control who can discover, use, and update it with the same permissions, tags, and audit that protect your tables.

Beta
Source ↗
5 products

Genie Agents enhancements

- Chat mode in Genie One : You can now submit prompts to a Genie Agent in Chat mode from Genie One. Cancel Agent mode responses through the API : You can now cancel in-progress Agent mode responses through the API. See the Cancel Genie agent response API .

GA
4 products

Anysphere Audit Logs connector (Beta)

The Anysphere Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Admin API to incrementally ingest team audit-log events into Databricks. Authentication uses a Cursor Admin API key. See Anysphere Audit Logs connector .

Beta
4 products

Consumer access to query Unity Gateway services will become generally available

Querying Unity Gateway model services and model provider services with Consumer access is currently opt-in through the Consumer access to Unity Gateway Public Preview . When this capability becomes generally available, consumer access users will be able to query these services without the preview enabled.

GA
5 products

Dashboard enhancements and bug fixes

- Import from Power BI and Tableau : Importing reports and data models from Power BI and Tableau with Genie Code ( /importBI ) is now generally available. See Import BI files using Genie Code . Larger Excel downloads : You can now download up to 1 million rows from a dashboard widget to Excel ( .xlsx ), up from 100,000. See Download results .

GA

Role-based access control (RBAC) is generally available

Role-based access control (RBAC) is now generally available. RBAC lets users assume a role in Databricks. When a user assumes a role, only that role's permissions apply, rather than the user's accumulated permissions. This enables exclusive access.

GA

Choose an effort level in Genie Code

You can now set the effort level for Genie Code to balance response quality and cost. Auto (default) gives you the highest quality responses. For simpler tasks, select Low to use a faster, lower-cost model. See Select a level of effort .

Update
Source ↗

User authorization for Databricks Apps will soon be available for workspaces with the compliance security profile enabled

In late September 2026, user authorization for Databricks Apps will be automatically enabled for workspaces with the compliance security profile enabled. User authorization allows apps to act with the identity of the app user, so apps can access resources on the user's behalf while enforcing the user's existing permissions. See User authorization .

Update
Source ↗

Identity attributes in ABAC column mask policies (Beta)

Identity attributes are in Beta. You can now write Unity Catalog ABAC column mask policy conditions that target users by attributes synced from your identity provider, such as department or country , in addition to group membership.

Beta

Session restore for serverless jobs is now in Beta

Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the job. Databricks automatically captures a state snapshot when an eligible run fails, runs 30 minutes or longer, or is cancelled, and keeps it for 7 days after the run completes.

Beta
Source ↗
5 products

Lakebase Postgres APIs are now generally available

Programmatic management of Lakebase Postgres is now generally available through the REST API, Databricks CLI, and Databricks SDKs (Python, Java, Go). These interfaces support operations for projects, branches, endpoints, databases, roles, credentials, synced tables, and catalogs. See Lakebase API guide .

GA
5 products

Block or redact sensitive data in requests and responses

The Sensitive Data Detection guardrail (Beta) detects structured sensitive data (such as Social Security numbers, credit card numbers, IBANs, and phone numbers) and either blocks the interaction or redacts the matched values in place.

Preview
4 products

Amplitude connector (Beta)

The Amplitude connector in Lakeflow Connect is now in Beta. Ingest product analytics event data along with event, cohort, and annotation metadata from Amplitude. See Amplitude connector .

Beta
4 products

ABAC GRANT policies now cover Unity Gateway resource types (Beta)

Attribute-based access control (ABAC) GRANT policies dynamically grant Unity Catalog privileges to securables whose governed tags match a condition. They now support model services, model provider services, Model Context Protocol (MCP) services, and agent services, which are the resource types Unity Gateway governs.

Beta
6 products

Alert system tables are in Public Preview

The system.alert schema is in Public Preview . This schema contains the alerts table, which records the configuration of every alert, and the alert_evaluation_history table, which records one row per alert evaluation. Use these tables to audit alert definitions, analyze evaluation trends, and monitor alert workloads at scale.

Preview

Change data feed on materialized views (Beta)

You can now read a change data feed from a materialized view created in a Lakeflow pipeline or in Databricks SQL, using Databricks Runtime 18 LTS or above. Use this to replicate materialized view changes to destinations outside Databricks, or to keep a history of materialized view changes for auditing and reporting.

Beta
Source ↗

Tag automations (Beta)

Tag automations are now in Beta . A tag automation assigns or removes governed tags on the Unity Catalog tables or volumes that match conditions you define, so tags stay accurate as your data and metadata change.

Beta
Source ↗

ai_search function (Beta)

The ai_search() SQL function retrieves information from one or more AI Search indexes configured as knowledge sources. Given a natural-language query, the function generates optimized search queries, retrieves and deduplicates results across sources, reranks them by relevance, and returns the most relevant documents.

Beta
Source ↗
4 products

REPLACE USING flows for pipelines (Beta)

REPLACE USING flows are now available in Lakeflow pipelines in Beta . Use a REPLACE USING flow when your source is a series of partial snapshots keyed by column. On each update, the flow replaces all rows that match the specified key columns and leaves all other rows unchanged.

Beta
5 products

Full page Genie Code is now generally available

Full page Genie Code is now generally available. Full page Genie Code is a command center experience where the active chat is shown prominently, notebooks and files open as tabs alongside it, and you can run multiple chats in parallel. Start work directly from Genie Code, and personalize how it works with skills, instructions, and MCP servers.

GA
5 products

Environment variables for serverless jobs are in Beta

Environment variables for serverless Lakeflow Jobs tasks are in Beta . You can define named environment variable entries at the job level and select one for each task to pass deployment-specific configuration to your application code. A workspace admin must enable the preview from the workspace Previews page.

Beta