Data and AI releases

548 this month · 176 companies

Unity Catalog Release notes from Databricks

86 releases · 5 this month

Official notes RSS

Governed tag propagation is in Beta

Tag propagation in Unity Catalog is in Beta . When you enable tag propagation for a governed tag, Unity Catalog uses lineage to automatically apply that tag to derived tables and views whenever a supported operation runs, such as CREATE TABLE AS SELECT , CREATE VIEW , INSERT INTO ... SELECT , or MERGE .

Beta
Source ↗

Cross-engine attribute-based access controls (ABAC) is now generally available

Cross-engine attribute-based access controls (ABAC) is now generally available. Supported external engines can read Unity Catalog managed tables with ABAC policies, row filters, and column masks enforced by Databricks serverless compute. See Cross-engine attribute-based access controls (ABAC) for requirements, supported clients, and serverless compute costs.

GA
Source ↗

ABAC on views is in Beta

Attribute-based access control (ABAC) row filters and column masks now extend to views, in addition to tables. This lets you use ABAC policies to control access to sensitive data exposed through views. Account admins can enable the ABAC on Views preview from the account console's Previews page. This feature requires Databricks Runtime 19 or above.

Beta
Source ↗

Invite OpenSharing recipients by email (Beta)

You can now invite OpenSharing recipients by email instead of exchanging a sharing identifier or credential file. OpenSharing emails the recipient a secure activation link to connect and read the shared data. Email sharing is in Beta . See OpenSharing by email .

Beta
Source ↗

Metastore-level ABAC policies are in Beta

Metastore-level ABAC policies are in Beta in Unity Catalog. You can now attach an ABAC policy (row filter, column mask, GRANT, or DENY) at the metastore level, so a single policy applies across every catalog in the metastore, including catalogs created later.

Beta
Source ↗

External secrets in Unity Catalog (Beta)

External secrets connect a Unity Catalog schema to AWS Secrets Manager. The secrets appear in Unity Catalog as read-only securable objects that you govern with Unity Catalog privileges. Databricks reads their values from AWS Secrets Manager on demand. See External secrets in Unity Catalog .

Beta
Source ↗

ABAC DENY policies are in Beta

ABAC DENY policies are in Beta in Unity Catalog. DENY policies can be used to explicitly deny the MANAGE ACCESS CONTROL privilege to prevent specified principals, including object owners, from performing access-management operations. They always take precedence over any grant. For details, see ABAC DENY policies (Beta) .

Beta
Source ↗

ABAC GRANT policies are generally available for models and services

ABAC GRANT policies for models, model services, model provider services, Model Context Protocol (MCP) services, and agent services are now generally available. These policies dynamically grant Unity Catalog privileges to securable objects whose governed tags match a condition, instead of granting privileges on each object individually.

GA
Source ↗

Unity Catalog Skills (Beta)

You can now publish, govern, and share agent skills with Unity Catalog. A skill is a first-class Unity Catalog securable ( catalog.schema.skill ) that follows the SKILL.md specification , so you register it once and control who can discover, use, and update it with the same permissions, tags, and audit that protect your tables.

Beta
Source ↗

Share foreign Delta tables with OpenSharing (Public Preview)

You can now use OpenSharing to share foreign Delta tables, which are Delta-format tables registered in a foreign catalog such as OneLake, a Hive metastore, or AWS Glue. Providers add foreign Delta tables to a share, and recipients access the shared data in read-only format.

Preview
Source ↗

The INSERT, UPDATE, and DELETE privileges are in Beta

The INSERT , UPDATE , and DELETE privileges are in Beta in Unity Catalog. These privileges are least-privilege alternatives to MODIFY that let you grant write access to a table's data without also granting the ability to change its schema or other metadata. The privileges require Databricks Runtime 18.1 or above.

Beta
2 releases →

Context attributes in ABAC column mask and row filter policies (Beta)

Context attributes for attribute-based access control (ABAC) policies are in Beta. You can now write Unity Catalog ABAC policy conditions that target the context of a request, such as which OAuth application is calling ( request.client_id ) and whether the request runs on behalf of a user ( request.is_on_behalf_of ).

Beta
Source ↗

Unity Catalog OSS UnityCatalog 0.6.0

We are thrilled to announce Unity Catalog 0.6.0 release, which includes exciting new features, many bug fixes, and improvements. A huge thank you to the awesome community who made this release possible!

Update
Source ↗

Sharing managed Iceberg tables is now generally available

Sharing managed Iceberg tables in Databricks-to-Databricks sharing and open sharing is now generally available. Providers can now also share managed Iceberg tables to external Iceberg clients. See Add managed Iceberg tables to a share and Read shared managed Iceberg tables .

GA
Source ↗

Define business concepts with Pages (Beta)

You can now use Pages to give business terms, acronyms, and KPIs a single governed definition. Part of Unity Catalog semantics , Pages form the human-modeled layer of the Genie Ontology that Genie One draws on to ground its answers. See Pages .

Beta
2 releases →

Unity Catalog ABAC GRANT policies support more securable types in Beta

ABAC GRANT policies dynamically grant Unity Catalog privileges to securables whose governed tags match a condition. These policies were previously only available for models, but now also support model services, model provider services, Model Context Protocol (MCP) services, and agent services. All supported types are in Beta.

Beta
Source ↗

READ METADATA privilege is GA

The READ METADATA privilege is now generally available in Unity Catalog. READ METADATA provides read-only visibility into the same metadata available to the object's owner or a user with MANAGE , including security-sensitive information that BROWSE doesn't expose, such as privilege grants, row filters and column masks, and ABAC policies.

GA
Source ↗

Tag automations (Beta)

Tag automations are now in Beta . A tag automation assigns or removes governed tags on the Unity Catalog tables or volumes that match conditions you define, so tags stay accurate as your data and metadata change.

Beta
Source ↗

Secrets in Unity Catalog is GA

Secrets in Unity Catalog is now generally available. You can store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace ( catalog.schema.secret ) and is governed by Unity Catalog privileges, so you can apply the same access controls and auditing that you use for other data assets.

Packaged clean rooms are now generally available

Packaged clean rooms are now generally available. In a packaged clean room, a provider supplies notebooks, JARs, and data that a consumer runs against their own data without seeing the provider's code or data assets. See Packaged clean rooms .

GA
Source ↗

Python UDTFs in Unity Catalog are now generally available

Registering Python user-defined table functions (UDTFs) in Unity Catalog is now generally available in Databricks Runtime 18. A Unity Catalog Python UDTF is a governed function that returns a table, invoked in the FROM clause of a SQL statement to return multiple rows and columns.

GA
Source ↗

Governed tags system table is in Beta

The system.tags.governed_tags system table is in Beta . This table contains a record for each governed tag key in your account, including customer-created and system-generated tags. Use it to programmatically determine which tags in your account are governed. See Governed tags system table reference .

Beta
Source ↗

Governance Hub is in Beta

Governance Hub is in Beta . Governance Hub is a centralized, account-level UI in the account console for monitoring governance across your Databricks account. It provides a unified view of data health and coverage, AI usage and spend, and cost drivers, with prioritized insights and recommendations. All views respect existing permissions.

Beta
4 releases →

Scala and Java UDFs in Unity Catalog are now generally available

Register Scala and Java user-defined functions (UDFs) in Unity Catalog and reuse them across notebooks, jobs, and SQL warehouses with Unity Catalog governance. Reuse existing JVM logic and get better performance than Python UDFs on all compute, including serverless. See Scala and Java user-defined functions (UDFs) in Unity Catalog .

GA
Source ↗

Trigger.AvailableNow support for OpenSharing streaming (GA)

Streaming reads from OpenSharing tables now support the Trigger.AvailableNow trigger. This trigger captures the shared table's current version when it starts, processes all available data across one or more micro-batches (honoring maxFilesPerTrigger and maxVersionsPerRpc ), and then stops, which is well suited to scheduled, batch-like incremental...

Secrets in Unity Catalog (Public Preview)

You can now store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace ( catalog.schema.secret ) and is governed by Unity Catalog privileges, so you can apply the same access controls and auditing that you use for other data assets. See Secrets in Unity Catalog .

Preview
Source ↗

Govern LLMs in Unity Catalog with model services (Beta)

You can now govern Databricks-hosted LLMs in Unity Catalog using model services , currently in Beta. A model service is a Unity Catalog securable that represents a governed LLM endpoint, so you can define an endpoint once and share it across workspaces using Unity Catalog privileges, instead of duplicating endpoints per workspace.

Beta
Source ↗

Unity Catalog OSS Unity Catalog AI 0.4.0

The 0.4.0 release of Unity Catalog AI includes several improvements, including expanded Databricks client options and dependency/security improvements. Artifacts in this release unitycatalog-ai unitycatalog-langchain unitycatalog-openai Major Changes Warehouse ID Support in DatabricksFunctionClient : For workspaces where serverless compute is unavailable or...

Update
Source ↗

Unity Catalog OSS UnityCatalog 0.4.0

We are excited to announce Unity Catalog 0.4.0 release which includes exciting new features and many bug-fixes and improvements. A huge thank you to the awesome community who made this release possible!

Update
Source ↗
About and activity
Releases per month
1Jun
13Jul
26Aug
14Sep
23Oct
5Nov
Official release-notes pages 15
Release-notes pageFeed
Unity Catalog OSS releases
github.com
RSS
AI/BI (dashboards, Genie)
docs.databricks.com
None
Databricks CLI releases
github.com
RSS
Databricks Connect
docs.databricks.com
None
Databricks Runtime
docs.databricks.com
None
Declarative Automation Bundles
docs.databricks.com
None
Developer tools (CLI, SDK, Terraform)
docs.databricks.com
None
Feature Store
docs.databricks.com
None
Platform release notes (AWS)
docs.databricks.com
RSS
Python SDK releases
github.com
RSS
Serverless compute
docs.databricks.com
None
Serverless environment versions
docs.databricks.com
None
Terraform provider releases
github.com
RSS
Unity AI Gateway
docs.databricks.com
None
What's coming
docs.databricks.com
None