Data and AI releases

548 this month · 176 companies

Python UDTFs in Unity Catalog are now generally available

Generally availableVerified

Registering Python user-defined table functions (UDTFs) in Unity Catalog is now generally available in Databricks Runtime 18. A Unity Catalog Python UDTF is a governed function that returns a table, invoked in the FROM clause of a SQL statement to return multiple rows and columns.

SQLGovernanceObservability

Read on docs.databricks.com

Also shipped Jul 28, 2026Databricks in July 2026 →

Snowflake Native Apps support for Virtual Private Snowflake on AWS for apps with containers (General availability)

Snowflake Native App with Snowpark Container Services now support Virtual Private Snowflake (VPS) on Amazon Web Services. Apps with containers can be distributed to Snowflake customers in VPS deployments. Apps running in VPS can use the functionality of Snowpark Container Services, including compute pools, services, jobs, and external access integrations.

GA
Source ↗

More from Unity CatalogEvery Unity Catalog release →

Packaged clean rooms are now generally available

Packaged clean rooms are now generally available. In a packaged clean room, a provider supplies notebooks, JARs, and data that a consumer runs against their own data without seeing the provider's code or data assets. See Packaged clean rooms .

GA
Source ↗

Governed tags system table is in Beta

The system.tags.governed_tags system table is in Beta . This table contains a record for each governed tag key in your account, including customer-created and system-generated tags. Use it to programmatically determine which tags in your account are governed. See Governed tags system table reference .

Beta
Source ↗

Secrets in Unity Catalog is GA

Secrets in Unity Catalog is now generally available. You can store, govern, and access secrets as securable objects in Unity Catalog. A Unity Catalog secret uses the three-level namespace ( catalog.schema.secret ) and is governed by Unity Catalog privileges, so you can apply the same access controls and auditing that you use for other data assets.

GA
Source ↗

MANAGE no longer requires USE CATALOG or USE SCHEMA on the same object

The MANAGE privilege no longer requires a usage privilege ( USE CATALOG or USE SCHEMA ) on the object where MANAGE is granted. This change makes MANAGE behave more consistently with object ownership. Previously, MANAGE on a catalog or schema took effect only if you also held the appropriate usage privileges on that object.

Update
Source ↗

Databricks-hosted sample datasets available in the samples catalog

The sample datasets /databricks-datasets mounted to DBFS are now also available in the samples catalog as samples.databricks.datasets , made available through OpenSharing. The datasets volume hosts a collection of Databricks-provided datasets that you can use to build and test data pipelines.

Update
Source ↗

Role-based access control (RBAC) is in Public Preview

Role-based access control (RBAC) is now in Public Preview. RBAC lets users assume a role in Databricks using only that role's permissions for the duration of the session instead of their own accumulated permissions. This enables exclusive access.

Preview
Source ↗

Governance Hub is in Beta

Governance Hub is in Beta . Governance Hub is a centralized, account-level UI in the account console for monitoring governance across your Databricks account. It provides a unified view of data health and coverage, AI usage and spend, and cost drivers, with prioritized insights and recommendations. All views respect existing permissions.

Beta
Source ↗

Automated setup for S3 external locations

You can now create an S3 external location using automated setup, the recommended method for connecting an S3 bucket to Databricks. Automated setup uses AWS IAM temporary delegation to configure your external location and provision all required resources, including the IAM role, storage credential, and external location.

Update
Source ↗