Configure materialization TTLs for individual OpenSharing recipients
Databricks enabled configuring materialization time-to-live settings for individual OpenSharing recipients to override metastore defaults.
Also shipped Nov 18, 2026Databricks in November 2026 →
V3 progress control | CodeRabbit Cloud, V3 review settings preview
CodeRabbit updated progress controls in the V3 review settings preview, allowing progress_updates configuration to control review-progress reporting format.
Hyperdrive, Workers VPC - Custom CA and client certificates (mTLS) for Workers VPC
Cloudflare Workers VPC now supports custom certificate authority (CA) verification and mutual TLS (mTLS) authentication for private VPC Services.
Spark Monitoring UI (General availability)
Snowflake announced the general availability of the Spark Monitoring UI in Snowsight for tracking and troubleshooting Snowpark Connect for Spark jobs and sessions.
Amazon OpenSearch Memory is now generally available
Amazon OpenSearch Memory is now generally available as a serverless capability in Amazon OpenSearch Service to store, extract, and retrieve persistent memory for AI agents.
Introducing the Apache Spark Optimization Agent for AWS Glue ETL
AWS Glue ETL introduced the Apache Spark Optimization Agent, which analyzes completed Spark runs to deliver automated cost and performance recommendations.
Gemini 4 Neon (GA)
Google Cloud announced the general availability of Gemini 4 Neon in Gemini Enterprise Agent Platform, supporting a 1M-token context window and four thinking levels.
More from Databricks Data Intelligence PlatformEvery Databricks Data Intelligence Platform release →
Configurable retention for system tables is generally available
Databricks made configurable retention for supported system tables generally available, allowing account admins to set retention periods between 30 and 3,650 days.
ai_forecast version 2 is now generally available
Version 2 of the ai_forecast SQL function is now generally available in Databricks SQL, powered by a time series foundation model with support for holiday features, external covariates, and non-negative forecasts.
Manage Lakewatch with the Databricks CLI (Beta)
Databricks CLI now supports managing Lakewatch datasources, parsers, and detection rules via the lakewatch command group.
OAuth authentication for webhook destinations will soon be available by default for workspaces with the compliance security profile enabled
Databricks announced that OAuth 2.0 client credentials authentication for webhook destinations will be enabled by default starting on or after December 20, 2026, for workspaces with compliance security profiles.
The Databricks GitHub app will request permission to create and manage pull requests
The Databricks GitHub app will request read and write access to pull requests to enable Genie Code and Genie ZeroOps to manage them. This is optional and requires user approval.
Databricks Runtime 19: November 16, 2026
Databricks released Databricks Runtime 19, which enables real-time watermark propagation by default for new real-time streaming queries. Stateful operators now advance event-time watermarks within batches, filtering late events faster and evicting state sooner.
IP functions will soon be available by default for workspaces with the compliance security profile enabled
Databricks announced that IP functions will soon be enabled by default for workspaces with the compliance security profile enabled. IP functions allow users to analyze and perform joins on IP addresses and CIDR blocks directly within SQL queries.
TIMERANGE_NOW() on the Lakewatch query page uses the selected time range
On the Lakewatch query page, TIMERANGE_NOW() now returns the end of the selected time range instead of the current time, so you can test a detection rule's predicates against historical data. See Reference the run's window with TIMERANGE_NOW() .