C++ SDK for the Zerobus Ingest connector is now available in Beta
A C++ SDK for the Zerobus Ingest connector in Lakeflow Connect is now available in Beta. The SDK provides a high-throughput gRPC client for ingesting records directly into Unity Catalog Delta tables, with support for JSON and Protocol Buffers. See Use Zerobus Ingest .
Also shipped Jul 23, 2026Databricks in July 2026 →
SQL environment variable and private Git package support for dbt Projects on Snowflake
Environment variable support for dbt Projects on Snowflake is now generally available. Manage per-developer schemas, dynamic runtime values, secrets, and multiple environments in a single, Git-versioned env.yml file that Snowflake resolves before each run.
SERVICE_AGENT user type (General availability)
With this release, the SERVICE_AGENT user type is generally available. Use this user type for automated AI agents that interact with Snowflake using their own identity and privileges.
SHOW CORTEX BASE MODELS command (General availability)
With this release, we are pleased to announce the general availability of the SHOW CORTEX BASE MODELS command. Use this command to list the Cortex Base Models available in your account, along with each model’s lifecycle status, regional availability, legacy date, and end-of-life date.
Transparent query forwarding is now available in Preview for clusters compatible with PostgreSQL 17 and 18
Transparent query forwarding is now available in Preview for clusters compatible with PostgreSQL 17 and 18. With this feature, the primary node in a cluster intercepts read-only queries and selectively forwards them to read pool instances while maintaining read-your-writes consistency.
Copilot cloud agent for Linear is now generally available
You can now assign issues in Linear to Copilot cloud agent , our asynchronous, autonomous background agent. When you assign a Linear issue to Copilot, it will: Analyze the issue contents and open a draft pull request. Work independently in its own ephemeral development environment, powered by GitHub Actions.
GitHub MCP Server supports the next MCP specification
The MCP protocol is going stateless on 28th July 2026, and the GitHub MCP Server supports the latest spec ahead of the official release. What’s changing The new stateless core means MCP deployments are now easy to scale. Extensions unlock innovation (e.g., MCP apps and Enterprise Managed Auth, both of which are already supported by VS Code).
More from LakeflowEvery Lakeflow release →
Lakeflow Designer Summer Release
The Lakeflow Designer Summer Release adds new operators, expands the Output and Join operators, and improves the canvas editing experience. The following updates are now available: Prepare operator : Use the new Prepare operator for common data-cleansing tasks, including changing text case and data types, replacing values, and applying formulas.
Override the REPLACE WHERE predicate for a single refresh
You can now override a standalone streaming table's defined REPLACE WHERE predicate for a single refresh by adding a WHERE clause to the REFRESH STREAMING TABLE command. The override applies only to that refresh and doesn't change the table definition, which is useful for one-time backfills and corrections.
Lakeflow Designer support for compliance security profile standards
Lakeflow Designer now supports all compliance security profile standards supported by Databricks and is available by default for workspaces with the compliance security profile enabled. For a full list of supported compliance standards, see Compliance security profile . See Lakeflow Designer .
Reddit Ads connector is now available in Beta
The managed Reddit Ads connector in Lakeflow Connect is now available in Beta. You can use the connector to ingest advertising campaign data and performance metrics from Reddit Ads into Databricks. See Reddit Ads connector .
Unit testing for pipelines (Beta)
You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming tables, expectations, and append flows.
Anthropic managed ingestion connector (Beta)
The Anthropic connector in Lakeflow Connect is now available in Beta. The connector allows you to ingest Compliance API data , audit activity, organizations, users, roles, groups, settings, and Claude chats and messages , from Anthropic into Databricks. See Anthropic connector .
OpenAI connector (Beta)
The OpenAI connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the OpenAI Organization Admin API to ingest organization administration data, such as users, projects, API keys, usage, costs, and audit logs, from OpenAI into Databricks.
Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled
Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled. Query-based connectors ingest data from databases by querying the source directly using a cursor column, without requiring change data capture (CDC) configuration or an ingestion gateway.