Releasesby IbisServerless job environments from pyproject.toml (Beta)
Beta2 days agoUnverifiedAdded Oct 24, 2026
Serverless notebook and Python script tasks can use a pyproject.toml file to configure their job environment. Configure the project environment in the Jobs UI, the Jobs API, or a bundle. Workspace admins can enable Project-Scoped Shared Compute on the Previews page . See Configure a project environment with pyproject.toml .
Topics: Notebooks, Developer tools
More Lakeflow releases
Every Lakeflow releaseMicrosoft Entra ID connector is available in Beta
The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect. Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Databricks.
Box Audit Logs managed ingestion connector (Beta)
The Box Audit Logs connector for Lakeflow Connect is now available in beta, enabling the ingestion of enterprise audit events into Databricks.
Google Analytics Aggregated connector is available in Beta
The managed Google Analytics Aggregated connector is now available in beta for Lakeflow Connect, supporting incremental ingestion of GA4 report data.
Lakeflow pipelines system tables are now generally available (GA)
The lakeflow system tables pipelines and pipeline_update_timeline are now generally available. These tables record the pipelines and pipeline updates in your account. For a reference of these tables, see Jobs system table reference .
SurveyMonkey connector is available in Beta
The managed SurveyMonkey connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest surveys, survey structure, collectors, survey responses, and contacts from SurveyMonkey into Databricks.
Oracle Eloqua connector is available in Beta
The managed Oracle Eloqua connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest marketing data such as contacts, accounts, campaigns, email and form assets, form submissions, events, and website visitors from Oracle Eloqua into Databricks.
Asana connector is available in Beta
The managed Asana connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. Use the connector to ingest work management data such as workspaces, teams, projects, tasks, portfolios, and goals from Asana into Databricks. The connector uses OAuth user-to-machine (U2M) authentication.
Saving an unchanged job no longer adds rows to the jobs system tables
Saving a job without changing its settings no longer adds rows to system.lakeflow.jobs or system.lakeflow.job_tasks , and change_time stays at the last change. This applies to saves from the UI, the Jobs API, and Declarative Automation Bundles. See Jobs table schema .
Also shipped on Oct 22, 2026
Databricks in October 2026Trace and evaluate Cursor agents with Langfuse, powered by ClickHouse
Users can now connect Cursor to Langfuse to trace agent turns and analyze model and tool calls, with ClickHouse providing the underlying analytics infrastructure.
The AI.TRANSLATE function lets you translate text strings between languages
The AI.TRANSLATE function lets you translate text strings between languages. AI.TRANSLATE supports standard Neural Machine Translation (NMT) workloads and Translation LLM (TLLM) capabilities. This function is generally available (GA).
Replit Monitoring Agent: Your very own software engineering team
Replit Monitoring Agent is an autonomous tool that investigates production alerts, identifies causes, applies fixes, and deploys them to production for internal apps.
You can configure Direct VPC ingress for Cloud Run instances ( Preview )
You can configure Direct VPC ingress for Cloud Run instances ( Preview ). Direct VPC ingress lets Cloud Run instances on a VPC network use their own ephemeral private IP address to communicate with each other and with other resources on the VPC network.
Gemini Enterprise: Single-user quota limits
Gemini Enterprise administrators can configure single-user quota limits on the Usage & Spending > Usage page in the Google Cloud console to prevent an individual user from using all of an edition's shared subscription quota pool.
Optimize AI costs with Agent Observability
Datadog introduced Agent Observability to help engineers identify applications driving AI spend, prioritize savings, and validate cost changes against performance.