CoProcess user-defined functions in Pipeline Builder
Pipeline Builder now supports keyed CoProcess UDFs for custom stateful logic that processes events from two streams and merges them into one output stream.
Also shipped Aug 13, 2026Palantir in August 2026 →
BigQuery pipelines add automated metadata enrichment in preview
Semantic metadata defined in SQLX configurations now syncs with Knowledge Catalog, and the Data Engineering Agent can generate this metadata from your intent or context.
Sharing tables backed by default storage will be enabled by default for all accounts
OpenSharing support for tables backed by default storage is generally available and on by default for most accounts. For most Enterprise or Premium tier accounts, Databricks will enable it automatically in mid-September 2026, and by early 2027 for the rest.
Expanded networking billing for OpenSharing SecureConnect
Databricks will be expanding networking billing for OpenSharing SecureConnect. Today, data providers are billed for data transfer (egress) when recipients access shared data through SecureConnect. Additional charge types and access scenarios, including charges billed to recipients, are planned.
OpenSharing SecureConnect will be available by default for all accounts
OpenSharing SecureConnect is generally available and available by default for accounts on the Premium plan. For accounts on the Enterprise plan, Databricks will enable it automatically in mid-September 2026, and by early 2027 for the rest.
Block or redact sensitive data in requests and responses
The Sensitive Data Detection guardrail (Beta) detects structured sensitive data (such as Social Security numbers, credit card numbers, IBANs, and phone numbers) and either blocks the interaction or redacts the matched values in place.
Smart Routing: Cut AI costs by routing each task to the right model
Smart Routing (Beta) automatically picks the right model and agent harness for each task, based on complexity, permissions, and budget. It shifts routine work to lower-cost models and reserves frontier models for hard problems, and every routing decision is visible and auditable.
More from Foundry and AIPEvery Foundry and AIP release →
Object timeline for observability of actions on objects
Object timeline shows edits made to an object by agents or manual actions with attribution, plus token usage, runtime, and agentic coverage.
AIP Analyst adds skills, time series analysis, Ontology interfaces, Foundry exports
AIP Analyst now supports AIP skills, lookup of past analyses, time series analysis, Ontology interfaces, and exporting results to Foundry resources.
AIP Evolve in beta
AIP Evolve, in beta for enrollments with AIP and AI FDE, coordinates fleets of AI FDE agents to improve AI systems toward a defined target, goal, and constraints.
Gemma 4 31B available in AIP through AWS Bedrock
Gemma 4 31B is available in AIP through AWS Bedrock for eligible commercial enrollments.
Gemini 3.7 Flash available in AIP
Gemini 3.7 Flash is available in AIP for non-georestricted, US, EU, IL2, IL4, and IL5 enrollments with Google Vertex AI enabled.
Grok 4.6 from xAI available in AIP
Grok 4.6 is available in AIP on US georestricted and non-georestricted enrollments with xAI enabled.
Media in TypeScript and Python functions is generally available
Working with media in functions is generally available: functions can accept media inputs, upload media, attach it to Ontology objects, and read media bytes and metadata.
Custom compute profiles for DataFusion faster pipelines
Faster pipelines backed by DataFusion now support a custom compute profile alongside five standard sizes, with independent CPU and memory settings and tunable session parameters.