Unit testing for pipelines (Beta)
BetaVerifiedAdded Sep 22, 2026
You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming tables, expectations, and append flows.
Topics: SQL, Streaming, Governance, Data integration, Observability
Summaries of vendors' own notes. Product names and logos belong to their owners; logos via logo.dev.
More Lakeflow releases
Every Lakeflow release| Date | Release | Type |
|---|---|---|
| Jul 24 | Lakeflow Designer Summer Release Update | Update |
| Jul 23 | C++ SDK for the Zerobus Ingest connector is now available in Beta Beta | Beta |
| Jul 22 | Override the REPLACE WHERE predicate for a single refresh Update | Update |
| Jul 22 | Lakeflow Designer support for compliance security profile standards Update | Update |
| Jul 31 | OpenAI connector (Beta) Beta | Beta |
| Jul 21 | Reddit Ads connector is now available in Beta Beta | Beta |
| Aug 3 | Environment variables for serverless jobs are in Beta Beta | Beta |
| Aug 3 | Automatic cost attribution for materialized views and streaming tables in Databricks SQL Update | Update |