This serverless compute release includes updates from Databricks Runtime 18 . New features Spark Declarative Pipelines on Lakeflow streaming query ID : Spark Declarative Pipelines on Lakeflow can now set the streaming query ID on demand.
Materialized view and streaming table refreshes that are orchestrated through a SQL task in a Lakeflow job now respect the job's Performance optimized setting. When the setting is turned off, the refresh uses standard performance mode, which consumes fewer DBUs.
Databricks, Inc. is an American data and artificial intelligence software company headquartered in San Francisco, California. It was founded in 2013 by the original creators of Apache Spark at the University of California, Berkeley.