Databricks enhances Lakeflow pipelines with continuous jobs
Databricks now allows users to orchestrate continuous Lakeflow pipelines with continuous jobs. This integration enables pipelines to leverage job-level features such as serverless Standard performance mode and additional notification destinations. The company recommends this new approach over the pipeline's existing built-in continuous setting, which remains available. This change primarily affects Databricks users working with Lakeflow pipelines.
Features (1) ›
- Continuous Lakeflow pipeline orchestration with continuous jobs
Users can now run a continuous Lakeflow pipeline using a continuous job, gaining access to job-level features like serverless Standard performance mode and expanded notification options. Databricks recommends this new orchestration pattern over the existing pipeline-specific continuous setting.
https://docs.databricks.com/aws/en/release-notes/product/2026/august#orchestrate-continuous-pipelines-with-continuous-jobs
Related releases
- Zerobus Ingest enabled by default for Databricks compliance security profiles Databricks Release Notes ·
- Databricks Lakeflow Introduces REPLACE USING Flows for Pipelines (Beta) Databricks Release Notes ·
- JAR Tasks on Serverless Compute Now Generally Available on Databricks Databricks Release Notes ·
- JAR Tasks on Serverless Compute Now Generally Available in Databricks Lakeflow Databricks Release Notes ·
- Change Data Feed Now Available for Databricks Materialized Views (Beta) Databricks Release Notes ·
- Databricks Lakeflow Connect adds SendGrid connector (Beta) Databricks Release Notes ·