Databricks Lakeflow: Pipeline Events System Table Enters Beta
Databricks has introduced the `pipeline_events` system table, now available in Beta for Lakeflow users. This table centralizes operational data, capturing event log entries, lifecycle transitions, flow progress, data quality, and errors across all Lakeflow pipelines and workspaces in a region. Engineers can leverage it to query historical pipeline activity, establish alerts for failures, and correlate pipeline behavior with other Lakeflow system tables for enhanced operational visibility.
Features (1) ›
- New Pipeline Events System Table for Lakeflow
The `pipeline_events` system table is now in Beta, recording event log entries for all Lakeflow pipelines in an account. It captures lifecycle transitions, flow progress, data quality metrics, and errors, centralizing operational data across all pipelines and workspaces in a region.
https://docs.databricks.com/aws/en/release-notes/product/2026/august#pipeline-events-system-table-is-in-beta
Related releases
- Databricks Lakeflow Connect Adds Managed Glean Data Ingestion Connector (Beta) Databricks Release Notes ·
- Databricks Lakeflow Connect: Zerobus Ingest to Streaming Tables GA Databricks Release Notes ·
- Databricks Lakeflow Designer August Release Adds Unique Operator and Canvas Enhancements Databricks Release Notes ·
- Databricks Lakeflow Jobs Now Integrates Genie Code as a Beta Task Databricks Release Notes ·
- OpenAI Connector for Databricks Lakeflow Connect (Beta) Databricks Release Notes ·
- Databricks Lakeflow Connect PagerDuty Connector Enters Beta Databricks Release Notes ·