PreviewWorth evaluating· Databricks release notes (AWS)
pipeline_events adds a Beta system table for Lakeflow pipeline events
The pipeline_events system table is in Beta and records Lakeflow pipelines event log entries for pipelines in an account. It includes lifecycle transitions, flow progress, data quality metrics, errors, and other operational data across pipelines and workspaces in a region.
Learners studying Lakeflow pipelines can query historical pipeline activity and failures across pipelines.