Jobs & Pipelines
ReleaseNice to know
Lakeflow system tables for pipelines reach general availability
From Databricks release notes (AWS)
The lakeflow system tables pipelines and pipeline_update_timeline are now generally available. They record the pipelines and pipeline updates in an account, and are documented in the jobs system table reference.
What to re-read
More from Jobs & Pipelines
- ReleaseLakeflow Jobs show job-level query performance metrics and insights (GA)
- PreviewServerless job tasks can configure their environment from pyproject.toml (Beta)
- ReleaseGenie Code tasks in Lakeflow Jobs are generally available
- ReleaseSaving an unchanged job no longer writes rows to the jobs system tables