Jobs & Pipelines
ReleaseWorth evaluating
Lakeflow Jobs show job-level query performance metrics and insights (GA)
From Databricks release notes (AWS)
Improved Lakeflow Performance Observability is generally available. Lakeflow Jobs now show query performance metrics and insights at the job level for supported tasks, and an Optimize button opens Genie Code to help improve queries using those insights.
What to re-read
More from Jobs & Pipelines
- PreviewServerless job tasks can configure their environment from pyproject.toml (Beta)
- ReleaseGenie Code tasks in Lakeflow Jobs are generally available
- ReleaseLakeflow system tables for pipelines reach general availability
- ReleaseSaving an unchanged job no longer writes rows to the jobs system tables