Jobs & Pipelines
ReleaseWorth evaluating
Continuous jobs can run Lakeflow pipelines
From Databricks release notes
A continuous job can now drive a Lakeflow pipeline, which brings serverless performance mode and the job's notification settings to a pipeline that never stops. Generally available.
What to re-read
More from Jobs & Pipelines
- ReleaseLakeflow Jobs show job-level query performance metrics and insights (GA)
- PreviewServerless job tasks can configure their environment from pyproject.toml (Beta)
- ReleaseGenie Code tasks in Lakeflow Jobs are generally available
- ReleaseLakeflow system tables for pipelines reach general availability