Jobs & Pipelines
ReleaseWorth evaluating
Standard performance mode is available for one-time Jobs API runs
From Databricks release notes (AWS)
The Jobs API can now set `performance_target` to `STANDARD` for one-time runs. Apache Airflow's `DatabricksSubmitRunOperator` also supports this setting, so users who trigger one-time runs from Airflow can use it there too.
Learners using the Jobs API or Airflow should know that one-time runs now accept this performance mode setting.
What to re-read
More from Jobs & Pipelines
- ReleaseLakeflow Jobs show job-level query performance metrics and insights (GA)
- PreviewServerless job tasks can configure their environment from pyproject.toml (Beta)
- ReleaseGenie Code tasks in Lakeflow Jobs are generally available
- ReleaseLakeflow system tables for pipelines reach general availability