Automatic change data feed computes row-level changes at query time with row tracking, without manually enabling change data feed on each Delta Lake or Apache Iceberg v3 table. It works with batch queries, Structured Streaming, and Delta Sharing, and requires Databricks Runtime 19 LTS or above with row tracking enabled.
The Databricks platform, as it moves
News
From the official release notes and blog. Every item points at the concepts worth re-reading.
Latest stories
Delta Lake
Release
Automatic change data feed is GA in Databricks Runtime 19 LTS
Change Data FeedRead
Delta Lake
Release
Automatic change data feed reached GA
Automatic change data feed reached general availability in Databricks. It computes change data feed at read time from row tracking on Delta Lake tables and row lineage on Apache Iceberg v3 tables, so qualifying Unity Catalog tables can serve row-level changes.
Change Data FeedRead
Delta Lake
Release
Automatic change data feed reads row-level changes without being switched on first
Auto CDF derives inserts, updates and deletes at query time from row tracking, so a table no longer has to have the change data feed enabled before the fact to be read as a stream of changes. Databricks measures MERGE and UPDATE about 15% faster with it. Generally available.
Change Data Feed +2Read
Everything, day by day
Tuesday 1 September
- Automatic change data feed is GA in Databricks Runtime 19 LTSAutomatic change data feed computes row-level changes at query time with row tracking, without manually enabling change data feed on each Delta Lake or Apache Iceberg v3 table. It works with batch queries, Structured Streaming, and Delta Sharing, and requires Databricks Runtime 19 LTS or above with row tracking enabled.
- Automatic change data feed reached GAAutomatic change data feed reached general availability in Databricks. It computes change data feed at read time from row tracking on Delta Lake tables and row lineage on Apache Iceberg v3 tables, so qualifying Unity Catalog tables can serve row-level changes.
- Change Data Feed renamed to Automatic change data feed
- Per-table Delta change data feed is legacy
- Automatic change data feed reads row-level changes without being switched on firstAuto CDF derives inserts, updates and deletes at query time from row tracking, so a table no longer has to have the change data feed enabled before the fact to be read as a stream of changes. Databricks measures MERGE and UPDATE about 15% faster with it. Generally available.
Nothing of that kind yet.