Delta Lake
ReleaseWorth evaluating
Automatic change data feed reads row-level changes without being switched on first
From Databricks release notes
Auto CDF derives inserts, updates and deletes at query time from row tracking, so a table no longer has to have the change data feed enabled before the fact to be read as a stream of changes. Databricks measures MERGE and UPDATE about 15% faster with it. Generally available.
What to re-read
More from Delta Lake
- ReleaseMulti-statement transactions are GA on managed Delta and Iceberg tables
- ReleaseExternal Spark clients can write to Unity Catalog managed Delta tables (GA)
- PreviewTime travel can enforce ABAC policies on qualifying managed tables
- ReleaseAutomatic change data feed is GA in Databricks Runtime 19 LTS