Data Ingestion
ReleaseNice to know
Debezium Server 3.7 adds a Zerobus Ingest sink for CDC into Delta tables
From Databricks blog
Debezium Server 3.7 ships a sink that sends change events from a source database straight to Zerobus Ingest, which writes them to Unity Catalog Delta tables with no Kafka cluster between them. A default typed mode maps events onto the source's columns, and an envelope mode lands each full change event in a fixed nine-column table with an idempotency key. Delivery is at-least-once, so duplicates are removed downstream, for example with AUTO CDC.
What to re-read
More from Data Ingestion
- PreviewLakeflow Connect gets a managed Okta connector in Beta
- ReleaseZerobus Ingest into default-storage tables is generally available
- PreviewData freshness column added to Lakeflow Connect database pipelines (Public Preview)
- PreviewLakeflow Connect adds a Microsoft Graph Logs connector in Beta for security alerts