Real-Time Mode reaches GA for Lakeflow pipelines, with ForEach sinks to operational stores

Real-Time Mode on Spark Declarative Pipelines (Lakeflow pipelines) is generally available, giving millisecond-range latency for streaming flows. A real-time pipeline runs in continuous mode with an update flow whose trigger is RealTime, writing to a sink; a ForEach sink can write to Lakebase, Redis or another OLTP store. Binning several real-time flows into one pipeline and a native Lakebase sink are listed as next steps.

Read the original