Streaming
ReleaseWorth evaluating

On-demand state repartitioning is generally available for stateful streaming

From Databricks release notes (AWS)

You can now change the number of shuffle partitions of a stateful Structured Streaming query or a Lakeflow pipeline without losing its checkpoint state. The feature is generally available.

Read the original

What to re-read

More from Streaming

All news in Streaming