Release· Databricks blog
On-demand state repartitioning added for Structured Streaming
Databricks announced on-demand state repartitioning for Apache Spark Structured Streaming on Databricks. The entry is aimed at people running stateful Structured Streaming queries in production.
Learners working with stateful streaming should know that Databricks now has a feature for repartitioning streaming state on demand.