Release· Databricks release notes (AWS)
counter_diff is now available for SQL window calculations
Databricks added the counter_diff window function for time-series counter data. It calculates differences between consecutive cumulative counter values and handles counter resets, and is available in Databricks SQL and Databricks Runtime 19 and above.
Learners using SQL window functions now have a built-in function for cumulative counters that can reset.