Compute
ReleaseWorth evaluating

Databricks Runtime 19 hides row filter and column mask metrics in Spark Connect

From Databricks release notes (AWS)

In the 19 October 2026 Databricks Runtime 19 update, Spark Connect DataFrame execution metrics no longer show internal operators and metrics tied to row filters and column masks, so policy execution details are not exposed through df.executionInfo.metrics. Query results do not change. Notebooks or tools that read detailed metrics inside protected subplans may need updating.

Read the original

What to re-read

More from Compute

All news in Compute