Compute
PreviewWorth evaluating
DataFrame caching on serverless compute enters Public Preview
From Databricks release notes (AWS)
df.cache() and df.persist() now work on serverless compute, so an expensive result can be reused for the rest of a session. It needs serverless environment version 5 or above, plus Databricks Connect for Python 18.1.8 or Scala 18.1.5 or above. The preview is on by default for most workspaces and admins can switch it off from the Previews page.
What to re-read
More from Compute
- ReleaseDatabricks Runtime 19 hides row filter and column mask metrics in Spark Connect
- PreviewPrivate Network Gateway for serverless: Private Preview on AWS, Public Preview on Azure
- ReleasePrivate Link from serverless compute to AWS-managed resources is generally available
- DeprecatedDatabricks Runtime 10.4 LTS ends on 2026-11-01