In preview

What Databricks is shipping but has not settled. Kept on its own page on purpose: a preview is a thing to investigate, not a thing to build a pipeline or an exam answer on.

61 tracked · 10 written up
PreviewPublic Preview16

Open to everyone and supported for production use, though it can still change. On by default, and an admin can turn it off.

BetaBeta38

Open to most customers but not for production: support runs through engineering, and the shape of it can still move. On by default on Premium, off on Enterprise.

PrivatePrivate Preview7

Invite only, through your account team, and not for production. Here so you know it exists, not so you can plan around it.

Preview Radar

61 of 61 tracked
Public PreviewBetaPrivate PreviewGAlanded, last 90 daysFoundationsPlatform & governanceData engineering · LakeflowData warehousing & BIAI & MLai_decideThe ai_search SQL functionConfigurable recovery peri…Git CLI commands in Git fo…Lakehouse ReplayServerless usage policiesABAC DENY policiesDomains and subdomainsEnvironments on classic co…Fine-grained DML privilegesGovernance HubGoverned agentic app build…Governed tag propagationMetastore-level ABAC polic…PagesBundle deployment historyCustomerLakeLakewatchPrivate network gatewayServerless compute rate li…Sharing foreign Delta tabl…Sharing metric viewsAnomaly detectionAutomatic type widening in…Lakebase change data feedManaged Iceberg materializ…MySQL and PostgreSQL conne…Real-time mode in Lakeflow…Zerobus Ingest into defaul…Full-text search indexes o…Kafka-compatible APIs for…Lakebase backup schedule A…Lakehouse//RTShopify connectorUnit testing for pipelinesGenie ZeroOpsLakeflow Jobs health scoreGenie Code task in jobsLakebase SearchLakeflow JobsLTAP Direct WritesDashboard relationshipsGenie InspectGenie OntologyAI/BI dashboard dataset ma…Genie Code CLILakehouse Real-Time wareho…Memory in Genie OneREPLACE USING flowsWeb search in GenieQuery tagsDatabricks-managed MCP ser…MLflow deployment jobsAgent memory pipelinesAgent services in Unity Ca…ai_enrichFull-text search indexes i…Managed agent memoryMLflow Prompt RegistryMLflow review queuesProduction monitoring for…Service policies for AI se…Unified trace tableUnity Catalog SkillsUnity GatewayUnity Gateway external ser…Unity Gateway service poli…Unity Gateway Skills APIAI RuntimeFeature viewsai_decide — SQL, Beta1The ai_search SQL function — SQL, Beta2Configurable recovery period for dropped tables — Catalog, Public Preview3Git CLI commands in Git folders — Workspace, Public Preview4Lakehouse Replay — Compute, Public Preview5Serverless usage policies — Workspace, Public Preview6ABAC DENY policies — Catalog, Beta7Domains and subdomains — Catalog, Beta8Environments on classic compute — Compute, Beta9Fine-grained DML privileges — Catalog, Beta10Governance Hub — Catalog, Beta11Governed agentic app building — Apps, Beta12Governed tag propagation — Catalog, Beta13Metastore-level ABAC policies — Catalog, Beta14Pages — Catalog, Beta15Bundle deployment history — Workspace, Private Preview16CustomerLake — Apps, Private Preview17Lakewatch — Apps, Private Preview18Private network gateway — Workspace, Private Preview19Serverless compute rate limits — Compute, Private Preview20Sharing foreign Delta tables — Discover, Generally available21Sharing metric views — Discover, Generally available22Anomaly detection — Data Quality, Public Preview23Automatic type widening in Auto Loader — Data Ingestion, Public Preview24Lakebase change data feed — Lakebase, Public Preview25Managed Iceberg materialized views — Delta Lake, Public Preview26MySQL and PostgreSQL connectors — Data Ingestion, Public Preview27Real-time mode in Lakeflow pipelines — Streaming, Public Preview28Zerobus Ingest into default storage — Data Ingestion, Public Preview29Full-text search indexes on tables — Delta Lake, Beta30Kafka-compatible APIs for Zerobus Ingest — Data Ingestion, Beta31Lakebase backup schedule API — Lakebase, Beta32Lakehouse//RT — Lakebase, Beta33Shopify connector — Data Ingestion, Beta34Unit testing for pipelines — Jobs & Pipelines, Beta35Genie ZeroOps — Jobs & Pipelines, Private Preview36Lakeflow Jobs health score — Runs, Private Preview37Genie Code task in jobs — Jobs & Pipelines, Generally available38Lakebase Search — Lakebase, Generally available39Lakeflow Jobs — Jobs & Pipelines, Generally available40LTAP Direct Writes — Lakebase, Generally available41Dashboard relationships — Dashboards, Public Preview42Genie Inspect — Genie, Public Preview43Genie Ontology — Genie, Public Preview44AI/BI dashboard dataset materialization — Dashboards, Beta45Genie Code CLI — Genie, Beta46Lakehouse Real-Time warehouse — SQL Warehouses, Beta47Memory in Genie One — Genie, Beta48REPLACE USING flows — SQL Warehouses, Beta49Web search in Genie — Genie, Beta50Query tags — Query History, Generally available51Databricks-managed MCP servers — Agents, Public Preview52MLflow deployment jobs — Models, Public Preview53Agent memory pipelines — Agents, Beta54Agent services in Unity Catalog — Unity Gateway, Beta55ai_enrich — Unity Gateway, Beta56Full-text search indexes in AI Search — AI Search, Beta57Managed agent memory — Agents, Beta58MLflow Prompt Registry — Experiments, Beta59MLflow review queues — Experiments, Beta60Production monitoring for GenAI apps — Experiments, Beta61Service policies for AI securables — Unity Gateway, Beta62Unified trace table — Unity Gateway, Beta63Unity Catalog Skills — Agents, Beta64Unity Gateway — Unity Gateway, Beta65Unity Gateway external service policies — Unity Gateway, Beta66Unity Gateway service policies — Unity Gateway, Beta67Unity Gateway Skills API — Unity Gateway, Beta68AI Runtime — Experiments, Generally available69Feature views — Features, Generally available70
written up here on the radar only generally available, last 90 days the beam names each dot as it passes. Hover one to hold its name.
All 70 by number
Data engineering · Lakeflow
  1. 23Anomaly detectionData Quality
  2. 24Automatic type widening in Auto LoaderData Ingestion
  3. 25Lakebase change data feedLakebase
  4. 26Managed Iceberg materialized viewsDelta Lake
  5. 27MySQL and PostgreSQL connectorsData Ingestion
  6. 28Real-time mode in Lakeflow pipelinesStreaming
  7. 29Zerobus Ingest into default storageData Ingestion
  8. 30Full-text search indexes on tablesDelta Lake
  9. 31Kafka-compatible APIs for Zerobus IngestData Ingestion
  10. 32Lakebase backup schedule APILakebase
  11. 33Lakehouse//RTLakebase
  12. 34Shopify connectorData Ingestion
  13. 35Unit testing for pipelinesJobs & Pipelines
  14. 36Genie ZeroOpsJobs & Pipelines
  15. 37Lakeflow Jobs health scoreRuns
  16. 38Genie Code task in jobsJobs & PipelinesGA · 2026-10
  17. 39Lakebase SearchLakebaseGA · 2026-09
  18. 40Lakeflow JobsJobs & PipelinesGA · 2026-10
  19. 41LTAP Direct WritesLakebaseGA · 2026-10

Written up here the filled blips above

Domains and Pages BetaThe human half of the Genie Ontology. Domains group assets by business purpose, Pages define what a business term actually means, and Genie prefers both over what it infers.The Genie Ontology PreviewThe context layer shared by Genie One and Genie Code. Half of it is Unity Catalog semantics that a human governs, half is ranked snippets Genie infers from existing assets.Lakebase change data feed, from Postgres into Delta PreviewEvery insert, update and delete in a Lakebase schema recorded as rows of a Unity Catalog Delta table, read from the Postgres write-ahead log.Agent memory BetaLong-term memory for an agent, kept in a workspace store Databricks runs on Lakebase and partitioned by actor — where the store, not the actor, is the security boundary.Model Context Protocol on Databricks PreviewThree places an agent's MCP servers come from: Databricks-managed servers, external servers registered in Unity Catalog as MCP Services, and custom servers hosted as apps.Agent and MCP services as Unity Catalog securables BetaRegistering agents and MCP servers as Unity Catalog objects, so every team's agents are discoverable in one place and every tool a server exposes is chosen, policed and counted.Guardrails for generative applications BetaPolicies evaluated on the way in and on the way out of a model call, returning allow, deny or ask, plus the data-side masking that stops a prompt carrying what it should not.Production monitoring for GenAI apps BetaRegistered scorers run continuously against a sampled fraction of live traces and attach their verdicts to each trace as feedback, so quality drift shows up without a scheduled evaluation.Prompt registry BetaThe MLflow prompt registry stores prompt templates as versioned Unity Catalog objects with aliases for production, so a prompt change can be evaluated and rolled back like a model version.MLflow deployment jobs PreviewA deployment job binds a registered model to a Lakeflow job whose evaluation, approval and deployment tasks fire whenever a new model version appears, with a human gate in the middle.

What the labels actually promise

StageWho can use itProduction useSupportOn by default
PrivateInvite onlyNoEngineering onlyNo
BetaMost customersNoEngineering onlyPremium yes, Enterprise no
PreviewEveryoneYesThe support teamYes, with an opt-out
GAEveryoneYesThe support teamYes

The line that matters is between Beta and Public Preview. Public Preview is supported and may be used in production. Beta is not, whatever it looks like in the UI. Databricks publishes these definitions on itsrelease types page.

Every entry, with the detail

filter it, or read the radar above
AI/BI dashboard dataset materialization Beta#we cover itdocs Dataset materialization for AI/BI dashboards is in Beta.Oct 2026
Agent memory pipelines Beta#we cover itdocs A memory pipeline links a session store to a memory store.Oct 2026
Genie Code CLI Beta#we cover itdocs Genie Code CLI is a coding agent that runs in a terminal and works on local files.Oct 2026
Governed tag propagation Beta#we cover itdocs With tag propagation enabled on a governed tag, Unity Catalog uses lineage to apply that tag to derived tables and views after supported operations such as CREATE TABLE AS SELECT, CREATE VIEW, INSERT INTO .Oct 2026
Unity Gateway Beta#we cover itdocs Unity Gateway now offers a Jailbreak guardrail for MCP traffic, in Beta.Oct 2026
Unity Gateway Skills API Beta#docs A REST API for managing skills on Unity Gateway is now in Beta, covering create, read, update, list, delete and finalize.Oct 2026
Unity Gateway external service policies Beta#we cover itdocs In Beta, an external service policy on Unity Gateway forwards request and response content to a third-party guardrail vendor and blocks the call if the vendor denies it.Oct 2026
Unity Gateway service policies Beta#we cover itdocs In Beta, a custom LLM-as-a-judge service policy on Unity Gateway can use OpenJev (Qwen3.Oct 2026
ai_enrich Beta#we cover itdocs The ai_enrich function can now ground every row with a search tool on an external Model Context Protocol server registered in Unity Gateway, such as You.Oct 2026
ABAC DENY policies Beta#docs Attribute-based policies that deny rather than grant, evaluated against governed tags.Why it matters: Deny rules change how you design a permission model, so worth watching closely.Sep 2026
Dashboard relationships Preview#we cover itdocs A join graph across AI/BI dashboard datasets, resolved at query time, with cross-dataset measures over several fact tables.Why it matters: The dynamic-grain counterpart to a metric view. Support for relationships in Unity Catalog is still in progress.Sep 2026
Governed agentic app building Beta#docs Databricks says you can now build governed data and AI apps without code.Sep 2026
Lakebase backup schedule API Beta#we cover itdocs Databricks added a Beta snapshot schedule API for Lakebase.Sep 2026
Metastore-level ABAC policies Beta#we cover itdocs Unity Catalog now has Beta support for attaching an ABAC policy at the metastore level.Sep 2026
Shopify connector Beta#we cover itdocs Lakeflow Connect now has a Shopify connector in Beta.Sep 2026
Zerobus Ingest into default storage Preview#we cover itdocs Push records into a Unity Catalog table backed by default storage, with no external location and no message bus.Why it matters: Ingesting into streaming tables is already generally available; this removes the last piece of setup.Sep 2026
ai_decide Beta#we cover itdocs ai_decide is a new AI Function in Beta that answers one or more questions about an input in a single call.Sep 2026
Environments on classic compute Beta#docs Declare dependencies as an environment on a classic cluster instead of cluster libraries and init scripts.Why it matters: One dependency model across serverless and classic compute, instead of two that behave differently.Aug 2026
Fine-grained DML privileges Beta#docs INSERT, UPDATE and DELETE as separate privileges under MODIFY, so a role can change rows without changing schema.Why it matters: The first change to the core Unity Catalog privilege list in years, which dates every permission diagram.Aug 2026
Private network gateway Private#docs One managed gateway for serverless traffic to your VPC, to on-premises systems and to the internet, reusing the network connectivity configuration.Why it matters: It would replace today’s sprawl of connectivity configurations, PrivateLink and egress rules with a single object.Aug 2026
REPLACE USING flows Beta#we cover itdocs Keeps a streaming table in sync from partial snapshots by replacing every row that matches the key columns.Why it matters: Completes the change-capture family next to AUTO CDC and REPLACE WHERE, which are both generally available.Aug 2026
The ai_search SQL function Beta#we cover itdocs Retrieval from an AI Search index, reranking and an optional grounded answer, all from one SQL function.Why it matters: Retrieval-augmented generation collapsed into a single SQL call, with citations arriving alongside it.Aug 2026
Unified trace table Beta#we cover itdocs Every request and response across the gateway in one Unity Catalog table, in OpenTelemetry format.Why it matters: The observability half of Unity Gateway reaching general availability.Aug 2026
Unity Catalog Skills Beta#docs Governed, reusable instructions that an agent can load, registered in Unity Catalog.Why it matters: Skills as a governed object rather than a prompt pasted into a notebook.Aug 2026
Git CLI commands in Git folders Preview#docs Run arbitrary git commands, including stash, interactive rebase and force push, inside a Git folder.Why it matters: Removes the limitation people hit within a week of using Git folders.Jul 2026
Governance Hub Beta#docs An account-level view of data health, coverage, AI usage and what is driving cost.Why it matters: The new front door for platform administrators, pulling together what is scattered today.Jul 2026
Lakehouse//RT Beta#we cover itdocs Analytics over live operational data in Lakebase, separate from registering the database as a Unity Catalog catalog.Why it matters: It is the answer to "can we report on the application database without copying it", and it is not settled yet.Jul 2026
Managed Iceberg materialized views Preview#we cover itdocs Materialized views stored as managed Iceberg tables, readable by external Iceberg engines.Why it matters: Extends managed Iceberg, generally available since May, from base tables to derived ones.Jul 2026
Memory in Genie One Beta#we cover itdocs Genie One remembering context between conversations, with confirmation prompts before it keeps something.Why it matters: Changes the experience for business users more than any other addition to the surface.Jul 2026
Unit testing for pipelines Beta#docs Python unit tests over pipeline transforms with mocked table inputs, run from the pipeline editor.Why it matters: The first native testing story for declarative pipelines, and the biggest gap against plain Spark.Jul 2026
Configurable recovery period for dropped tables Preview#we cover itdocs Set how long a dropped managed table can be undropped, from nothing at all to thirty days.Why it matters: It changes what UNDROP TABLE can actually do, which is the sort of detail an exam asks about.Jun 2026
CustomerLake Private#docs A customer data platform that runs inside the lakehouse rather than copying customer data out to one: Customer 360, identity resolution, audiences, activation and campaigns, governed by Unity Catalog, with profile and campaign agents on top and a real-time profile API.Why it matters: Announced at Data + AI Summit 2026 as a Private Preview; there is no documentation page yet, so the blog post is the page that carries the label.Jun 2026
Genie Ontology Preview#we cover itdocs The shared context layer behind Genie, half defined by you in Unity Catalog and half inferred from metric views, dashboards and queries.Why it matters: On by default since August 2026, so it is already shaping answers in workspaces that never opted in.Jun 2026
Genie ZeroOps Private#docs A background agent that watches jobs, pipelines, tables and models in production, traces a failure or a drift to its cause through Unity Catalog lineage, drafts a fix and validates it in a sandbox before a person approves it.Why it matters: Often searched for as Genie Ops; the name is Genie ZeroOps. Private Preview announced June 2026, nothing in the documentation yet.Jun 2026
Lakehouse Replay Preview#docs Shadow-runs a sample of read-only serverless queries against a coming runtime version to catch regressions.Why it matters: It changes how a runtime upgrade is planned, from hoping to measuring.Jun 2026
Lakebase change data feed Preview#we cover itdocs Every insert, update and delete in a Lakebase schema written to Unity Catalog Delta history tables, read from the Postgres write-ahead log.Why it matters: It is the built-in route from operational Postgres to the lakehouse: no CDC tool, no message bus, no replication slot to watch.May 2026
Real-time mode in Lakeflow pipelines Preview#docs A trigger setting on a pipeline sink that pushes end-to-end latency down to milliseconds instead of micro-batches.Why it matters: It breaks the micro-batch assumption that sits under everything written about streaming so far.May 2026
Automatic type widening in Auto Loader Preview#docs Evolves an integer column to long, or float to double, without rewriting the table.Why it matters: Schema evolution is the part of Auto Loader people get wrong most often, and this changes the answer.Mar 2026
Lakewatch Private#docs An agentic SIEM as a native application on a workspace: telemetry lands in open formats normalised to OCSF, Lakeflow Connect ingests it, Genie hunts in natural language, Agent Bricks agents triage and respond, and detections are code.Why it matters: Private Preview since March 2026 with named customers; no documentation page exists, so the announcement carries the label until one does.Mar 2026
Anomaly detection Preview#we cover itdocs Schema-level monitoring that learns freshness and completeness from history and flags tables that went quiet or arrived thin.Why it matters: The only layer that catches an upstream job stopping, which no row-level rule can see.Feb 2026
Agent services in Unity Catalog Beta#we cover itdocs Agents registered as Unity Catalog securables, discoverable next to tables and models.Why it matters: Governance for agents that works like governance for data.2026
Bundle deployment history Private#docs A record of what each bundle deployment changed, queryable after the fact.Why it matters: Deployment archaeology is currently a git log and a guess.2026
Databricks-managed MCP servers Preview#we cover itdocs Ready-made Model Context Protocol servers for Genie, AI Search, SQL and Unity Catalog functions.Why it matters: The documented default way to give an agent tools, ahead of hand-written wrappers.2026
Domains and subdomains Beta#we cover itdocs Groups catalogs, tables and assets into business domains using governed tags, with one level of nesting.Why it matters: The organising layer Unity Catalog has been missing, and it feeds the Genie Ontology.2026
Full-text search indexes in AI Search Beta#we cover itdocs Indexes that need no embeddings at all, available on storage-optimized endpoints.Why it matters: The reason Vector Search was renamed AI Search.2026
Full-text search indexes on tables Beta#docs CREATE SEARCH INDEX on a text column lets the search and isearch functions skip files that cannot contain a match. Off by default, Databricks Runtime 18.2 and above.Why it matters: Substring and keyword lookups without scanning the whole table. Not the same thing as AI Search full-text indexes.2026
Genie Inspect Preview#we cover itdocs Inspecting how a Genie Agent reached an answer, step by step.Why it matters: The debugging surface for an agent that answers confidently and wrongly.2026
Kafka-compatible APIs for Zerobus Ingest Beta#we cover itdocs Producers that already speak the Kafka protocol write into Zerobus Ingest without switching to its SDKs or REST API.Why it matters: Moving an existing Kafka producer becomes a configuration change rather than a rewrite.2026
Lakeflow Jobs health score Private#docs A health score per job, summarising reliability and cost signals in one number.Why it matters: Worth watching because it would change how job monitoring is presented, not only measured.2026
Lakehouse Real-Time warehouse Beta#we cover itdocs A fourth SQL warehouse type aimed at low-latency serving, alongside serverless, pro and classic.Why it matters: Changes the answer to "which warehouse type" questions once it settles.2026
MLflow Prompt Registry Beta#we cover itdocs Version prompt templates like code, with aliases for production and automated optimisation.Why it matters: Prompts are the part of a generative application that changes most and is versioned least.2026
MLflow deployment jobs Preview#we cover itdocs Bind a registered model to a job that evaluates, asks for approval and deploys when a new version appears.Why it matters: Model promotion with a human in the loop, without writing the orchestration yourself.2026
MLflow review queues Beta#we cover itdocs A reviewer workflow for labelling traces one item at a time, for people who are not workspace users.Why it matters: Expert feedback is the input that makes an LLM judge worth trusting.2026
Managed agent memory Beta#we cover itdocs Memory stores as Unity Catalog securables, holding episodic and semantic memory for an agent.Why it matters: Agents that remember are a different product from agents that do not.2026
MySQL and PostgreSQL connectors Preview#we cover itdocs Managed log-based change capture from the MySQL binlog and from PostgreSQL logical replication.Why it matters: The two most common open-source operational databases, still behind SQL Server and Oracle in the connector line-up.2026
Pages Beta#we cover itdocs Governed, authoritative definitions of business terms, entities and acronyms, held in Unity Catalog.Why it matters: A glossary that the AI surfaces actually read, rather than a wiki nobody updates.2026
Production monitoring for GenAI apps Beta#we cover itdocs Runs the same evaluation scorers against a sample of live traces and attaches the results to each trace.Why it matters: The only honest way to know whether a deployed agent is still good.2026
Serverless compute rate limits Private#docs Caps on how much serverless compute an account or workspace can consume.Why it matters: The control that is missing when serverless spend runs away, and there is no cluster to stop.2026
Serverless usage policies Preview#we cover itdocs Attribute serverless spend to a team or project by attaching a policy that tags the usage.Why it matters: Serverless usage is otherwise hard to attribute, which is how budgets get surprised.2026
Service policies for AI securables Beta#we cover itdocs Policies evaluated when a model is called and when it answers, returning allow, deny or ask, with built-in safety judges.Why it matters: The replacement for AI guardrails, and it fails closed by design.2026

Labels come from the documentation page of each feature and are re-checked by the agent. A feature that reaches general availability leaves the radar above and is listed below, with its page kept as it was.

Made it to generally available

9 tracked features have graduated
Lakeflow Jobsgenerally availablewe cover itA Lakeflow job can now carry up to five triggers.Oct 2026
Genie Code task in jobsgenerally availableRuns an autonomous agent from a natural-language prompt as a task inside a job.Oct 2026
AI Runtimegenerally availablewe cover itServerless GPU compute with a distributed decorator for PyTorch, DeepSpeed and Ray workloads.Oct 2026
Feature viewsgenerally availablewe cover itDeclarative features with windowed aggregations, materialised on demand instead of hand-built tables.Oct 2026
Sharing foreign Delta tablesgenerally availablewe cover itPut foreign tables in Delta format, which Databricks reads straight from their source storage, inside a share.Oct 2026
Sharing metric viewsgenerally availablewe cover itPut a metric view inside a share, so a recipient gets the governed measures and dimensions rather than the tables under them.Oct 2026
LTAP Direct Writesgenerally availablewe cover itA faster path for the initial load and the snapshot refreshes of a synced table, for new synced tables on Postgres 17.Oct 2026
Query tagsgenerally availablewe cover itKey-value tags set per session or per statement that show up in query history and in the system tables.Oct 2026
Newsletter

Watch the previews that turn into products

Most previews quietly become generally available, and a few quietly disappear. We re-read the documentation behind each one and tell you when a label changes.

Choose what you get5 of 43
Your stack · Platform & governance

Tick what you run, and untick “Everything worth knowing” to get only that.

Data engineering · Lakeflow
Data warehousing & BI
AI & ML
Your learning paths

Each one is a section of the letter, and you only get the ones you tick. Every email carries a link back to this list, so you can change it later without an account.

Double opt-in: we send one email to check the address is yours. Nothing else until you confirm.