Serving
PreviewWorth evaluating
Custom model serving protobuf requests accept text and binary inputs (Public Preview)
From Databricks release notes (AWS)
Protobuf requests to custom model serving endpoints can now mix numeric tensors with text and binary payloads such as images, audio or documents, sent as KServe v2 BYTES tensors; text and binary outputs come back the same way. It is in Public Preview and works only on endpoints deployed after November 10, 2026; endpoints deployed earlier do not get it.
What to re-read
More from Serving
- DeprecatedZhipu AI GLM 5.2 deprecated, retirement set for February 4, 2027
- DeprecatedDeepSeek V4 Flash (0731) retired; DeepSeek V4.1 Flash (1017) is the replacement
- DeprecatedThinking Machine Labs Inkling retired on 30 October 2026; GLM 5.3 or Kimi K3 recommended
- DeprecatedMoonshot AI Kimi K2.7 retired on 30 October 2026; Kimi K3 recommended