Lakebase
ReleaseNice to know
Lakebase Search tokenizer handles Chinese, Japanese and Korean text
From Databricks release notes (AWS)
The lakebase_tokenizer extension gains a morphological template that segments Chinese, Japanese and Korean text, with built-in tokenizer_chinese, tokenizer_japanese and tokenizer_korean configurations. It ships in lakebase_tokenizer 0.2.0; existing users run ALTER EXTENSION lakebase_tokenizer UPDATE and keep their configurations and indexes.
What to re-read
More from Lakebase
- ReleaseLakebase supports Postgres logical replication in and out
- ReleaseLTAP Direct Writes for Lakebase synced tables is generally available
- ReleaseLakebase Search gets lakebase_tokenizer for configurable keyword matching
- ReleaseLakebase Search is GA: BM25 and vector search extensions in Postgres