0.8.2
kyutai-labs/moshi0.8.2May 21, 2025by ts-thomas
AI Summary
Introduces advanced caching and async processing workflows while simplifying charset support with universal presets and renaming legacy charset names.
Key Highlights
- Config-Serialized Query Caches
- Resolver Async Processing Workflow including Queuing
- Extended Result Highlighting with Boundaries and Ellipsis
- Universal charset presets replacing legacy Latin presets
- Removal of ArabicDefault and CyrillicDefault charsets
Breaking Changes
- Charset renamed from LatinExact to Exact
- Charset renamed from LatinDefault to Default
- Charset renamed from LatinSimple to Normalize
- Charset ArabicDefault and CyrillicDefault were removed
New Features
- Async processing workflow
- Query caching
- Extended result highlighting
- Charset normalization simplification
Full Release Notes
- Config-Serialized Query Caches, Improved caching strategy for Document indexes and Resolver - Resolver Async Processing Workflow (including Queuing) - Extended Resolver Support: Worker, Persistent, Cache - Extended Result Highlighting: Boundaries, Ellipsis, Alignment - Improved TypeScript Typings - Improved Stemmer Handling - Improved Result Highlighting - Use multi-language charset normalization as the default Encoder - Simplified charset support for multi-language content - Charset renamed LatinExact => Exact, LatinDefault => Default and LatinSimple => Normalize, these are universal charset presets for any languages - Charset ArabicDefault and CyrillicDefault was removed, they are fully covered by the default universal charset presets - Charset Charset.CjkDefault was renamed to Charset.CJK