0.8.2

Cinnamon/kotaemon0.8.2May 21, 2025by ts-thomas

AI Summary

Focuses on performance optimizations, caching improvements, and result highlighting enhancements with updated type definitions.

Key Highlights

  • Implemented Resolver Async Processing Workflow including Queuing
  • Extended Resolver Support with Worker, Persistent, and Cache modes
  • Extended Result Highlighting with Boundaries, Ellipsis, and Alignment
  • Charset renames (LatinExact => Exact, LatinDefault => Default, LatinSimple => Normalize) and removals

Breaking Changes

  • Charset names have been renamed and some presets (ArabicDefault, CyrillicDefault, Charset.CjkDefault) have been removed
  • Charset Charset.CjkDefault was renamed to Charset.CJK

New Features

  • Config-Serialized Query Caches
  • Async Resolver with queuing
  • Extended result highlighting
  • Improved Stemmer Handling
  • Updated TypeScript Typings

Full Release Notes

- Config-Serialized Query Caches, Improved caching strategy for Document indexes and Resolver
- Resolver Async Processing Workflow (including Queuing)
- Extended Resolver Support: Worker, Persistent, Cache
- Extended Result Highlighting: Boundaries, Ellipsis, Alignment
- Improved TypeScript Typings
- Improved Stemmer Handling
- Improved Result Highlighting
- Use multi-language charset normalization as the default Encoder
- Simplified charset support for multi-language content
- Charset renamed LatinExact => Exact, LatinDefault => Default and LatinSimple => Normalize, these are universal charset presets for any languages
- Charset ArabicDefault and CyrillicDefault was removed, they are fully covered by the default universal charset presets
- Charset Charset.CjkDefault was renamed to Charset.CJK