Starstruk Logo MarkStarstruk

v1.4.6

clusterzx/paperless-aiv1.4.6Jan 6, 2025by clusterzx

AI Summary

This release focuses on optimizing context handling to prevent errors with large documents. It introduces a tokenization service to manage content size effectively. By precalculating token sizes, the application can now trim content to fit within larger context limits.

Key Highlights

  • Added tokenization service to precalculate token size.
  • Trim content to fit for larger contexts.
  • Optimized handling of large inputs.

New Features

  • Tokenization service

Full Release Notes

**Full Changelog**: https://github.com/clusterzx/paperless-ai/compare/v1.4.5...v1.4.6

- Added a tokinization service to precalculate token size and trim to fit for larger contexts.