v2.1.9

clusterzx/paperless-aiv2.1.9Jan 13, 2025by clusterzx

AI Summary

A maintenance release that restores the Ollama context size configuration and introduces a new setting to include existing correspondents and tags in prompts for better matching.

Key Highlights

  • Restored Ollama `num_ctx` setting to 100,000 tokens.
  • Added a new 'Use existing Correspondents and Tags' option to improve data matching consistency.

New Features

  • Ollama context size configuration
  • Prompt augmentation with existing tags and correspondents

Full Release Notes

**Full Changelog**: https://github.com/clusterzx/paperless-ai/compare/v2.1.8...v2.1.9

Added a new Settings option:
Brought back num_ctx (100000) for Ollama.

"Use existing Correspondents and Tags".

If you choose yes, all your tags and correspondents will be added to the prompt for later data matching and providing better consistent results. BUT it will increase your token length and will be costlier and for Ollama much more possible to run into issues.
When you have many preexisting data it will be somtimes the case that the prompt only consists of your data and nothing more. So pay attention!