v0.8.0

livestorejs/livestorev0.8.0Mar 26, 2026by Pringled

AI Summary

A major feature update for the model2vec library that refactors persistence, replaces the tokenizer with a new implementation, and updates documentation and Python support.

Key Highlights

  • Replaced tokenizer code with skeletoken
  • Refactored persistence system
  • Deprecated Python 3.9 support
  • Updated results to MTEB V2

Breaking Changes

  • Deprecated Python 3.9 support

New Features

  • New tokenizer implementation
  • Refactored persistence, removed from_sentence_transformers
  • Exposed random seed
  • Added utility for tokenizer pad id

Full Release Notes

## What's Changed
* docs: Added CITATION.cff, updated citation info by @Pringled in https://github.com/MinishLab/model2vec/pull/293
* docs: Added modelcard logo by @Pringled in https://github.com/MinishLab/model2vec/pull/294
* docs: Update default model for example by @Pringled in https://github.com/MinishLab/model2vec/pull/299
* chore: Deprecated Python 3.9 support by @Pringled in https://github.com/MinishLab/model2vec/pull/301
* chore: Update CI to run on external PRs, fix test import by @Pringled in https://github.com/MinishLab/model2vec/pull/303
* feat: replace tokenizer code with skeletoken by @stephantul in https://github.com/MinishLab/model2vec/pull/302
* feat: refactor persistence, remove from_sentence_transformers by @stephantul in https://github.com/MinishLab/model2vec/pull/305
* fix: refix tokenizer with added token shenanigans by @stephantul in https://github.com/MinishLab/model2vec/pull/304
* fix: if layers == 0, layers were not initialized by @stephantul in https://github.com/MinishLab/model2vec/pull/306
* feat: expose random seed, small typing fix by @stephantul in https://github.com/MinishLab/model2vec/pull/308
* feat: add util for tokenizer pad id  by @stephantul in https://github.com/MinishLab/model2vec/pull/310
* docs: Update results to MTEB V2 by @Pringled in https://github.com/MinishLab/model2vec/pull/311
* chore: Bump version by @Pringled in https://github.com/MinishLab/model2vec/pull/312


**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.7.0...v0.8.0