v0.7.0

livestorejs/livestorev0.7.0Oct 5, 2025by Pringled

AI Summary

This release focuses on performance optimizations and configuration flexibility for the model2vec library, introducing vocabulary quantization and faster model loading speeds. It also adds support for configurable padding tokens and pooling modes for distillation.

Key Highlights

Vocabulary quantization for improved efficiency
Faster loading for models that are already cached
Configurable padding tokens and embedding data types
Configurable pooling modes for distillation
Python 3.13 support added to CI

New Features

Support for passing weight to loss functions
Classifier freezing capability
Vocabulary quantization feature
Configurable padding token support
Faster model loading when cached
Configurable pooling for distillation
Configurable embedding data types

Full Release Notes

## What's Changed
* add support for passing weight to the loss functions by @volker48 in https://github.com/MinishLab/model2vec/pull/260
* fix: padding token not recognized, update transformers by @stephantul in https://github.com/MinishLab/model2vec/pull/265
* Fix tag train documentation by @Lhemamou in https://github.com/MinishLab/model2vec/pull/269
* chore: Added python 3.13 to pyproject and CI by @Pringled in https://github.com/MinishLab/model2vec/pull/270
* feat: add classifier freezing by @stephantul in https://github.com/MinishLab/model2vec/pull/274
* fix: remove windows tests by @stephantul in https://github.com/MinishLab/model2vec/pull/277
* feat: add configurable pad token by @stephantul in https://github.com/MinishLab/model2vec/pull/276
* feat: faster loading if model already cached by @stephantul in https://github.com/MinishLab/model2vec/pull/278
* feat: add vocabulary quantization by @stephantul in https://github.com/MinishLab/model2vec/pull/271
* fix: load faster, make quantization better by @stephantul in https://github.com/MinishLab/model2vec/pull/279
* fix: F rule, A rule, update ruff by @stephantul in https://github.com/MinishLab/model2vec/pull/281
* feat: Added embedding_dtype and vocabulary_quantization to config by @Pringled in https://github.com/MinishLab/model2vec/pull/280
* fix: Disable MPS for Torch versions >=2.8.0 by @Pringled in https://github.com/MinishLab/model2vec/pull/287
* feat: Add configurable pooling for distillation by @Pringled in https://github.com/MinishLab/model2vec/pull/288
* chore: Deprecate apply_zipf and use_subword parameters by @Pringled in https://github.com/MinishLab/model2vec/pull/289
* chore: Rename PoolingType to PoolingMode by @Pringled in https://github.com/MinishLab/model2vec/pull/290
* docs: Update main docs by @Pringled in https://github.com/MinishLab/model2vec/pull/291
* chore: Bump version by @Pringled in https://github.com/MinishLab/model2vec/pull/292

## New Contributors
* @volker48 made their first contribution in https://github.com/MinishLab/model2vec/pull/260
* @Lhemamou made their first contribution in https://github.com/MinishLab/model2vec/pull/269

## Deprecation warnings ⚠️ 
* `apply_zipf` and `use_subword` are now officially deprecated from distill

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.6.0...v0.7.0