v0.7.0

nextjs/saas-starterv0.7.0Oct 5, 2025by Pringled

AI Summary

This release focuses on performance optimizations including vocabulary quantization and faster model loading, alongside new configuration options for distillation and padding. It also includes updates to support Python 3.13 and renames internal pooling types.

Key Highlights

  • Added vocabulary quantization support
  • Improved model loading speed with caching
  • Added configurable pooling for distillation
  • Added support for Python 3.13
  • Deprecated apply_zipf and use_subword parameters

Breaking Changes

  • PoolingType has been renamed to PoolingMode

New Features

  • Add support for passing weight to loss functions
  • Add classifier freezing
  • Add configurable pad token
  • Faster loading if model already cached
  • Add vocabulary quantization
  • Added embedding_dtype to config
  • Add configurable pooling for distillation

Full Release Notes

## What's Changed
* add support for passing weight to the loss functions by @volker48 in https://github.com/MinishLab/model2vec/pull/260
* fix: padding token not recognized, update transformers by @stephantul in https://github.com/MinishLab/model2vec/pull/265
* Fix tag train documentation by @Lhemamou in https://github.com/MinishLab/model2vec/pull/269
* chore: Added python 3.13 to pyproject and CI by @Pringled in https://github.com/MinishLab/model2vec/pull/270
* feat: add classifier freezing by @stephantul in https://github.com/MinishLab/model2vec/pull/274
* fix: remove windows tests by @stephantul in https://github.com/MinishLab/model2vec/pull/277
* feat: add configurable pad token by @stephantul in https://github.com/MinishLab/model2vec/pull/276
* feat: faster loading if model already cached by @stephantul in https://github.com/MinishLab/model2vec/pull/278
* feat: add vocabulary quantization by @stephantul in https://github.com/MinishLab/model2vec/pull/271
* fix: load faster, make quantization better by @stephantul in https://github.com/MinishLab/model2vec/pull/279
* fix: F rule, A rule, update ruff by @stephantul in https://github.com/MinishLab/model2vec/pull/281
* feat: Added embedding_dtype and vocabulary_quantization to config by @Pringled in https://github.com/MinishLab/model2vec/pull/280
* fix: Disable MPS for Torch versions >=2.8.0 by @Pringled in https://github.com/MinishLab/model2vec/pull/287
* feat: Add configurable pooling for distillation by @Pringled in https://github.com/MinishLab/model2vec/pull/288
* chore: Deprecate apply_zipf and use_subword parameters by @Pringled in https://github.com/MinishLab/model2vec/pull/289
* chore: Rename PoolingType to PoolingMode by @Pringled in https://github.com/MinishLab/model2vec/pull/290
* docs: Update main docs by @Pringled in https://github.com/MinishLab/model2vec/pull/291
* chore: Bump version by @Pringled in https://github.com/MinishLab/model2vec/pull/292

## New Contributors
* @volker48 made their first contribution in https://github.com/MinishLab/model2vec/pull/260
* @Lhemamou made their first contribution in https://github.com/MinishLab/model2vec/pull/269

## Deprecation warnings ⚠️ 
* `apply_zipf` and `use_subword` are now officially deprecated from distill

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.6.0...v0.7.0