Starstruk Logo MarkStarstruk

v0.7.0

MinishLab/model2vecv0.7.0Oct 5, 2025by Pringled

AI Summary

This release focuses on performance improvements including faster model loading, vocabulary quantization, and configurable padding tokens. It also introduces classifier freezing for fine-tuning scenarios and deprecates older parameters like apply_zipf and use_subword.

Key Highlights

  • Added configurable pad token support
  • Implemented vocabulary quantization for memory efficiency
  • Added classifier freezing capability
  • Faster model loading when cached
  • Added configurable pooling for distillation

Breaking Changes

  • Renamed PoolingType to PoolingMode
  • Deprecated apply_zipf and use_subword parameters

New Features

  • Weight support in loss functions
  • Configurable pad token
  • Vocabulary quantization
  • Classifier freezing
  • Faster model loading with caching
  • Configurable pooling for distillation
  • embedding_dtype configuration
  • vocabulary_quantization configuration

Full Release Notes

## What's Changed
* add support for passing weight to the loss functions by @volker48 in https://github.com/MinishLab/model2vec/pull/260
* fix: padding token not recognized, update transformers by @stephantul in https://github.com/MinishLab/model2vec/pull/265
* Fix tag train documentation by @Lhemamou in https://github.com/MinishLab/model2vec/pull/269
* chore: Added python 3.13 to pyproject and CI by @Pringled in https://github.com/MinishLab/model2vec/pull/270
* feat: add classifier freezing by @stephantul in https://github.com/MinishLab/model2vec/pull/274
* fix: remove windows tests by @stephantul in https://github.com/MinishLab/model2vec/pull/277
* feat: add configurable pad token by @stephantul in https://github.com/MinishLab/model2vec/pull/276
* feat: faster loading if model already cached by @stephantul in https://github.com/MinishLab/model2vec/pull/278
* feat: add vocabulary quantization by @stephantul in https://github.com/MinishLab/model2vec/pull/271
* fix: load faster, make quantization better by @stephantul in https://github.com/MinishLab/model2vec/pull/279
* fix: F rule, A rule, update ruff by @stephantul in https://github.com/MinishLab/model2vec/pull/281
* feat: Added embedding_dtype and vocabulary_quantization to config by @Pringled in https://github.com/MinishLab/model2vec/pull/280
* fix: Disable MPS for Torch versions >=2.8.0 by @Pringled in https://github.com/MinishLab/model2vec/pull/287
* feat: Add configurable pooling for distillation by @Pringled in https://github.com/MinishLab/model2vec/pull/288
* chore: Deprecate apply_zipf and use_subword parameters by @Pringled in https://github.com/MinishLab/model2vec/pull/289
* chore: Rename PoolingType to PoolingMode by @Pringled in https://github.com/MinishLab/model2vec/pull/290
* docs: Update main docs by @Pringled in https://github.com/MinishLab/model2vec/pull/291
* chore: Bump version by @Pringled in https://github.com/MinishLab/model2vec/pull/292

## New Contributors
* @volker48 made their first contribution in https://github.com/MinishLab/model2vec/pull/260
* @Lhemamou made their first contribution in https://github.com/MinishLab/model2vec/pull/269

## Deprecation warnings ⚠️ 
* `apply_zipf` and `use_subword` are now officially deprecated from distill

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.6.0...v0.7.0