v0.7.0

teamhanko/hankov0.7.0Oct 5, 2025by Pringled

AI Summary

A significant update introducing model quantization features, performance improvements, and deprecating older configuration parameters.

Key Highlights

Added support for passing weights to loss functions
Introduced vocabulary quantization and faster loading
Deprecated apply_zipf and use_subword parameters
Added Python 3.13 support

New Features

Weight parameter for loss functions
Classifier freezing feature
Configurable pad token
Vocabulary quantization
Embedding dtype configuration
Configurable pooling for distillation
Python 3.13 support

Full Release Notes

## What's Changed
* add support for passing weight to the loss functions by @volker48 in https://github.com/MinishLab/model2vec/pull/260
* fix: padding token not recognized, update transformers by @stephantul in https://github.com/MinishLab/model2vec/pull/265
* Fix tag train documentation by @Lhemamou in https://github.com/MinishLab/model2vec/pull/269
* chore: Added python 3.13 to pyproject and CI by @Pringled in https://github.com/MinishLab/model2vec/pull/270
* feat: add classifier freezing by @stephantul in https://github.com/MinishLab/model2vec/pull/274
* fix: remove windows tests by @stephantul in https://github.com/MinishLab/model2vec/pull/277
* feat: add configurable pad token by @stephantul in https://github.com/MinishLab/model2vec/pull/276
* feat: faster loading if model already cached by @stephantul in https://github.com/MinishLab/model2vec/pull/278
* feat: add vocabulary quantization by @stephantul in https://github.com/MinishLab/model2vec/pull/271
* fix: load faster, make quantization better by @stephantul in https://github.com/MinishLab/model2vec/pull/279
* fix: F rule, A rule, update ruff by @stephantul in https://github.com/MinishLab/model2vec/pull/281
* feat: Added embedding_dtype and vocabulary_quantization to config by @Pringled in https://github.com/MinishLab/model2vec/pull/280
* fix: Disable MPS for Torch versions >=2.8.0 by @Pringled in https://github.com/MinishLab/model2vec/pull/287
* feat: Add configurable pooling for distillation by @Pringled in https://github.com/MinishLab/model2vec/pull/288
* chore: Deprecate apply_zipf and use_subword parameters by @Pringled in https://github.com/MinishLab/model2vec/pull/289
* chore: Rename PoolingType to PoolingMode by @Pringled in https://github.com/MinishLab/model2vec/pull/290
* docs: Update main docs by @Pringled in https://github.com/MinishLab/model2vec/pull/291
* chore: Bump version by @Pringled in https://github.com/MinishLab/model2vec/pull/292

## New Contributors
* @volker48 made their first contribution in https://github.com/MinishLab/model2vec/pull/260
* @Lhemamou made their first contribution in https://github.com/MinishLab/model2vec/pull/269

## Deprecation warnings ⚠️ 
* `apply_zipf` and `use_subword` are now officially deprecated from distill

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.6.0...v0.7.0