Starstruk Logo MarkStarstruk

v0.7.0

caddyserver/caddyv0.7.0Oct 5, 2025by Pringled

AI Summary

This release focuses on performance enhancements and configuration flexibility, introducing vocabulary quantization, configurable padding tokens, and support for Python 3.13. It also adds configurable pooling for distillation while deprecating legacy parameters.

Key Highlights

  • Added configurable padding token support
  • Introduced vocabulary quantization for faster model loading
  • Added configurable pooling for distillation
  • Deprecated `apply_zipf` and `use_subword` parameters
  • Disabled MPS for Torch versions >= 2.8.0

New Features

  • Configurable padding token
  • Faster loading if model is already cached
  • Vocabulary quantization
  • Added embedding_dtype and vocabulary_quantization to config
  • Configurable pooling for distillation

Full Release Notes

## What's Changed
* add support for passing weight to the loss functions by @volker48 in https://github.com/MinishLab/model2vec/pull/260
* fix: padding token not recognized, update transformers by @stephantul in https://github.com/MinishLab/model2vec/pull/265
* Fix tag train documentation by @Lhemamou in https://github.com/MinishLab/model2vec/pull/269
* chore: Added python 3.13 to pyproject and CI by @Pringled in https://github.com/MinishLab/model2vec/pull/270
* feat: add classifier freezing by @stephantul in https://github.com/MinishLab/model2vec/pull/274
* fix: remove windows tests by @stephantul in https://github.com/MinishLab/model2vec/pull/277
* feat: add configurable pad token by @stephantul in https://github.com/MinishLab/model2vec/pull/276
* feat: faster loading if model already cached by @stephantul in https://github.com/MinishLab/model2vec/pull/278
* feat: add vocabulary quantization by @stephantul in https://github.com/MinishLab/model2vec/pull/271
* fix: load faster, make quantization better by @stephantul in https://github.com/MinishLab/model2vec/pull/279
* fix: F rule, A rule, update ruff by @stephantul in https://github.com/MinishLab/model2vec/pull/281
* feat: Added embedding_dtype and vocabulary_quantization to config by @Pringled in https://github.com/MinishLab/model2vec/pull/280
* fix: Disable MPS for Torch versions >=2.8.0 by @Pringled in https://github.com/MinishLab/model2vec/pull/287
* feat: Add configurable pooling for distillation by @Pringled in https://github.com/MinishLab/model2vec/pull/288
* chore: Deprecate apply_zipf and use_subword parameters by @Pringled in https://github.com/MinishLab/model2vec/pull/289
* chore: Rename PoolingType to PoolingMode by @Pringled in https://github.com/MinishLab/model2vec/pull/290
* docs: Update main docs by @Pringled in https://github.com/MinishLab/model2vec/pull/291
* chore: Bump version by @Pringled in https://github.com/MinishLab/model2vec/pull/292

## New Contributors
* @volker48 made their first contribution in https://github.com/MinishLab/model2vec/pull/260
* @Lhemamou made their first contribution in https://github.com/MinishLab/model2vec/pull/269

## Deprecation warnings ⚠️ 
* `apply_zipf` and `use_subword` are now officially deprecated from distill

**Full Changelog**: https://github.com/MinishLab/model2vec/compare/v0.6.0...v0.7.0