Starstruk Logo MarkStarstruk

v0.1.0

MinishLab/model2vecv0.1.0Sep 20, 2024by stephantul

AI Summary

This is the initial public release of the model2vec project, establishing the foundational codebase, benchmarks, and documentation.

Key Highlights

  • Initial project setup and codebase establishment by Pringled
  • Addition of phrase benchmarks and multi-word tokenizer support
  • Integration of push-to-hub functionality for model sharing
  • Codebase refactoring, dependency management updates, and performance optimizations
  • Comprehensive documentation and testing suite

Breaking Changes

  • Removed 'tokens' tokenizer in favor of the multi-word tokenizer

New Features

  • Phrase benchmarks
  • Multi-word tokenizer
  • Push to Hub functionality
  • Automated build system (Makefile)
  • Project documentation
  • Unit tests

Full Release Notes

## What's Changed
* Initial commit by @Pringled in https://github.com/MinishLab/model2vec/pull/1
* Add phrase benchmarks by @stephantul in https://github.com/MinishLab/model2vec/pull/2
* Add multi word tokenizer by @stephantul in https://github.com/MinishLab/model2vec/pull/3
* Aligned code with template by @Pringled in https://github.com/MinishLab/model2vec/pull/4
* Add new makefile by @stephantul in https://github.com/MinishLab/model2vec/pull/5
* Refactored codebase by @Pringled in https://github.com/MinishLab/model2vec/pull/6
* Gone reach by @stephantul in https://github.com/MinishLab/model2vec/pull/7
* separate dependency, remove requirements.txt, add base makefile option by @stephantul in https://github.com/MinishLab/model2vec/pull/8
* Add lots of stuff by @stephantul in https://github.com/MinishLab/model2vec/pull/9
* fix issue with tokens by @stephantul in https://github.com/MinishLab/model2vec/pull/10
* Add tests by @Pringled in https://github.com/MinishLab/model2vec/pull/11
* Remove tokens tokenizer by @stephantul in https://github.com/MinishLab/model2vec/pull/12
* make it faster by @stephantul in https://github.com/MinishLab/model2vec/pull/13
* add push_to_hub functionality by @stephantul in https://github.com/MinishLab/model2vec/pull/14
* Add docs by @Pringled in https://github.com/MinishLab/model2vec/pull/15
* docs: Added model list by @Pringled in https://github.com/MinishLab/model2vec/pull/16
* New image by @stephantul in https://github.com/MinishLab/model2vec/pull/17

## New Contributors
* @Pringled made their first contribution in https://github.com/MinishLab/model2vec/pull/1
* @stephantul made their first contribution in https://github.com/MinishLab/model2vec/pull/2

**Full Changelog**: https://github.com/MinishLab/model2vec/commits/v0.1.0