Starstruk Logo MarkStarstruk

v0.1.11

EricLBuehler/mistral.rsv0.1.11May 28, 2024by EricLBuehler

AI Summary

Refactored the ModelKind structure using strum and added verbose mode and GGUF tokenizer support.

Key Highlights

  • Refactor ModelKind with strum
  • Verbose mode added
  • Support for using GGUF tokenizer
  • Set device to CPU if loading isq

New Features

  • Verbose mode
  • GGUF tokenizer support

Full Release Notes

## What's Changed
* refactor: `ModelKind` with `strum` + `derive_more` by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/335
* Update dependencies by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/343
* Set device to cpu if loading isq by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/346
* Expose some APIs on the Rust side by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/348
* Propogating Regex init error by @gregszumel in https://github.com/EricLBuehler/mistral.rs/pull/349
* Add a verbose mode by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/353
* Refactor `deserialize_chat_template` by @Jeadie in https://github.com/EricLBuehler/mistral.rs/pull/354
* Add support for using GGUF tokenizer by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/345

## New Contributors
* @gregszumel made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/349

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.10...v0.1.11