v0.1.14

EricLBuehler/mistral.rsv0.1.14Jun 5, 2024by EricLBuehler

AI Summary

Improved documentation for local GGUF loading and fixed various tokenizer and message handling issues.

Key Highlights

  • Support for multiple GGUF files
  • Improved docs for local GGUF loading
  • Fix for tokenizer write on read-only file system

New Features

  • Multiple GGUF file support

Full Release Notes

## What's Changed
* Improve docs for loading `gguf` purely locally by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/371
* Fix message with chat template by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/374
* Fix tokenizer write on read only file system by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/373
* Manual subtyping for u32 in GGUF max seq len by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/376
* refactor: DRY `varbuilder_utils.rs` by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/364
* Support multiple GGUF files by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/379
* Organize normal loading metadata by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/381
* Bump version 0.1.13 -> 0.1.14 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/382


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.13...v0.1.14