v0.1.14
EricLBuehler/mistral.rsv0.1.14Jun 5, 2024by EricLBuehler
AI Summary
Improved documentation for local GGUF loading and fixed various tokenizer and message handling issues.
Key Highlights
- Support for multiple GGUF files
- Improved docs for local GGUF loading
- Fix for tokenizer write on read-only file system
New Features
- Multiple GGUF file support
Full Release Notes
## What's Changed * Improve docs for loading `gguf` purely locally by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/371 * Fix message with chat template by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/374 * Fix tokenizer write on read only file system by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/373 * Manual subtyping for u32 in GGUF max seq len by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/376 * refactor: DRY `varbuilder_utils.rs` by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/364 * Support multiple GGUF files by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/379 * Organize normal loading metadata by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/381 * Bump version 0.1.13 -> 0.1.14 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/382 **Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.13...v0.1.14