v0.1.16
EricLBuehler/mistral.rsv0.1.16Jun 8, 2024by EricLBuehler
AI Summary
This release introduces the Phi 3 vision model and features significant refactoring work by @polarathene, including improvements to Metal loading and logging.
Key Highlights
- Introduction of Phi 3 vision model support
- Refactoring of GGUF metadata tokenizer
- Fused bias linear layer with cublaslt
- Fix for Metal loading issues
New Features
- Phi 3 vision model
- Fused bias linear layer
Full Release Notes
## Summary - Various fixes - Excellent work on refactoring by @polarathene - First vision model: Phi 3 vision ## What's Changed * Implement the Phi 3 vision model by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/351 * Bump version again to 0.1.15 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/390 * Add docs for installing huggingface-cli by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/391 * Fix metal loading issue by loading sequentially by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/394 * Fix logging in gguf and ggml by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/399 * Add fused bias linear layer with cublaslt by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/400 * docs: Resolve CI lints on docs by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/401 * Refactor: GGUF metadata tokenizer by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/389 * Add `Nonzero` layer by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/402 * Bump version to 0.1.16 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/404 **Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.15...v0.1.16