v0.1.16

EricLBuehler/mistral.rsv0.1.16Jun 8, 2024by EricLBuehler

AI Summary

This release introduces the Phi 3 vision model and features significant refactoring work by @polarathene, including improvements to Metal loading and logging.

Key Highlights

  • Introduction of Phi 3 vision model support
  • Refactoring of GGUF metadata tokenizer
  • Fused bias linear layer with cublaslt
  • Fix for Metal loading issues

New Features

  • Phi 3 vision model
  • Fused bias linear layer

Full Release Notes

## Summary
- Various fixes
- Excellent work on refactoring by @polarathene 
- First vision model: Phi 3 vision

## What's Changed
* Implement the Phi 3 vision model by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/351
* Bump version again to 0.1.15 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/390
* Add docs for installing huggingface-cli by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/391
* Fix metal loading issue by loading sequentially by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/394
* Fix logging in gguf and ggml by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/399
* Add fused bias linear layer with cublaslt by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/400
* docs: Resolve CI lints on docs by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/401
* Refactor: GGUF metadata tokenizer by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/389
* Add `Nonzero` layer by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/402
* Bump version to 0.1.16 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/404


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.15...v0.1.16