v0.1.23

EricLBuehler/mistral.rsv0.1.23Jun 29, 2024by EricLBuehler

AI Summary

Introduced the Gemma 2 model, improved decoding performance, and updated documentation and dependencies.

Key Highlights

Added the Gemma 2 model
Optimized decoding by removing redundant QKV transpose
Added progress bar and logging for loading repeating layers
Utilized new quantize_onto qtensor API

New Features

Gemma 2 model

Full Release Notes

## What's Changed
* Improve and update docs by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/477
* Progress bar and logging when loading repeating layers by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/479
* Update deps by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/483
* Optimize decoding by removing redundant qkv transpose by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/487
* Fixes and tweak docs, logging for local loading by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/489
* Add the Gemma 2 model by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/490
* Update demo video by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/491
* Utilize new quantize_onto qtensor api by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/492
* Update deps by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/493
* Bump version to 0.1.23 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/495


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.22...v0.1.23