v0.1.10

EricLBuehler/mistral.rsv0.1.10May 22, 2024by EricLBuehler

AI Summary

Refactored layers.rs and removed the candle-layer-norm dependency while fixing KV cache issues.

Key Highlights

Refactor layers.rs
Remove candle-layer-norm dependency
Fix mistral model repeat KV

Full Release Notes

## What's Changed
* Fixes and verbosity improvements for device mapping by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/332
* chore: `SimpleModelPaths` should be renamed to `LocalModelPaths` by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/331
* Remove candle-layer-norm dep by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/333
* Refactor layers.rs by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/338
* chore: Simplify `utils/token.rs:get_token()` by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/328
* chore: Use `strum` to simplify `GGUFArchitecture` maintenance by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/334
* Fix mistral model repeat kv by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/340

## New Contributors
* @polarathene made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/331

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.9...v0.1.10