Starstruk Logo MarkStarstruk

v0.1.12

EricLBuehler/mistral.rsv0.1.12May 31, 2024by EricLBuehler

AI Summary

Added a new example, fixed local loading authentication issues, and refactored GGUF/GGML loaders.

Key Highlights

  • New example added
  • Fix for local loading authentication
  • Refactor GGUF/GGML loaders with ModelKind
  • Disable cublaslt if using f16 kernels

New Features

  • New example
  • Local loading authentication fix

Full Release Notes

## What's Changed
* Add an example by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/357
* Fix no auth token for local loading by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/360
* fix: Ensure committed files are normalized to LF by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/361
* Fix unauth check by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/362
* Allow default unigram unk token for GGUF by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/363
* Disable cublaslt if using f16 kernels by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/359
* refactor: GGUF + GGML Loaders with `ModelKind` by @polarathene in https://github.com/EricLBuehler/mistral.rs/pull/356
* Clamp n device layers to n model layers by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/367
* Bump version to 0.1.12 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/368


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.11...v0.1.12