v0.1.9
EricLBuehler/mistral.rsv0.1.9May 18, 2024by EricLBuehler
AI Summary
Improved chat templates documentation and utilized cuBLASlt for faster attention computations.
Key Highlights
- Use cuBLASlt in attention
- Improve chat templates docs
New Features
- cuBLASlt in attention
Full Release Notes
## What's Changed * Improve chat templates docs by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/327 * Use cuBLASlt in attention by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/325 **Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.8...v0.1.9