Starstruk Logo MarkStarstruk

v0.1.5

EricLBuehler/mistral.rsv0.1.5May 9, 2024by EricLBuehler

AI Summary

A maintenance-focused release that introduces the quantized Phi 3 model and improves build compatibility and benchmarking capabilities.

Key Highlights

  • Addition of the quantized Phi 3 model.
  • PyO3 build compatibility improvements for extension modules.
  • Fix for short parameter conflict in LoRA.
  • Warmup pass for benchmarking.

New Features

  • Quantized Phi 3 model
  • PyO3 extension module compatibility

Full Release Notes

## What's Changed
* Warmup pass for mistralrs-bench by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/270
* Fix short param conflict for LoRA by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/271
* Add build.rs to PyO3 to improve compat when extension_module by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/274
* Add the quantized phi3 model by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/276


**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.4...v0.1.5