v0.2.2

EricLBuehler/mistral.rsv0.2.2Jul 24, 2024by github-actions[bot]

AI Summary

Fixes scheduler v2 Ctrl+C handling, makes Mixtral sliding window optional, and adds Llama 3.1 scaled rope support.

Key Highlights

Ctrl+C handling fix for scheduler v2
Optional sliding window for Mixtral
Llama 3.1 scaled rope support

New Features

Scheduler v2 Ctrl+C fix
Mixtral sliding window option
Llama 3.1 scaled rope

Full Release Notes

## What's Changed
* Fix ctrlc handling for scheduler v2 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/614
* Make `sliding_window` optional for mixtral by @csicar in https://github.com/EricLBuehler/mistral.rs/pull/616
* Support Llama 3.1 scaled rope by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/618

## New Contributors
* @csicar made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/616

**Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.2.1...v0.2.2

## MSRV

MSRV is `1.75`.

## Install mistralrs-server 0.2.2

### Install prebuilt binaries via shell script

```sh
curl --proto '=https' --tlsv1.2 -LsSf https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-installer.sh | sh
```

## Download mistralrs-server 0.2.2

|  File  | Platform | Checksum |
|--------|----------|----------|
| [mistralrs-server-aarch64-apple-darwin.tar.xz](https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-aarch64-apple-darwin.tar.xz) | Apple Silicon macOS | [checksum](https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-aarch64-apple-darwin.tar.xz.sha256) |
| [mistralrs-server-x86_64-apple-darwin.tar.xz](https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-x86_64-apple-darwin.tar.xz) | Intel macOS | [checksum](https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-x86_64-apple-darwin.tar.xz.sha256) |
| [mistralrs-server-x86_64-unknown-linux-gnu.tar.xz](https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-x86_64-unknown-linux-gnu.tar.xz) | x64 Linux | [checksum](https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.2/mistralrs-server-x86_64-unknown-linux-gnu.tar.xz.sha256) |