@magnitudedev/cli@0.2.5

## 0.2.5

### Patch Changes

- [`32e095e`](https://github.com/magnitudedev/magnitude/commit/32e095e6561b2e58daaaf1438604a21d36ee827f) Thanks [@anerli](https://github.com/anerli)! - - Speed up generation for mixture-of-experts models with multi-token prediction by drafting three tokens ahead instead of one: Qwen3.6-35B-A3B now generates 106–138 tok/s on a GB10 (previously 97–105) and 109–138 tok/s on an M4 Pro (previously 103–111).

  - Speed up generation at a 16K context by about 8% on Macs (67.0 → 72.4 tok/s) and 11% on NVIDIA GPUs (66.3 → 73.4 tok/s), with the same output, by choosing each token while reading less of the output layer and doing more of each step in fewer GPU launches.
  - Speed up multi-token prediction on NVIDIA GPUs by loading each expert's weights once per step when several drafted tokens choose it, cutting verification time by up to 11%.

- [`32e095e`](https://github.com/magnitudedev/magnitude/commit/32e095e6561b2e58daaaf1438604a21d36ee827f) Thanks [@anerli](https://github.com/anerli)! - - Speed up prompt processing on M5 and later Macs about 2x by running matrix multiplies and attention on the GPU's tensor operations: Qwen3.5-4B at a 64K context now processes prompts at 649 tok/s (previously 308), cutting time to first token from 213 to 101 seconds, with identical output. Other Macs are unchanged.

- [`7aea836`](https://github.com/magnitudedev/magnitude/commit/7aea83653a5acf2035d6d3229efd5700ff684e8d) Thanks [@thrgreenwald](https://github.com/thrgreenwald)! - - Fix models failing to load on M1 and M2 Macs with "requests N threads per threadgroup; the pipeline allows M". Metal kernels are now built to accept the thread count they launch with, which fixes Qwen3.8 27B on M1 Max and similar errors in other kernels.

  - Fix models with 16 or more query heads per key (Gemma 4 12B, Muse Glimmer 30B, Nemotron 3.5 Lightning, Qwen3.5 122B, Nemotron 3 Super) failing on M1 and M2 Macs. Prefill attention now splits a key's query heads into groups, so it fits every Mac's thread limit, with no change in speed or output elsewhere.

- [`cffe46e`](https://github.com/magnitudedev/magnitude/commit/cffe46e77af5f45ce99565f096d545443dbbd3d0) Thanks [@thrgreenwald](https://github.com/thrgreenwald)! - - Fix removing a model that is running or loading failing with a misleading error. Removing it now stops the model first, and the confirmation says so.

- [`a3e5422`](https://github.com/magnitudedev/magnitude/commit/a3e542241b075567894881290aad2a5ed2f94aaf) Thanks [@anerli](https://github.com/anerli)! - - Fix models with DFlash2 speculative decoding (Qwen3.8 27B) and Nemotron models failing to load on Vulkan GPUs with a shader compilation error. Every GPU kernel is now compiled for Vulkan, CUDA and Metal before each release, including every kernel each catalog model loads.