@magnitudedev/cli@0.2.1

rust-lang/rustlings@magnitudedev/cli@0.2.1Sep 30, 2026by github-actions[bot]

Upgrading?

AI Summary

A patch release addressing concurrency issues and speculative decoding problems. The update improves request handling when multiple requests arrive simultaneously.

Key Highlights

  • Fixed local model hanging when multiple requests arrive
  • Improved admission control for concurrent requests
  • Fixed speculative decoding failures in long prompts
  • Better resource management for CPU cores

New Features

  • Concurrency fixes for Qwen3.6 35B-A3B models
  • Improved request queuing and handling
  • Better speculative decoding reliability

Full Release Notes

## 0.2.1

### Patch Changes

- [`0476b71`](https://github.com/magnitudedev/magnitude/commit/0476b71a0fb772245328529312a3392d77b630aa) Thanks [@anerli](https://github.com/anerli)! - - Fix the local model hanging forever when a request arrived while another was generating, as with Qwen3.6 35B-A3B: every later request waited without a response while the model still reported Ready, and the engine held a CPU core at 100%. Admission no longer waits on the running generation, and the engine can no longer wait on work only it could release.
  - Fix speculative-decoding models failing mid-request with "only a blocked last page is relocated" during long prompts.

Related Repositories