@magnitudedev/cli@0.2.1
atlasia-ma/MoulSot@magnitudedev/cli@0.2.1Sep 30, 2026by github-actions[bot]
Upgrading?
AI Summary
Resolves a deadlock issue where the local model would hang indefinitely when handling concurrent requests, and fixes failures in speculative decoding during long prompts.
Key Highlights
- Fixes local model hanging on concurrent requests
- Fixes speculative-decoding failures during long prompts
Full Release Notes
## 0.2.1 ### Patch Changes - [`0476b71`](https://github.com/magnitudedev/magnitude/commit/0476b71a0fb772245328529312a3392d77b630aa) Thanks [@anerli](https://github.com/anerli)! - - Fix the local model hanging forever when a request arrived while another was generating, as with Qwen3.6 35B-A3B: every later request waited without a response while the model still reported Ready, and the engine held a CPU core at 100%. Admission no longer waits on the running generation, and the engine can no longer wait on work only it could release. - Fix speculative-decoding models failing mid-request with "only a blocked last page is relocated" during long prompts.
Related Repositories
rasbt/LLMs-from-scratch★ 107,095
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
lyogavin/airllm★ 40,274
AirLLM 2.8T LLM inference with single 4GB GPU
NirDiamant/RAG_Techniques★ 29,967
This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.
microsoft/OmniParser★ 25,540
A simple screen parsing tool towards pure vision based GUI agent
karpathy/nn-zero-to-hero★ 24,911
Neural Networks: Zero to Hero