v3.4.0 @magnitudedev/cli@0.2.8
low risk
magnitudedev/magnitudeOct 12, 2026 → Oct 12, 20260 days between releases
What's New
Adds streaming for embedding tables and fixes AMD GPU stability issues
New Features
- Streaming embedding tables to reduce memory footprint
- CPU fallback for incompatible integrated GPUs
- Faster Gemma decoding via assistant model pairing
Improvements
- Stop decoding zstd requests exceeding 128 MB to prevent memory expansion
- Optimized Gemma 4 generation speed using assistant models
Bug Fixes
- Fixed 'sampling distribution is nonfinite' errors on M1 Max/Ultra Macs
- Fixed AMD GPU crashes and long prompt handling on 8 GB GPUs
Upgrade Notes
No configuration changes are required. The update optimizes memory usage and GPU stability automatically.
The Two Releases
v3.4.0
v3.4.0
Oct 12, 2026· 10 days ago
This release enhances store compatibility by adding read-only evidence and fixing error handling in compatibility probes, specifically supporting WAL-mode headers.
Full release notes@magnitudedev/cli@0.2.8
@magnitudedev/cli@0.2.8
Oct 12, 2026· 9 days ago
This patch release optimizes memory usage and fixes critical stability issues for Mac and AMD GPU environments. It implements streaming for embedding tables and adds CPU fallback for unsupported integrated GPUs.
Full release notes