b10419
ggml-org/llama.cppb10419Aug 13, 2026by github-actions[bot]same day as b10418
What changed since b10418
OpenVINO backend updated with Qwen3.5 support and memory optimizations.
Breaking changes
- Removal of EXP with FP32 support in OpenVINO backend
New features
- Qwen3.5 support (dense and MoE) in OpenVINO backend
- Stream weight requantization to reduce compile-time peaks
- Expanded OpenVINO operator support (FILL, UNARY_OP_SIGMOID, SQR, SQRT)
- Reclaim host weight RSS on GPU
Improvements
- Significant memory optimization reducing compile-time peaks by up to 2GB
- Improved OpenVINO backend stability with unique node naming
- Enhanced fallback mechanism to CPU backend for unsupported operations
Bug fixes
- Fixed accuracy issues in NeoX RoPE and gemma3n architecture tests
- Fixed mpt failed case
- Fixed CPY and GATED_DELTA_NET op test failures
- Fixed qwen35 9b gq quantization
- Fixed EXP with FP32 overflow issues in backend tests
Upgrade notes
No specific configuration changes are required. The OpenVINO backend now supports Qwen3.5 models and includes improved memory management. Existing configurations should work without modification.
Analyzed Oct 16, 2026
Upgrading?
Release notes summary
A major update to the OpenVINO backend featuring Qwen3.5 support, significant memory optimizations to reduce compile-time peaks, and expanded operator support.
Key Highlights
- Enable Qwen3.5 support (dense and MoE) in OpenVINO backend
- Memory optimization: Stream weight requantization (up to 2GB peak reduction)
- Enable various ops including FILL, UNARY_OP_SIGMOID, SQR, SQRT
- Fix accuracy issues in NeoX RoPE and other architecture tests
Release Notes (excerpt)
<details open> OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952) * OpenVINO backend: 1) enable gpt-oss moe on OV bk; 2) enable mxfp4 support * OpenVINO backend: disable TOPK_MOE op test * OpenVINO Backend: Add op FILL support * OpenVINO backend: enable set rows with multi dims * fix the name missmatch in setrow + view * OpenVINO backend: enable op GGML_UNARY_OP_SIGMOID * OpenVINO Backend: enable SQR & SQRT…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system