b10419

ggml-org/llama.cppb10419Aug 13, 2026by github-actions[bot]same day as b10418

What changed since b10418

medium risk

OpenVINO backend updated with Qwen3.5 support and memory optimizations.

Breaking changes

  • Removal of EXP with FP32 support in OpenVINO backend

New features

  • Qwen3.5 support (dense and MoE) in OpenVINO backend
  • Stream weight requantization to reduce compile-time peaks
  • Expanded OpenVINO operator support (FILL, UNARY_OP_SIGMOID, SQR, SQRT)
  • Reclaim host weight RSS on GPU

Improvements

  • Significant memory optimization reducing compile-time peaks by up to 2GB
  • Improved OpenVINO backend stability with unique node naming
  • Enhanced fallback mechanism to CPU backend for unsupported operations

Bug fixes

  • Fixed accuracy issues in NeoX RoPE and gemma3n architecture tests
  • Fixed mpt failed case
  • Fixed CPY and GATED_DELTA_NET op test failures
  • Fixed qwen35 9b gq quantization
  • Fixed EXP with FP32 overflow issues in backend tests

Upgrade notes

No specific configuration changes are required. The OpenVINO backend now supports Qwen3.5 models and includes improved memory management. Existing configurations should work without modification.

Analyzed Oct 16, 2026

Upgrading?

Release notes summary

A major update to the OpenVINO backend featuring Qwen3.5 support, significant memory optimizations to reduce compile-time peaks, and expanded operator support.

Key Highlights

  • Enable Qwen3.5 support (dense and MoE) in OpenVINO backend
  • Memory optimization: Stream weight requantization (up to 2GB peak reduction)
  • Enable various ops including FILL, UNARY_OP_SIGMOID, SQR, SQRT
  • Fix accuracy issues in NeoX RoPE and other architecture tests

Release Notes (excerpt)

<details open> OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952) * OpenVINO backend: 1) enable gpt-oss moe on OV bk; 2) enable mxfp4 support * OpenVINO backend: disable TOPK_MOE op test * OpenVINO Backend: Add op FILL support * OpenVINO backend: enable set rows with multi dims * fix the name missmatch in setrow + view * OpenVINO backend: enable op GGML_UNARY_OP_SIGMOID * OpenVINO Backend: enable SQR & SQRT…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories