b9817
ggml-org/llama.cppb9817Jun 26, 2026by github-actions[bot]same day as b9816
What changed since b9816
OpenVINO backend refresh: OV 2026.2.1, self-contained packages, new ops and dropped hardcoded compute types.
Breaking changes
- OpenVINO backend no longer uses hardcoded compute_op_type sets, so op-to-device/type assignment may differ from b9816 and could change performance or numerics for existing OV deployments.
New features
- Added the glu_swiglu_oai operator to the OpenVINO backend, enabling models that rely on SwiGLU-style gated activations.
- OpenVINO softmax now accepts a sink input, broadening attention/masking patterns the backend can offload.
- add_id in the OpenVINO backend now handles both 2D and 4D tensors.
- OpenVINO release packages are now self-contained, bundling what was previously an external runtime dependency.
Improvements
- Bumped the OpenVINO dependency to 2026.2.1.
- Optimized the mul_mat_id conversion path for large tensor sizes in the OpenVINO backend.
- Cleaned up OpenVINO build/packaging paths for consistency across release artifacts.
Bug fixes
- Reverted an over-eager removal of get_op_type so op-type resolution still works after the compute_op_type cleanup.
Upgrade notes
This release is almost entirely OpenVINO-backend scoped; CPU, CUDA, Metal, Vulkan and ROCm users see no functional delta from b9816. OpenVINO users should re-run accuracy and throughput checks, since dropping hardcoded compute op types can shift how ops are assigned, and should switch to the new self-contained packages rather than pairing binaries with an older external OV runtime.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Major update to the OpenVINO backend including version upgrade to 2026.2.1, removal of hardcoded compute types, and new operator support like GLU SwiGLU OAI.
Key Highlights
- Update to OpenVINO 2026.2.1
- Self-contained release packages
- Removal of hardcoded compute op types
- New softmax support with sink input
- New GLU SwiGLU OAI operator
Release Notes (excerpt)
<details open> openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (#24974) * Update to OV 2026.2.1, Make OV release packages self-contained * Update to OV 2026.2.1, Make OV release packages self-contained * OpenVINO Backend: Remove compute_op_type hardcoded sets (#222) * OpenVINO Backend: Remove compute_op_type hardcoded sets * revert get_op_type removal * OpenVINO backend: enable softmax with sink input…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system