b9817

ggml-org/llama.cppb9817Jun 26, 2026by github-actions[bot]same day as b9816

What changed since b9816

medium risk

OpenVINO backend refresh: OV 2026.2.1, self-contained packages, new ops and dropped hardcoded compute types.

Breaking changes

  • OpenVINO backend no longer uses hardcoded compute_op_type sets, so op-to-device/type assignment may differ from b9816 and could change performance or numerics for existing OV deployments.

New features

  • Added the glu_swiglu_oai operator to the OpenVINO backend, enabling models that rely on SwiGLU-style gated activations.
  • OpenVINO softmax now accepts a sink input, broadening attention/masking patterns the backend can offload.
  • add_id in the OpenVINO backend now handles both 2D and 4D tensors.
  • OpenVINO release packages are now self-contained, bundling what was previously an external runtime dependency.

Improvements

  • Bumped the OpenVINO dependency to 2026.2.1.
  • Optimized the mul_mat_id conversion path for large tensor sizes in the OpenVINO backend.
  • Cleaned up OpenVINO build/packaging paths for consistency across release artifacts.

Bug fixes

  • Reverted an over-eager removal of get_op_type so op-type resolution still works after the compute_op_type cleanup.

Upgrade notes

This release is almost entirely OpenVINO-backend scoped; CPU, CUDA, Metal, Vulkan and ROCm users see no functional delta from b9816. OpenVINO users should re-run accuracy and throughput checks, since dropping hardcoded compute op types can shift how ops are assigned, and should switch to the new self-contained packages rather than pairing binaries with an older external OV runtime.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Major update to the OpenVINO backend including version upgrade to 2026.2.1, removal of hardcoded compute types, and new operator support like GLU SwiGLU OAI.

Key Highlights

  • Update to OpenVINO 2026.2.1
  • Self-contained release packages
  • Removal of hardcoded compute op types
  • New softmax support with sink input
  • New GLU SwiGLU OAI operator

Release Notes (excerpt)

<details open> openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (#24974) * Update to OV 2026.2.1, Make OV release packages self-contained * Update to OV 2026.2.1, Make OV release packages self-contained * OpenVINO Backend: Remove compute_op_type hardcoded sets (#222) * OpenVINO Backend: Remove compute_op_type hardcoded sets * revert get_op_type removal * OpenVINO backend: enable softmax with sink input…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories