b10057
ggml-org/llama.cppb10057Jul 17, 2026by github-actions[bot]same day as b10056
What changed since b10056
SYCL backend correctness fixes for quantization row math and Q5_K kernels; no API changes from b10056.
Improvements
- SYCL non-reordered Q5_K kernel now derives its iteration count from K_QUANTS_PER_ITERATION for consistency with other kernels.
- Added a missing row > nrows bounds check in the SYCL path to harden against out-of-range access.
Bug fixes
- Corrected incorrect row calculation in the SYCL backend when K_QUANTS_PER_ITERATION equals 1.
- Restored the missing second-half processing in the reordered Q5_K SYCL kernel, which surfaced as MUL_MAT failures in test-backend-ops.
- Fixed a potential off-by-one error in SYCL row indexing.
Upgrade notes
This is a drop-in patch over b10056 with no config or API changes; only SYCL users are affected. If you run SYCL builds with quantized models (especially Q5_K), upgrading is recommended since prior binaries could produce wrong results. The OpenCL ABS op from b10056 remains included.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Fixes critical bugs in the SYCL backend related to quantization row calculations and Q5_K kernel processing.
Key Highlights
- Fixed incorrect row calculation when K_QUANTS_PER_ITERATION is 1
- Fixed Q5_K kernel processing issues
- Resolved potential off-by-one errors and missing checks
New Features
- SYCL backend bug fixes
Release Notes (excerpt)
<details open> sycl: fix row calculation when K_QUANTS_PER_ITERATION is 1 (#25690) * sycl: fix incorrect row calculation when K_QUANTS_PER_ITERATION=1 Signed-off-by: Todd Malsbary <todd.malsbary@intel.com> * sycl: use K_QUANTS_PER_ITERATION for non-reordered Q5_K kernel This is the only Q5_K kernel that was not using KQPI. Signed-off-by: Todd Malsbary <todd.malsbary@intel.com> * sycl: add missing second half processing to reordered q5_k Error found while running…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system