b10057

ggml-org/llama.cppb10057Jul 17, 2026by github-actions[bot]same day as b10056

What changed since b10056

low risk

SYCL backend correctness fixes for quantization row math and Q5_K kernels; no API changes from b10056.

Improvements

  • SYCL non-reordered Q5_K kernel now derives its iteration count from K_QUANTS_PER_ITERATION for consistency with other kernels.
  • Added a missing row > nrows bounds check in the SYCL path to harden against out-of-range access.

Bug fixes

  • Corrected incorrect row calculation in the SYCL backend when K_QUANTS_PER_ITERATION equals 1.
  • Restored the missing second-half processing in the reordered Q5_K SYCL kernel, which surfaced as MUL_MAT failures in test-backend-ops.
  • Fixed a potential off-by-one error in SYCL row indexing.

Upgrade notes

This is a drop-in patch over b10056 with no config or API changes; only SYCL users are affected. If you run SYCL builds with quantized models (especially Q5_K), upgrading is recommended since prior binaries could produce wrong results. The OpenCL ABS op from b10056 remains included.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Fixes critical bugs in the SYCL backend related to quantization row calculations and Q5_K kernel processing.

Key Highlights

  • Fixed incorrect row calculation when K_QUANTS_PER_ITERATION is 1
  • Fixed Q5_K kernel processing issues
  • Resolved potential off-by-one errors and missing checks

New Features

  • SYCL backend bug fixes

Release Notes (excerpt)

<details open> sycl: fix row calculation when K_QUANTS_PER_ITERATION is 1 (#25690) * sycl: fix incorrect row calculation when K_QUANTS_PER_ITERATION=1 Signed-off-by: Todd Malsbary <todd.malsbary@intel.com> * sycl: use K_QUANTS_PER_ITERATION for non-reordered Q5_K kernel This is the only Q5_K kernel that was not using KQPI. Signed-off-by: Todd Malsbary <todd.malsbary@intel.com> * sycl: add missing second half processing to reordered q5_k Error found while running…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories