b10353
ggml-org/llama.cppb10353Aug 10, 2026by github-actions[bot]same day as b10344
What changed since b10344
Adds a contiguity guard for ggml_roll on CUDA and Metal, fixing silent corruption with permuted tensors.
Improvements
- CUDA and Metal backends now declare a contiguity requirement for ROLL in supports_op, mirroring the existing GGML_OP_ROPE guard.
- Scheduler can now correctly fall back to the stride-aware CPU implementation instead of running a stride-ignoring GPU kernel.
- Test coverage extended with a permuted-input test_roll case to catch this class of regression.
Bug fixes
- Fixed silently incorrect ggml_roll results on CUDA and Metal when the source tensor was non-contiguous (e.g. permuted).
Upgrade notes
No config or API changes are required; just swap in the newer binaries. GPU users who previously ran ROLL on permuted tensors may see those ops fall back to CPU, which is a small performance trade-off for correct results. The Nemotron MTP work from the prior build is not mentioned in these notes, so treat it as unchanged rather than removed.
Analyzed Oct 29, 2026
Upgrading?
Release notes summary
Fixes a bug in the `ggml_roll` operation on CUDA and Metal backends. These backends were not validating tensor contiguity, leading to silent data corruption when permuted tensors were used.
Key Highlights
- Added contiguity requirement for ROLL operation on CUDA and Metal backends.
- Fixes silent data corruption on permuted tensors.
- Added `test_roll` case for permuted inputs.
Release Notes (excerpt)
<details open> ggml : require contiguous src for ROLL on CUDA and Metal (#25928) ggml_roll only asserts nb[0] == ggml_type_size, so a permuted src is a valid input, but the CUDA and Metal roll kernels index by ne alone and never read the nb strides. A non-contiguous src therefore produced silently wrong results. Neither backend declared a contiguity requirement in supports_op, so the scheduler did not fall back to the CPU implementation, which does handle strides correctly.…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system