b9890
ggml-org/llama.cppb9890Jul 6, 2026by github-actions[bot]same day as b9888
What changed since b9888
CUDA backend refactor removes the `-sm row` option and reworks cuBLAS, with CDNA/BF16 and stride fixes.
Breaking changes
- The `-sm row` CUDA option has been removed, so any scripts or configs passing it will fail or be rejected.
Improvements
- cuBLAS path in the CUDA backend was refactored for cleaner and more consistent behavior.
- CDNA + BF16 logic was corrected, improving AMD GPU compatibility.
- src0 stride and contiguity requirements were fixed, tightening memory handling correctness.
- GGML_CUDA_FORCE_CUBLAS and BF16 cast handling were corrected as part of the refactor.
Bug fixes
- Fixed bad return paths introduced during the CUDA refactor.
- Fixed incorrect BF16 casts on CDNA hardware.
Upgrade notes
Drop any use of `-sm row` from CUDA launch commands or wrapper scripts before upgrading, since the option no longer exists. AMD CDNA users relying on BF16 should re-validate outputs after the logic fix. No config migration is otherwise required.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
A significant refactoring of the CUDA backend removes the `-sm row` option and reworks the cuBLAS implementation. This includes fixes for AMD CDNA compatibility with BF16 and corrections to memory stride handling.
Key Highlights
- Remove -sm row option from CUDA
- Refactor cuBLAS implementation
- Fix CDNA + BF16 logic
- Fix src0 strides and contiguous requirements
Release Notes (excerpt)
<details open> CUDA: remove -sm row, refactor cuBLAS (#24216) * CUDA: remove -sm row, refactor cuBLAS * fix CDNA + BF16 logic * fix bad return * fix src0 strides, contiguous requirements * fix GGML_CUDA_FORCE_CUBLAS * fix casts to BF16 </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system