b9929
ggml-org/llama.cppb9929Jul 8, 2026by github-actions[bot]same day as b9928
What changed since b9928
b9929 adds a Vulkan submission-threshold tweak for small AMD GPUs and refreshes platform binaries; no Hexagon changes carried over.
New features
- Vulkan backend now lowers the submission threshold on small AMD GPUs based on compute unit count.
Improvements
- Better Vulkan command submission behavior on low-CU AMD hardware, reducing overhead per batch.
- KleidiAI is disabled on macOS and openEuler builds to work around build failures.
- Standard multi-platform binary matrix refreshed, including CUDA 12/13, ROCm 7.2, Vulkan, and OpenVINO builds.
Upgrade notes
This is a small incremental build; no config or model changes are required. Users on small AMD GPUs with the Vulkan backend should see modest submission-overhead gains, while macOS/openEuler users lose KleidiAI acceleration in prebuilt binaries. The Hexagon VTCM/pipeline work from b9928 is unchanged here.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
Focuses on Vulkan optimizations for small AMD GPUs and includes the usual comprehensive binary builds for macOS, Linux, Windows, and Android.
Key Highlights
- Reduced Vulkan submission threshold for small AMD GPUs based on CU count
- Comprehensive platform binaries including macOS, Linux, Windows (CUDA 12/13), and Android
- Disabled KleidiAI on macOS and openEuler due to build issues
Release Notes (excerpt)
<details open> vulkan: for small AMD GPUs, reduce submission threshold based on CU count (#25240) </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (ROCm 7.2) - Ubuntu x64 (OpenVINO) - Ubuntu x64 (SYCL FP32) - Ubuntu x64 (SYCL FP16) **Android:**…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system