b10040
ggml-org/llama.cppb10040Jul 16, 2026by github-actions[bot]same day as b10038
What changed since b10038
b10040 restores the HIP integrated-device flag so ROCm APUs can use host buffers again, while keeping the CUDA/Jetson workaround.
Improvements
- The Jetson Orin workaround that forces the integrated flag to false is now scoped to CUDA-only builds instead of all CUDA/HIP devices.
- HIP builds now report the real hipDeviceProp_t.integrated value, making device-type reporting consistent with buffer-support checks.
Bug fixes
- Fixed an inconsistency where supports_buft() rejected CUDA host buffers on AMD APU/UMA parts because the cached integrated flag was hardcoded to false.
- Restored integrated-GPU host-buffer usage on ROCm, resolving the regression tracked in issue #23977.
Upgrade notes
Only ROCm/HIP deployments on AMD APU or unified-memory parts are affected; rebuild or pull the b10040 ROCm binaries to regain host-buffer support. CUDA users, including Jetson Orin, see no behavioral change since the workaround remains active there. No config or API changes are required.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Fixes a bug in CUDA/HIP integration detection where the integrated flag was incorrectly set to false, preventing host buffer usage on AMD APU parts.
Key Highlights
- Restore `prop.integrated` on HIP builds
- Fixes host buffer usage on AMD APU/UMA parts
- Keeps Jetson workaround intact for CUDA
New Features
- HIP integration fix
Release Notes (excerpt)
<details open> ggml-cuda : restore prop.integrated on HIP builds (#24233) PR #16308 set info.devices[id].integrated = false unconditionally for all CUDA/HIP devices as a workaround for corrupted output on Jetson Orin (#15034). On HIP/ROCm the device's real hipDeviceProp_t.integrated flag is needed: with the cached field forced to false, supports_buft() refuses CUDA host buffers on AMD APU/UMA parts, while get_type() already reads…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system