b10040

ggml-org/llama.cppb10040Jul 16, 2026by github-actions[bot]same day as b10038

What changed since b10038

low risk

b10040 restores the HIP integrated-device flag so ROCm APUs can use host buffers again, while keeping the CUDA/Jetson workaround.

Improvements

  • The Jetson Orin workaround that forces the integrated flag to false is now scoped to CUDA-only builds instead of all CUDA/HIP devices.
  • HIP builds now report the real hipDeviceProp_t.integrated value, making device-type reporting consistent with buffer-support checks.

Bug fixes

  • Fixed an inconsistency where supports_buft() rejected CUDA host buffers on AMD APU/UMA parts because the cached integrated flag was hardcoded to false.
  • Restored integrated-GPU host-buffer usage on ROCm, resolving the regression tracked in issue #23977.

Upgrade notes

Only ROCm/HIP deployments on AMD APU or unified-memory parts are affected; rebuild or pull the b10040 ROCm binaries to regain host-buffer support. CUDA users, including Jetson Orin, see no behavioral change since the workaround remains active there. No config or API changes are required.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Fixes a bug in CUDA/HIP integration detection where the integrated flag was incorrectly set to false, preventing host buffer usage on AMD APU parts.

Key Highlights

  • Restore `prop.integrated` on HIP builds
  • Fixes host buffer usage on AMD APU/UMA parts
  • Keeps Jetson workaround intact for CUDA

New Features

  • HIP integration fix

Release Notes (excerpt)

<details open> ggml-cuda : restore prop.integrated on HIP builds (#24233) PR #16308 set info.devices[id].integrated = false unconditionally for all CUDA/HIP devices as a workaround for corrupted output on Jetson Orin (#15034). On HIP/ROCm the device's real hipDeviceProp_t.integrated flag is needed: with the cached field forced to false, supports_buft() refuses CUDA host buffers on AMD APU/UMA parts, while get_type() already reads…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories