b9685

ggml-org/llama.cppb9685Jun 17, 2026by github-actions[bot]same day as b9684

What changed since b9684

low risk

Adds SYCL device-to-device memcpy support and fixes P2P communication detection in the SYCL backend.

New features

  • SYCL backend gains a device-to-device memory copy path implemented through the SYCL API.

Improvements

  • The GGML_SYCL_DEV2DEV_MEMCPY option is now exposed through the runtime option table rather than being a compile-time-only setting.
  • Peer-to-peer communication detection logic was reworked to more reliably decide when direct device transfers are usable.

Bug fixes

  • Corrected a defect introduced while resolving merge conflicts in the dev2dev memcpy change.

Upgrade notes

This is a single-PR increment on top of b9684 with no API or CLI changes, so a straight binary swap is sufficient. SYCL users who previously set GGML_SYCL_DEV2DEV_MEMCPY at build time should verify the new runtime-table entry is honored in their configuration. Non-SYCL backends are unaffected.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Adds device-to-device memory copy functionality using the SYCL API. This release also updates the runtime table and fixes P2P communication detection methods.

Key Highlights

  • SYCL dev2dev memcpy implementation
  • Runtime table update for new memcpy option
  • P2P communication detection method fix

Release Notes (excerpt)

<details open> [SYCL] add dev2dev memcpy by SYCL API (#24476) * add dev2dev memcpy by SYCL API * mv GGML_SYCL_DEV2DEV_MEMCPY to runntime table * update the detect method for p2p comm * fix the erro created during fix confilct --------- Co-authored-by: Neo Zhang <NA> </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories