b9674

ggml-org/llama.cppb9674Jun 17, 2026by github-actions[bot]same day as b9673

What changed since b9673

low risk

b9674 is a targeted SYCL bug-fix release addressing a use-after-free in async memcpy during MoE prefill.

Improvements

  • mmid_row_mapping_host is now kept persistent to avoid dangling references during async copies.
  • Added stream synchronization (stream->wait) around the async memcpy path for safer ordering.

Bug fixes

  • Fixed a use-after-free in the SYCL backend when async memcpy overlaps MoE prefill memory management.
  • Resolved instability/crashes when running MoE models on SYCL devices during prefill.

Upgrade notes

This is a drop-in patch over b9673 with no config or API changes; SYCL users running MoE models should upgrade to avoid the memory-safety bug. The USM system allocation feature from b9673 remains opt-in via GGML_SYCL_USM_SYSTEM.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

This release fixes a critical use-after-free bug in the SYCL backend related to asynchronous memory copy operations during Mixture-of-Experts (MoE) prefill phases. This ensures memory safety and stability when running MoE models on SYCL devices.

Key Highlights

  • Fix for use-after-free bug in SYCL async memcpy
  • Fix for MoE prefill memory management issues
  • Persistence of `mmid_row_mapping_host`

New Features

  • SYCL async memcpy bug fix

Release Notes (excerpt)

<details open> SYCL: fix use-after-free bug with async memcpy in MoE prefill (#24676) * SYCL: fix a bug with async memcpy * make mmid_row_mapping_host persistent * comment on stream->wait * Apply suggestion from @sanmai * Apply suggestion from @sanmai * Apply suggestion from @sanmai </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories