b9674
ggml-org/llama.cppb9674Jun 17, 2026by github-actions[bot]same day as b9673
What changed since b9673
b9674 is a targeted SYCL bug-fix release addressing a use-after-free in async memcpy during MoE prefill.
Improvements
- mmid_row_mapping_host is now kept persistent to avoid dangling references during async copies.
- Added stream synchronization (stream->wait) around the async memcpy path for safer ordering.
Bug fixes
- Fixed a use-after-free in the SYCL backend when async memcpy overlaps MoE prefill memory management.
- Resolved instability/crashes when running MoE models on SYCL devices during prefill.
Upgrade notes
This is a drop-in patch over b9673 with no config or API changes; SYCL users running MoE models should upgrade to avoid the memory-safety bug. The USM system allocation feature from b9673 remains opt-in via GGML_SYCL_USM_SYSTEM.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
This release fixes a critical use-after-free bug in the SYCL backend related to asynchronous memory copy operations during Mixture-of-Experts (MoE) prefill phases. This ensures memory safety and stability when running MoE models on SYCL devices.
Key Highlights
- Fix for use-after-free bug in SYCL async memcpy
- Fix for MoE prefill memory management issues
- Persistence of `mmid_row_mapping_host`
New Features
- SYCL async memcpy bug fix
Release Notes (excerpt)
<details open> SYCL: fix use-after-free bug with async memcpy in MoE prefill (#24676) * SYCL: fix a bug with async memcpy * make mmid_row_mapping_host persistent * comment on stream->wait * Apply suggestion from @sanmai * Apply suggestion from @sanmai * Apply suggestion from @sanmai </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system