b9673
ggml-org/llama.cppb9673Jun 17, 2026by github-actions[bot]1 days after b9672
What changed since b9672
SYCL backend gains opt-in USM system allocations enabling VRAM overcommit on memory-constrained devices.
New features
- SYCL backend can now allocate large GPU buffers (≥1GB) using USM system allocations when the device supports it.
- Enables VRAM overcommit by letting the system migrate buffers between host and device, useful on devices like the B580.
- Feature is gated behind the GGML_SYCL_USM_SYSTEM environment variable and is off by default.
Improvements
- Automatic fallback to regular allocations when USM system allocations are unsupported by the device or system.
- No change to default behavior or non-SYCL backends, keeping existing deployments unaffected.
Upgrade notes
No migration is required; the new SYCL path is opt-in. To use it, set GGML_SYCL_USM_SYSTEM in the environment before launching and verify your device/driver supports USM system allocations, otherwise llama.cpp silently falls back to standard allocations. Only SYCL builds are affected.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
This release introduces optional Unified Shared Memory (USM) system allocations for the SYCL backend, allowing for VRAM overcommit on devices with limited memory. The feature is disabled by default and can be enabled via the `GGML_SYCL_USM_SYSTEM` environment variable.
Key Highlights
- Addition of optional USM system allocations for SYCL
- Support for VRAM overcommit (e.g., on B580 device)
- Fallback to regular allocations if USM is unsupported
- Requires `GGML_SYCL_USM_SYSTEM` environment variable to enable
Release Notes (excerpt)
<details open> sycl: Add optional USM system allocations (#22526) This introduces an optional feature to allocate large GPU buffers (≥ 1GB) using USM system allocations if supported by the device. It allows using buffers from the system allocator then letting the system manage memory migrations between host and device as necessary. This feature is disabled by default and requires the GGML_SYCL_USM_SYSTEM environment variable to enable. If USM system allocations are not supported…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system