b10043
ggml-org/llama.cppb10043Jul 16, 2026by github-actions[bot]same day as b10042
What changed since b10042
Adds opt-in CUDA virtual device support (with NCCL disabled for those setups) on top of the previous Volta/Turing CUDA graph enablement.
New features
- CUDA virtual devices can now be used, letting a single physical GPU be presented as multiple simulated GPUs.
- Virtual devices are labeled in the device description output, and new GPUx2 server CI jobs exercise multi-device configurations.
Improvements
- NCCL communication path is automatically skipped when virtual devices are in use, avoiding an unsupported code path.
- Internal CUDA backend code was refactored to accommodate the virtual device abstraction.
Upgrade notes
No configuration or migration steps are required for existing setups; the virtual device capability is opt-in. Be aware that multi-GPU runs using virtual devices will not use NCCL, so expect different scaling behavior than with real GPUs. The Volta/Turing CUDA graph support from the previous build remains in place.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Adds support for CUDA virtual devices, allowing the simulation of multiple GPUs, and disables NCCL in this scenario.
Key Highlights
- Support for CUDA virtual devices
- Disable NCCL path when virtual devices are used
Release Notes (excerpt)
<details open> CUDA: Support CUDA Virtual Devices (#25228) * support cuda virtual devices * disable NCCL path when virtual devices are used * label virtual devices in description; add GPUx2 server CI jobs * code refactor </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system