b10078
ggml-org/llama.cppb10078Jul 21, 2026by github-actions[bot]same day as b10077
What changed since b10077
Vulkan backend queue handling refactored to per-instance mutexes with optional driver-side synchronization via VK_KHR_internally_synchronized_queues.
New features
- Vulkan backend now uses VK_KHR_internally_synchronized_queues to skip host-side mutex locking when the driver supports internal synchronization.
- Queue submission is abstracted behind a polymorphic interface, allowing locked and lock-free submission paths to coexist.
Improvements
- Per-instance mutexes replace coarser locking in vk_queue, improving thread safety and reducing contention.
- Queues are now owned via unique_ptr, enforcing exclusive ownership and tightening lifetime management.
- Added lock guarding in aliased-queue creation and null checks in the device destructor for safer teardown.
- Fallback defines and guarded feature queries keep builds working on Vulkan implementations lacking the new extension.
Bug fixes
- Fixed a duplicate pNext chain when enabling internally synchronized queue features.
- Corrected the timing of the internallySynchronizedQueues query so device creation no longer mismatches the probe result.
Upgrade notes
No configuration or CLI changes are required; this is an internal Vulkan backend refactor. Vulkan users on drivers supporting VK_KHR_internally_synchronized_queues get lock-free submission automatically, while other drivers fall back to the existing host-side locking path. Rebuild from source if you link against the Vulkan backend internals, since queue types and ownership semantics changed.
Analyzed Oct 25, 2026
Upgrading?
Release notes summary
Refactors Vulkan queue handling to use per-instance mutexes and unique handles, integrating VK_KHR_internally_synchronized_queues to bypass host-side locking when driver-side synchronization is supported.
Key Highlights
- Vulkan queue refactor with per-instance mutexes
- Integration of VK_KHR_internally_synchronized_queues
- Improved thread safety and performance via driver-side synchronization
- Use of unique_ptr for exclusive queue ownership
Release Notes (excerpt)
<details open> vulkan: Refactor vk_queue to use per-instance mutexes and unique handles (#23570) * Refactor vk_queue to use per-instance mutexes and unique handles * integrates VK_KHR_internally_synchronized_queues, abstracting the queue submission into a polymorphic interface that completely bypasses host-side mutex locking when driver-side synchronization is supported * fix compilation error * fix duplicate pNext chain for VkPhysicalDeviceInternallySynchronizedQueuesFeaturesKHR…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system