llama.cpp Releases
609 releases of ggml-org/llama.cpp
- b10079
Fixes a bug in the server component where it failed to properly handle a null llama_context pointer, preventing potential crashes during request processing.
Jul 22, 2026
- b10078
Refactors Vulkan queue handling to use per-instance mutexes and unique handles, integrating VK_KHR_internally_synchronized_queues to bypass host-side locking when driver-side synchronization is supported.
Jul 21, 2026
- b10077
Adds the missing GGML_BACKEND_DL_IMPL macro invocation for the OpenVINO backend to fix issue #25586, ensuring consistent backend initialization across the codebase.
Jul 21, 2026
- b10076
CUDA optimization to vectorize get_rows operation for int4 types.
Jul 21, 2026
- b10075
Hexagon backend adds CLAMP operation support.
Jul 20, 2026
- b10069
OpenCL improvements for Adreno GPU support including broadcast and view offsets.
Jul 20, 2026
- b10068
DFlash model update for proper handling of injected K/V cache.
Jul 18, 2026
- b10067
Fix for quantization of DeepSeek-V4's routing table tensor.
Jul 18, 2026
- b10066
OpenCL update to load and use a specific kernel from binary kernel library.
Jul 17, 2026
- b10064
OpenCL optimization for improved memory access patterns in q4_K quantization.
Jul 17, 2026
- b10063
General sync release for ggml library updates across multiple platforms.
Jul 17, 2026
- b10061
Bug fix for test suite to prevent NaN values in sentinel tensors.
Jul 17, 2026
- b10059
Changes the default implementation for Hadamard matrix multiplication to use a CPU routine.
Jul 17, 2026
- b10058
Adds support for Q2_0 quantization format to the Vulkan backend and optimizes mat-vec-mul performance.
Jul 17, 2026
- b10057
Fixes critical bugs in the SYCL backend related to quantization row calculations and Q5_K kernel processing.
Jul 17, 2026
- b10056
Adds an OpenCL operation for absolute value (ABS) to the backend.
Jul 17, 2026
- b10054
Adds documentation notes regarding OpenCL usage with specific Adreno 810 hardware and includes standard release binaries.
Jul 17, 2026
- b10052
Major overhaul of Hexagon L2 cache handling, introducing dirty bit tracking, threaded flushing, and various MUL_MAT and workqueue improvements.
Jul 16, 2026
- b10051
Updates KleidiAI integration to distinguish between SME (v1) and SME2 hardware capabilities, ensuring correct kernel dispatch.
Jul 16, 2026
- b10050
Fixes a potential race condition in Vulkan by synchronizing on event wait when using transfer queues for asynchronous copies.
Jul 16, 2026