llama.cpp Releases
684 releases of ggml-org/llama.cpp
- b9787
Fixes unit test failures for 3D convolution operations in the SYCL backend.
Jun 25, 2026
- b9786
Enhances the OpenCL backend to support non-contiguous memory rows in normalization operations, improving compatibility with various memory layouts.
Jun 25, 2026
- b9785
Hardens the chat mode input handling to improve security by enforcing stricter checks on input caps.
Jun 25, 2026
- b9784
Major performance and architectural overhaul of the Hexagon (Qualcomm) backend, introducing tiled weight repacking (32x32), improved kernel parameters, graph caching, and VTCM optimizations.
Jun 24, 2026
- b9782
Code cleanup removing the unused `json-partial` module from the common library.
Jun 24, 2026
- b9781
Adds a configuration option to reduce the graph submission batch size in the Vulkan backend to prevent timeout issues on certain hardware configurations.
Jun 24, 2026
- b9780
Improves build reliability for the Vulkan backend by ensuring the build fails immediately if a shader fails to compile, rather than silently succeeding and producing broken binaries at runtime.
Jun 24, 2026
- b9777
Adds two new LFM2.5 embedding models to the repository, specifically LFM2.5-ColBERT-350M and LFM2.5-Embedding-350M, and restores LFM models in the README.
Jun 24, 2026
- b9776
Fixes a Vulkan floating-point overflow issue in Fully Attention (FA) by applying bias before the softmax operation. Includes standard binary builds for macOS, Linux, Windows, Android, and openEuler.
Jun 24, 2026
- b9775
The server component now includes a check for draft context creation errors to improve error reporting and debugging.
Jun 23, 2026
- b9774
This release enhances Vulkan backend support by implementing unary operations and non-contiguous memory support for various math functions like SQR, SQRT, and NORM.
Jun 23, 2026
- b9773
This release adds support for the GET_ROWS_BACK operation in the Vulkan backend.
Jun 23, 2026
- b9771
This release optimizes Vulkan shader variants by converting the ALIGNED flag for matrix multiplication into a specialization constant, which reduces binary size.
Jun 23, 2026
- b9770
The server component receives a fix for remote preset handling to ensure correct operation. A test was also added to validate this functionality.
Jun 23, 2026
- b9769
This release fixes a linker error in Vulkan builds by explicitly linking the ggml-cpu library when debug result-checking or test modes are enabled. Standard binaries are provided for all supported platforms.
Jun 23, 2026
- b9768
This release introduces support for the Granite Speech Plus audio model, including conversion capabilities and extended multi-layer concatenation features. Various bug fixes were also applied to naming and alignment.
Jun 23, 2026
- b9767
This release optimizes WebGPU inference for small batches by utilizing a matrix-vector path. It includes updated binaries for supported platforms and backends.
Jun 23, 2026
- b9763
This release adds an identifier to tool call responses within the server API. Pre-built binaries are provided for macOS, Linux, Android, Windows, and openEuler across various architectures and hardware backends.
Jun 22, 2026
- v0.8.22
This release from the mistral.rs repository improves CUDA matrix handling, error reporting, and release configuration.
Jun 22, 2026
- b9761
Moved model downloading to a dedicated child process to allow for real-time progress tracking via SSE endpoint.
Jun 22, 2026