llama.cpp Releases
684 releases of ggml-org/llama.cpp
- b10146
Enabled BF16 (Brain Float 16) tiled GEMM optimizations specifically for PowerPC architecture.
Jul 27, 2026
- b10145
Modified the --mlock flag behavior to exclusively lock memory in place without memory mapping.
Jul 27, 2026
- b10144
Improved the web server and UI stability by fixing stream handling for model names with special characters, managing pending requests during model loading, and preserving session state on page reloads.
Jul 27, 2026
- b10142
Added preliminary support for the MiniMax-M3 multimodal model, including vision capabilities, optimized attention mechanisms, and multi-stream handling.
Jul 27, 2026
- b10141
Fixed a build issue for the multimodal text module (mtmd) on Android.
Jul 26, 2026
- b10107
Fixed a crash on Windows with the Hexagon backend when the op_poll option is enabled.
Jul 24, 2026
- b10106
Fixes an issue preventing external compilation of the q1_0 Multi-Quantization Matrix (MMQ) kernels.
Jul 24, 2026
- b10105
Refactors mmap, mlock, and directio arguments into a single unified `load-mode` argument, requiring a change in command-line usage.
Jul 24, 2026
- v0.7.1
This release contains a large number of changes including session header actions, Markdown export, Zhipu AI web search support, Volcengine rerank, and various bug fixes for chat, wiki, and embedding features.
Jul 24, 2026
- b10103
Adds f16 type support to the leaky relu activation function in the Metal backend.
Jul 24, 2026
- b10099
Improves NVFP4 W4A4 activation quantization on CUDA with fused kernels and optimized memory access patterns.
Jul 23, 2026
- b10098
Updates Hexagon activation operations with optimized microkernels and improved memory handling for non-contiguous data.
Jul 23, 2026
- b10094
Automatically infers the speculative type from draft repo sidecars (mtp/dflash/eagle3) when no explicit `--spec-type` is provided.
Jul 23, 2026
- b10093
Fixes the DeepSeek4 chat template to explicitly follow reference behavior and adds support for the DeepSeekv4 `drop_reasoning` flag.
Jul 23, 2026
- b10092
Enables PowerPC backend variants on AIX and fixes a missing semicolon in the PowerPC Q0 matmul implementation.
Jul 23, 2026
- b10091
This release fixes a bug related to SYCL package shared library lookup. It includes standard binaries for macOS, Linux, Windows, Android, and openEuler.
Jul 22, 2026
- b10090
Adds a depthwise convolution 2D (CONV_2D_DW) kernel to the WebGPU backend, ported from the Vulkan backend implementation.
Jul 22, 2026
- b10089
Significantly optimizes the CUDA backend by implementing support for k-quants, i-quants, and mxfp4 in the GET_ROWS operation, enabling efficient device-side embedding lookups.
Jul 22, 2026
- b10088
A maintenance release focused on fixing a tensor operation issue in the llama-arch module for DeepSeek4 APE, along with disabling specific backend builds.
Jul 22, 2026
- b10087
Adds support for new hardware devices, specifically the Laguna XS.2 and Laguna M.1.
Jul 22, 2026