llama.cpp Releases
684 releases of ggml-org/llama.cpp
- b9975
Fixes a GGUF validation issue by rejecting empty metadata keys to prevent potential loading errors. Includes standard binary builds for macOS, Linux, Windows, Android, and openEuler with support for various hardware backends.
Jul 12, 2026
- b9974
Prevents crashes in CUDA builds when querying memory on devices with insufficient memory. This allows the application to gracefully handle low-memory devices and explicitly disabled devices via the `-dev none` flag.
Jul 12, 2026
- b9973
Fixes the cache clearing logic for DeepSeek V4 to clear cache only for specific sequences instead of the entire context, improving efficiency.
Jul 12, 2026
- b9972
Enhances the server API by enabling streaming for the `exec_shell_command` tool, allowing real-time output from shell executions.
Jul 12, 2026
- b9971
Refactors the server stream functionality to improve thread safety and code organization by removing a non-thread-safe stop call and relocating server components.
Jul 12, 2026
- b9970
Introduces a new `GGML_OP_LIGHTNING_INDEXER` operation to implement the lightning indexer for DeepSeek V3.2 and V4 models, along with comprehensive tests and RPC updates.
Jul 12, 2026
- b9969
Fixed a critical crash bug in llama-cli for longer prompts by updating Vulkan matmul routing for Adreno GPUs to use medium tiles and fixing shared memory issues.
Jul 12, 2026
- b9968
Added optimized int8 dense matrix multiplication and MoE (Mixture of Experts) prefill operations specifically for Adreno GPUs via the OpenCL backend.
Jul 12, 2026
- b9967
Updated the LLM server API to accept null values for sampling parameters (like temperature and top_p), allowing clients to request server defaults and improving OpenAI API compliance.
Jul 12, 2026
- b9966
Optimized regex pattern compilation in `llama_meta_device_get_split_state()` by making patterns static const local variables to prevent recompilation on every call, significantly improving decode thread performance.
Jul 11, 2026
- b9965
Enhanced ARGSORT performance for small tensors on Hexagon hardware by implementing efficient bitonic sorting in HVX registers and optimizing common cases.
Jul 11, 2026
- v1.16.1
A bug-fix patch addressing a WebAssembly memory leak, extending comment removal to more module file types, and fixing directory tree rendering and token counting issues on Windows.
Jul 11, 2026
- b9964
Fixes an issue where duplicate downloads of spec models could occur in arguments.
Jul 11, 2026
- b9963
Adds multi-tile support for DeepSeek OCR v1, enabling dynamic resolution processing.
Jul 11, 2026
- b9960
Removes the `loading.html` file from the server interface.
Jul 11, 2026
- b9959
Syncs and updates the ggml library core.
Jul 11, 2026
- b9957
Improves server tools by adding abstractions and removes the deprecated `apply_diff` functionality.
Jul 10, 2026
- b9956
Fixes a crash in the CLI when connecting to a server with an invalid base URL by implementing graceful exception handling.
Jul 10, 2026
- b9952
Optimizes FlashAttention usage by using F16 for Key-Query masks and removes dead code related to raw_k repeats in DeepSeek V4.
Jul 10, 2026
- b9951
Introduces a new ET backend with FlashAttention and SSM support, along with optimized kernels for various operations like MUL_MAT, ROPE, and GLU.
Jul 10, 2026