b10206
ggml-org/llama.cppb10206Jul 31, 2026by github-actions[bot]same day as b10205
What changed since b10205
b10206 enforces matching K/V cache types for DeepSeek V4 and MLA models and auto-enables Flash Attention when the V cache is quantized.
Breaking changes
- Configurations that previously used different K and V cache types with DeepSeek V4 or MLA models are now rejected or coerced, so asymmetric cache quantization flags may no longer work.
New features
- Flash Attention is now turned on automatically when the V cache is quantized, instead of requiring an explicit flag.
- Cache type consistency enforcement extends to MLA-based models in addition to DeepSeek V4.
Improvements
- KV cache handling for DeepSeek V4 and MLA architectures is now validated centrally, reducing misconfiguration-driven correctness issues.
Bug fixes
- Prevents silent incorrect inference from mismatched K/V cache types on DeepSeek V4 and MLA models.
Upgrade notes
If you run DeepSeek V4 or MLA models with asymmetric cache quantization (e.g. different -ctk and -ctv values), align them before upgrading. Quantized V caches will now implicitly enable Flash Attention, which may change memory usage and performance characteristics; verify your backend supports FA for these models.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
This release enforces consistent Key and Value cache types for DeepSeek V4 and MLA models, and enables Flash Attention automatically when the Value cache is quantized.
Key Highlights
- Enforces same K and V cache types for DeepSeek V4 and MLA models
- Enables Flash Attention if V cache is quantized
Release Notes (excerpt)
<details open> llama : enforce the same K and V cache types for DeepSeek V4; enable FA if V cache is quantized (#25871) * llama : enforce the same K and V cache types for DeepSeek V4; enable FA if V cache is quantized * llama : enforce the same K and V cache types for MLA models --------- Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com> </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system