b9952
ggml-org/llama.cppb9952Jul 10, 2026by github-actions[bot]same day as b9951
What changed since b9951
b9952 is a small follow-up that switches FlashAttention KQ masks to F16 and trims dead DeepSeek V4 code.
Improvements
- All Key-Query masks (except the lightning indexer) are now stored as F16 when FlashAttention is enabled, reducing mask memory and bandwidth.
- Zero attention bias is no longer applied in DeepSeek V4, simplifying the attention path.
- Dead code that duplicated the unified raw_k cache per stream in DeepSeek V4 was removed, since raw_k is always non-unified.
Upgrade notes
This is a drop-in update from b9951 with no config or API changes; the F16 KQ mask switch happens automatically when FlashAttention is active. DeepSeek V4 users should see slightly lower memory use and cleaner attention handling. No migration steps are required.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
Optimizes FlashAttention usage by using F16 for Key-Query masks and removes dead code related to raw_k repeats in DeepSeek V4.
Key Highlights
- F16 KQ masks for FlashAttention
- DeepSeek V4 optimizations
New Features
- F16 KQ masks in FlashAttention
- DeepSeek V4 optimizations
Release Notes (excerpt)
<details open> llama : make all KQ masks f16 if FA is used, remove zero attention bias, remove raw_k repeats in DeepSeek V4 (#25370) * llama : make all KQ masks (except the lightning indexer one) f16 if FA is used and remove zero attention bias in DeepSeek V4 * llama : remove dead code that repeats unified raw_k cache for each stream in DeepSeek V4 - no longer needed as raw_k is always non-unified. --------- Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com> </details>…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system