b9970
ggml-org/llama.cppb9970Jul 12, 2026by github-actions[bot]same day as b9969
What changed since b9969
Adds a new GGML_OP_LIGHTNING_INDEXER op enabling DeepSeek V3.2/V4 lightning indexer, with an RPC version bump.
Breaking changes
- The RPC protocol version was bumped to carry the new operation, so RPC clients and servers built from different revisions may no longer interoperate.
New features
- New GGML_OP_LIGHTNING_INDEXER graph operation implementing the DeepSeek V3.2/V4 lightning indexer.
- DeepSeek V3.2 and DeepSeek V4 model graphs now use the lightning indexer op instead of the previous composition.
- Added unit tests covering lightning indexer mask broadcasting and FLOPs accounting.
Improvements
- Lightning indexer op takes an f16 mask parameter and drops redundant scale parameters for a simpler signature.
- Input tensors are validated to be non-transposed, and CPU implementation variables were renamed for clarity.
- RPC backend extended to recognize and dispatch the new operation.
Bug fixes
- Corrected mask broadcasting behavior in the lightning indexer, verified by dedicated tests.
Upgrade notes
Rebuild RPC client and server from the same revision, since the protocol version changed with this release. DeepSeek V3.2/V4 users get the new indexer path automatically; no config changes are required. Custom ggml backends that enumerate ops must handle GGML_OP_LIGHTNING_INDEXER or they will fail on those models.
Analyzed Oct 24, 2026
Upgrading?
Release notes summary
Introduces a new `GGML_OP_LIGHTNING_INDEXER` operation to implement the lightning indexer for DeepSeek V3.2 and V4 models, along with comprehensive tests and RPC updates.
Key Highlights
- Added `GGML_OP_LIGHTNING_INDEXER` operation to ggml
- Integrated lightning indexer into DeepSeek V3.2 and V4 models
- Added tests for mask broadcasting and FLOPs calculation
- Bumped RPC version to support the new operation
Release Notes (excerpt)
<details open> ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer (#24231) * ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer * ggml : remove scale parameters from lightning indexer OP, add f16 mask parameter * tests : add GGML_OP_LIGHTNING_INDEXER tests * ggml : bump RPC version * chore : check if lightning indexer input tensors are not transposed…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system