b9970

ggml-org/llama.cppb9970Jul 12, 2026by github-actions[bot]same day as b9969

What changed since b9969

medium risk

Adds a new GGML_OP_LIGHTNING_INDEXER op enabling DeepSeek V3.2/V4 lightning indexer, with an RPC version bump.

Breaking changes

  • The RPC protocol version was bumped to carry the new operation, so RPC clients and servers built from different revisions may no longer interoperate.

New features

  • New GGML_OP_LIGHTNING_INDEXER graph operation implementing the DeepSeek V3.2/V4 lightning indexer.
  • DeepSeek V3.2 and DeepSeek V4 model graphs now use the lightning indexer op instead of the previous composition.
  • Added unit tests covering lightning indexer mask broadcasting and FLOPs accounting.

Improvements

  • Lightning indexer op takes an f16 mask parameter and drops redundant scale parameters for a simpler signature.
  • Input tensors are validated to be non-transposed, and CPU implementation variables were renamed for clarity.
  • RPC backend extended to recognize and dispatch the new operation.

Bug fixes

  • Corrected mask broadcasting behavior in the lightning indexer, verified by dedicated tests.

Upgrade notes

Rebuild RPC client and server from the same revision, since the protocol version changed with this release. DeepSeek V3.2/V4 users get the new indexer path automatically; no config changes are required. Custom ggml backends that enumerate ops must handle GGML_OP_LIGHTNING_INDEXER or they will fail on those models.

Analyzed Oct 24, 2026

Upgrading?

Release notes summary

Introduces a new `GGML_OP_LIGHTNING_INDEXER` operation to implement the lightning indexer for DeepSeek V3.2 and V4 models, along with comprehensive tests and RPC updates.

Key Highlights

  • Added `GGML_OP_LIGHTNING_INDEXER` operation to ggml
  • Integrated lightning indexer into DeepSeek V3.2 and V4 models
  • Added tests for mask broadcasting and FLOPs calculation
  • Bumped RPC version to support the new operation

Release Notes (excerpt)

<details open> ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer (#24231) * ggml : add GGML_OP_LIGHTNING_INDEXER that implements DeepSeek V3.2/V4 lightning indexer * ggml : remove scale parameters from lightning indexer OP, add f16 mask parameter * tests : add GGML_OP_LIGHTNING_INDEXER tests * ggml : bump RPC version * chore : check if lightning indexer input tensors are not transposed…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories