b10290

ggml-org/llama.cppb10290Aug 6, 2026by github-actions[bot]same day as b10289

What changed since b10289

medium risk

Adds ggml_build_forward_order to stop stale inputs in mtmd audio graphs, plus a small AGENTS.md comment cleanup.

New features

  • New ggml_build_forward_order API inserts graph nodes for ordering only, without setting the compute flag, so unselected branches are not forced to run.

Improvements

  • clip_graph::build_attn now uses the ordering-only hint for q/k/v, preserving ggml_build_forward_select semantics.
  • Compute flags are applied only when a branch is actually selected, avoiding wasted work on unselected branches.
  • Reduced comment noise in AGENTS.md.

Bug fixes

  • Fixed GEN_WAV calls in mtmd audio graphs executing the GEN_CODE branch with a stale inp_code0, which triggered a get_rows bound assert on CPU.

Upgrade notes

This is a drop-in build bump with no config or CLI changes; the new ggml function is additive, so existing callers of ggml_build_forward_expand are unaffected. Only downstream code that builds multi-modal graphs and relies on ordering hints needs to switch to ggml_build_forward_order to get the fix.

Analyzed Oct 22, 2026

Upgrading?

Release notes summary

This release introduces a new graph ordering function (`ggml_build_forward_order`) to prevent stale inputs in multi-modal audio processing graphs. It addresses a bug where compute flags were applied too early, causing incorrect execution in specific branches.

Key Highlights

  • Added `ggml_build_forward_order` for better tensor ordering in multi-modal graphs.
  • Fixes stale input handling in GEN_WAV calls within mtmd audio graphs.
  • Prevents forced execution of unselected branches with stale inputs.
  • Updated comments in AGENTS.md.

Release Notes (excerpt)

<details open> mtmd/ggml: add ggml_build_forward_order (#26649) * ggml: add ggml_build_forward_order ggml_build_forward_expand marks the tensor and all its ancestors for compute, so using it as a pure ordering hint (keeping q, k and v together) defeats ggml_build_forward_select: the unselected branch is forced to run with inputs that were never uploaded. In the mtmd audio graph this makes GEN_WAV calls execute the GEN_CODE branch with a…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories