b10081

ggml-org/llama.cppb10081Jul 22, 2026by github-actions[bot]same day as b10080

What changed since b10080

low risk

Fixes draft repo sidecar resolution so -hfd with --spec-type draft-dflash picks the speculative sidecar model.

New features

  • Speculative decoding now works when the draft repo ships sidecar models, wiring sidecar discovery into the draft plan's fallback path.

Improvements

  • Draft plan now consumes the sidecars it already discovered instead of discarding them, matching the main plan's fallback behavior.

Bug fixes

  • Draft resolution no longer falls back to the repo's main model when find_best_model() excludes sidecar files and the explicit draft plan suppressed sidecar discovery.

Upgrade notes

No config or CLI changes are required; existing -hf/-hfd invocations keep working. Users combining a sidecar-shipping draft repo with --spec-type draft-dflash should upgrade to get correct speculative decoding. This release is a single targeted fix on top of b10080, so the server error-handling and UI changes from the prior build remain in effect.

Analyzed Oct 31, 2026

Upgrading?

Release notes summary

Fixes a bug where draft repositories were not resolving to their requested sidecar models when using the --spec-type draft-dflash flag, ensuring speculative decoding works as expected.

Key Highlights

  • Fixes draft repo sidecar resolution
  • Enables proper speculative decoding with sidecar repos
  • Wires sidecar discovery into the fallback pattern

Release Notes (excerpt)

<details open> common: resolve draft repo to its requested sidecar (#25955) With -hfd pointing to a repo shipping speculative sidecars, the draft resolved to the main model of that repo, since find_best_model() excludes sidecar files, and the explicit draft plan suppressed the sidecar discovery on the -hf repo. The draft plan already discovers its sidecars, they were just never consumed. Wire them as the draft, following the fallback pattern of the main plan, so this now works as expected:…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories