b10148

ggml-org/llama.cppb10148Jul 27, 2026by github-actions[bot]same day as b10146

What changed since b10146

medium risk

Fixes draft-model selection so an explicit -md/-hfd choice is no longer overridden by automatic sidecar resolution.

Breaking changes

  • CLI behavior change: supplying an explicit draft model file now disables automatic sidecar resolution, so setups that implicitly relied on the sidecar overriding -md will resolve differently.

New features

  • The -hfd tag now anchors sidecar selection directly, matching an exact tag first and falling back to the closest quant.
  • A requested sidecar can now resolve even when no full model matches the given tag.

Improvements

  • Speculative decoding load logs (draft model and MTP draft context) are promoted from trace to info level and appear at default verbosity.
  • A wired draft sidecar is treated as an explicit draft, preventing the main plan from downloading a redundant second model.

Bug fixes

  • An explicit --model-draft path given with -hfd was silently overridden by sidecar resolution and never resolved to a local file; manual configuration now wins.
  • Tag-based sidecar selection no longer aborts the whole draft plan when the tag has no matching full model.

Upgrade notes

No config migration is required, but verify any scripts that combine -md with -hfd: explicit draft files now take precedence and skip sidecar resolution. Expect additional draft-model log lines at default verbosity, which may affect log-parsing tooling.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Fixed a regression where explicitly specified draft models were silently overridden by automatic sidecar resolution, ensuring user configuration takes precedence.

Key Highlights

  • Fixed explicit draft model precedence over sidecar resolution
  • Applied -hfd tag to sidecar resolution logic

Release Notes (excerpt)

<details open> common: fix explicit -md precedence over draft sidecar resolution (#26165) * common: fix explicit -md precedence over draft sidecar resolution Follow-up of #25955, an explicit --model-draft file given with -hfd was silently overridden by the sidecar resolution of the draft repo, and its path was never resolved to a local file. An explicit draft file selection now disables the sidecar resolution, so the manual CLI configuration wins over the automatic one.…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories