b10541

ggml-org/llama.cppb10541Aug 21, 2026by github-actions[bot]same day as b10539

What changed since b10539

medium risk

Adds a `--mmproj-device` CLI flag (with `-mmdev` short form) for selecting the multimodal projection device in MTMD.

New features

  • New `--mmproj-device` command-line argument lets users pick which device loads the multimodal projection (mmproj) model.
  • A `-mmdev` short flag is provided as a shorthand for the new option.
  • The mmproj device backend is now loaded immediately when the argument is parsed rather than deferred.

Improvements

  • The existing `MTMD_BACKEND_DEVICE` environment variable continues to work, so the new flag is backward compatible with prior configurations.
  • CLI documentation was regenerated to cover the new argument.

Upgrade notes

No action required: the change is additive and existing `MTMD_BACKEND_DEVICE` setups keep working. If you previously relied on the env var, you can migrate to `--mmproj-device`/`-mmdev` for per-invocation control. Note the Vulkan FA MMQ fp32 quantization fix landed in the previous build (b10539) and is already included here.

Analyzed Oct 27, 2026

Upgrading?

Release notes summary

Adds a command-line argument `--mmproj-device` to the MTMD (Multi-Modal Text-to-Model) backend to allow specifying the device for the multimodal projection model.

Key Highlights

  • New `--mmproj-device` argument added
  • Backward compatibility maintained with MTMD_BACKEND_DEVICE env var

Release Notes (excerpt)

<details open> mtmd: add --mmproj-device argument (#23255) * feat: add --mmproj-device arg & backwards compatible MTMD_BACKEND_DEVICE env var * feat: load mmproj device backend immediately, add -mmdev shortflag * fix: its a pointer now get the name * clean up * gen docs * nits --------- Co-authored-by: Xuan Son Nguyen <son@huggingface.co> </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/42037857> **macOS/iOS:**…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories