b10541
ggml-org/llama.cppb10541Aug 21, 2026by github-actions[bot]same day as b10539
What changed since b10539
Adds a `--mmproj-device` CLI flag (with `-mmdev` short form) for selecting the multimodal projection device in MTMD.
New features
- New `--mmproj-device` command-line argument lets users pick which device loads the multimodal projection (mmproj) model.
- A `-mmdev` short flag is provided as a shorthand for the new option.
- The mmproj device backend is now loaded immediately when the argument is parsed rather than deferred.
Improvements
- The existing `MTMD_BACKEND_DEVICE` environment variable continues to work, so the new flag is backward compatible with prior configurations.
- CLI documentation was regenerated to cover the new argument.
Upgrade notes
No action required: the change is additive and existing `MTMD_BACKEND_DEVICE` setups keep working. If you previously relied on the env var, you can migrate to `--mmproj-device`/`-mmdev` for per-invocation control. Note the Vulkan FA MMQ fp32 quantization fix landed in the previous build (b10539) and is already included here.
Analyzed Oct 27, 2026
Upgrading?
Release notes summary
Adds a command-line argument `--mmproj-device` to the MTMD (Multi-Modal Text-to-Model) backend to allow specifying the device for the multimodal projection model.
Key Highlights
- New `--mmproj-device` argument added
- Backward compatibility maintained with MTMD_BACKEND_DEVICE env var
Release Notes (excerpt)
<details open> mtmd: add --mmproj-device argument (#23255) * feat: add --mmproj-device arg & backwards compatible MTMD_BACKEND_DEVICE env var * feat: load mmproj device backend immediately, add -mmdev shortflag * fix: its a pointer now get the name * clean up * gen docs * nits --------- Co-authored-by: Xuan Son Nguyen <son@huggingface.co> </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/42037857> **macOS/iOS:**…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system