b10045
ggml-org/llama.cppb10045Jul 16, 2026by github-actions[bot]same day as b10043
What changed since b10043
b10045 adds text-only slot save/restore for multimodal (mtmd) server models, on top of b10043's CUDA virtual device support.
New features
- Server can now save and restore text-only slots when running multimodal (mtmd) models, previously unsupported in that configuration.
Improvements
- Release artifacts refreshed across platforms, including macOS arm64/x64, Windows CUDA 12.4 and 13.3, and Linux ROCm 7.2, OpenVINO, and SYCL builds.
- KleidiAI-enabled macOS arm64 builds remain disabled, consistent with the prior release.
Upgrade notes
This is a small incremental bump with no config or API migration required; the only functional delta is the new mtmd text-only slot save/restore path. If you rely on slot save/restore with multimodal models, verify behavior after upgrading. CUDA virtual device support from b10043 is unchanged and still disables the NCCL path.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Adds a server feature allowing text-only slot save and restore when using Multimodal (mtmd) models, accompanied by standard platform binaries.
Key Highlights
- Server now allows text-only slot save/restore with Multimodal (mtmd) models
- macOS binaries available for Apple Silicon (arm64) and Intel (x64)
- Windows binaries support CUDA 12.4 and 13.3, along with OpenVINO and SYCL
- Linux binaries support ROCm, OpenVINO, and SYCL for Ubuntu
- KleidiAI builds are disabled for this release
Release Notes (excerpt)
<details open> server : allow text-only slot save/restore with mtmd (#25076) </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (ROCm 7.2) - Ubuntu x64 (OpenVINO) - Ubuntu x64 (SYCL FP32) - Ubuntu x64 (SYCL FP16) **Android:**…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system