b10045

ggml-org/llama.cppb10045Jul 16, 2026by github-actions[bot]same day as b10043

What changed since b10043

low risk

b10045 adds text-only slot save/restore for multimodal (mtmd) server models, on top of b10043's CUDA virtual device support.

New features

  • Server can now save and restore text-only slots when running multimodal (mtmd) models, previously unsupported in that configuration.

Improvements

  • Release artifacts refreshed across platforms, including macOS arm64/x64, Windows CUDA 12.4 and 13.3, and Linux ROCm 7.2, OpenVINO, and SYCL builds.
  • KleidiAI-enabled macOS arm64 builds remain disabled, consistent with the prior release.

Upgrade notes

This is a small incremental bump with no config or API migration required; the only functional delta is the new mtmd text-only slot save/restore path. If you rely on slot save/restore with multimodal models, verify behavior after upgrading. CUDA virtual device support from b10043 is unchanged and still disables the NCCL path.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Adds a server feature allowing text-only slot save and restore when using Multimodal (mtmd) models, accompanied by standard platform binaries.

Key Highlights

  • Server now allows text-only slot save/restore with Multimodal (mtmd) models
  • macOS binaries available for Apple Silicon (arm64) and Intel (x64)
  • Windows binaries support CUDA 12.4 and 13.3, along with OpenVINO and SYCL
  • Linux binaries support ROCm, OpenVINO, and SYCL for Ubuntu
  • KleidiAI builds are disabled for this release

Release Notes (excerpt)

<details open> server : allow text-only slot save/restore with mtmd (#25076) </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (ROCm 7.2) - Ubuntu x64 (OpenVINO) - Ubuntu x64 (SYCL FP32) - Ubuntu x64 (SYCL FP16) **Android:**…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories