b9688

ggml-org/llama.cppb9688Jun 17, 2026by github-actions[bot]same day as b9687

What changed since b9687

medium risk

Server Router gains a model management API with download/delete endpoints and SSE real-time updates, plus crash fixes.

New features

  • Server Router now exposes a model management API for listing and managing models.
  • New endpoints allow downloading models through the router.
  • New endpoints allow deleting models through the router.
  • SSE-based real-time update stream added to the router API.
  • Documentation and tests were added alongside the new router endpoints.

Improvements

  • Router stability hardened by addressing std::terminate paths.
  • Multiple crash scenarios in the new API were fixed during development.
  • Test coverage expanded for the router model management endpoints.

Bug fixes

  • Fixed a std::terminate condition in the server router.
  • Resolved crash issues found while exercising the new management API.

Upgrade notes

This is a small step from b9687 to b9688 with no breaking changes; existing CLI and server behavior is unaffected. If you rely on the Server Router, review the updated API docs to adopt the new download/delete and SSE endpoints. No config migration is required.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Expands the Server Router with a comprehensive model management API, including endpoints for downloading, deleting models, and real-time SSE updates.

Key Highlights

  • Model management API (download/delete)
  • SSE real-time updates API
  • Crash fixes and stability improvements

Release Notes (excerpt)

<details open> server: (router) add model management API (#23976) * wip * server: (router) add SSE realtime updates API * nits * wip * add download API * add download api * update docs * add delete endpoint * fix std::terminate * fix crash * fix 2 * add tests * nits </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories