b9688
ggml-org/llama.cppb9688Jun 17, 2026by github-actions[bot]same day as b9687
What changed since b9687
Server Router gains a model management API with download/delete endpoints and SSE real-time updates, plus crash fixes.
New features
- Server Router now exposes a model management API for listing and managing models.
- New endpoints allow downloading models through the router.
- New endpoints allow deleting models through the router.
- SSE-based real-time update stream added to the router API.
- Documentation and tests were added alongside the new router endpoints.
Improvements
- Router stability hardened by addressing std::terminate paths.
- Multiple crash scenarios in the new API were fixed during development.
- Test coverage expanded for the router model management endpoints.
Bug fixes
- Fixed a std::terminate condition in the server router.
- Resolved crash issues found while exercising the new management API.
Upgrade notes
This is a small step from b9687 to b9688 with no breaking changes; existing CLI and server behavior is unaffected. If you rely on the Server Router, review the updated API docs to adopt the new download/delete and SSE endpoints. No config migration is required.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Expands the Server Router with a comprehensive model management API, including endpoints for downloading, deleting models, and real-time SSE updates.
Key Highlights
- Model management API (download/delete)
- SSE real-time updates API
- Crash fixes and stability improvements
Release Notes (excerpt)
<details open> server: (router) add model management API (#23976) * wip * server: (router) add SSE realtime updates API * nits * wip * add download API * add download api * update docs * add delete endpoint * fix std::terminate * fix crash * fix 2 * add tests * nits </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system