b9927
ggml-org/llama.cppb9927Jul 8, 2026by github-actions[bot]same day as b9925
What changed since b9925
CLI reimplemented on top of HTTP transport, adding router-mode support and renaming cli-view to cli-ui.
Breaking changes
- The CLI no longer runs in-process and instead talks to a server over HTTP, so invocations that assumed a purely local, self-contained CLI may need a reachable endpoint.
- The cli-view component/flag is renamed to cli-ui, which breaks scripts or tooling referencing the old name.
- JSON was removed from the CLI header, so any consumer parsing that header output will need to adapt.
New features
- CLI can now operate in router mode, including the single-model router case.
- CLI works against remote servers over HTTP, not just a local instance.
- Model aliases are now displayed in the CLI UI.
Improvements
- CLI internals refactored with a pimpl layout and destructor-based cleanup for cleaner resource handling.
- Header output simplified by dropping embedded JSON.
- Minor code cleanups and removal of an outdated comment.
Upgrade notes
If you script against the CLI, verify it can reach an HTTP server (local or remote) since the transport changed from in-process to HTTP. Update any references to cli-view to cli-ui and stop parsing JSON from the CLI header. Router-mode users should test the single-model case explicitly.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
Migrates the CLI implementation to use HTTP communication, supporting router mode and improved UI display.
Key Highlights
- CLI moved to HTTP-based implementation
- Added support for router mode
- Renamed CLI-view to CLI-ui
- Removed JSON from header
- Shows model aliases
Release Notes (excerpt)
<details open> cli : move to HTTP-based implementation (#24948) * cli: move to HTTP-based implementation * wip * working * remote server ok * cli support router mode Co-authored-by: Piotr Wilkin <ilintar@gmail.com> * case: router with only one model * Apply suggestions from code review Co-authored-by: Piotr Wilkin (ilintar) <piotr.wilkin@syndatis.com> * remove outdated comment * use destructor instead * add ftype * cli-view --> cli-ui * pimpl * no more json in header…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system