b9927

ggml-org/llama.cppb9927Jul 8, 2026by github-actions[bot]same day as b9925

What changed since b9925

medium risk

CLI reimplemented on top of HTTP transport, adding router-mode support and renaming cli-view to cli-ui.

Breaking changes

  • The CLI no longer runs in-process and instead talks to a server over HTTP, so invocations that assumed a purely local, self-contained CLI may need a reachable endpoint.
  • The cli-view component/flag is renamed to cli-ui, which breaks scripts or tooling referencing the old name.
  • JSON was removed from the CLI header, so any consumer parsing that header output will need to adapt.

New features

  • CLI can now operate in router mode, including the single-model router case.
  • CLI works against remote servers over HTTP, not just a local instance.
  • Model aliases are now displayed in the CLI UI.

Improvements

  • CLI internals refactored with a pimpl layout and destructor-based cleanup for cleaner resource handling.
  • Header output simplified by dropping embedded JSON.
  • Minor code cleanups and removal of an outdated comment.

Upgrade notes

If you script against the CLI, verify it can reach an HTTP server (local or remote) since the transport changed from in-process to HTTP. Update any references to cli-view to cli-ui and stop parsing JSON from the CLI header. Router-mode users should test the single-model case explicitly.

Analyzed Oct 31, 2026

Upgrading?

Release notes summary

Migrates the CLI implementation to use HTTP communication, supporting router mode and improved UI display.

Key Highlights

  • CLI moved to HTTP-based implementation
  • Added support for router mode
  • Renamed CLI-view to CLI-ui
  • Removed JSON from header
  • Shows model aliases

Release Notes (excerpt)

<details open> cli : move to HTTP-based implementation (#24948) * cli: move to HTTP-based implementation * wip * working * remote server ok * cli support router mode Co-authored-by: Piotr Wilkin <ilintar@gmail.com> * case: router with only one model * Apply suggestions from code review Co-authored-by: Piotr Wilkin (ilintar) <piotr.wilkin@syndatis.com> * remove outdated comment * use destructor instead * add ftype * cli-view --> cli-ui * pimpl * no more json in header…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories