b10328
ggml-org/llama.cppb10328Aug 8, 2026by github-actions[bot]same day as b10327
What changed since b10327
b10328 adds opt-in Docker-based tool isolation for the server, on top of b10327's CUDA quantized-copy kernel fix.
New features
- Server can now run tools inside isolated Docker containers for sandboxing.
- New `x-tool-runtime` configuration option selects the tool isolation method.
- Added a `tools_io_docker` backend alongside the existing sandbox backend.
Improvements
- Tool I/O backends were split into distinct sandbox and Docker implementations for clearer separation.
- Server info reporting was adapted to expose the new tool runtime configuration.
- Python bindings received a type-check fix accompanying the new option.
- Documentation was extended to cover the tool isolation feature.
Upgrade notes
The new isolation support is opt-in: existing deployments keep current behavior unless `x-tool-runtime` is set. Using Docker isolation requires a working Docker runtime on the host. No config migration is needed for users not adopting the feature.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Adds initial support for tool isolation using Docker containers to enhance security and sandboxing.
Key Highlights
- Introduces `x-tool-runtime` configuration option to select isolation methods.
- Tools can now run in Docker containers via the new `tools_io_docker` backend.
- Documentation and configuration updates added to support the new isolation feature.
Release Notes (excerpt)
<details open> server: add initial tool isolation support (via docker) (#26507) * server: add initial tool isolation support (via docker) * add docs * adapt get_info * py: fix type check * cont * separate tools_io_sandbox / tools_io_docker * rename sandbox --> isolate * x-tool-docker --> x-tool-runtime --------- Co-authored-by: Pascal <admin@serveurperso.com> </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system