b10328

ggml-org/llama.cppb10328Aug 8, 2026by github-actions[bot]same day as b10327

What changed since b10327

medium risk

b10328 adds opt-in Docker-based tool isolation for the server, on top of b10327's CUDA quantized-copy kernel fix.

New features

  • Server can now run tools inside isolated Docker containers for sandboxing.
  • New `x-tool-runtime` configuration option selects the tool isolation method.
  • Added a `tools_io_docker` backend alongside the existing sandbox backend.

Improvements

  • Tool I/O backends were split into distinct sandbox and Docker implementations for clearer separation.
  • Server info reporting was adapted to expose the new tool runtime configuration.
  • Python bindings received a type-check fix accompanying the new option.
  • Documentation was extended to cover the tool isolation feature.

Upgrade notes

The new isolation support is opt-in: existing deployments keep current behavior unless `x-tool-runtime` is set. Using Docker isolation requires a working Docker runtime on the host. No config migration is needed for users not adopting the feature.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Adds initial support for tool isolation using Docker containers to enhance security and sandboxing.

Key Highlights

  • Introduces `x-tool-runtime` configuration option to select isolation methods.
  • Tools can now run in Docker containers via the new `tools_io_docker` backend.
  • Documentation and configuration updates added to support the new isolation feature.

Release Notes (excerpt)

<details open> server: add initial tool isolation support (via docker) (#26507) * server: add initial tool isolation support (via docker) * add docs * adapt get_info * py: fix type check * cont * separate tools_io_sandbox / tools_io_docker * rename sandbox --> isolate * x-tool-docker --> x-tool-runtime --------- Co-authored-by: Pascal <admin@serveurperso.com> </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories