b10182

ggml-org/llama.cppb10182Jul 29, 2026by github-actions[bot]same day as b10181

What changed since b10181

high risk

Sampling refactor moves suppress_tokens into common/sampling and removes the has_logit_bias flag, a breaking API change.

Breaking changes

  • The `has_logit_bias` flag has been removed from the API, so any caller or binding that sets or reads it will fail to compile or behave incorrectly.
  • suppress_tokens handling now lives in common/sampling rather than the core llama layer, so code that relied on the old location or call path must be updated.

New features

  • Token suppression logic is now consolidated in the common/sampling module, giving a single place to configure suppress_tokens.

Improvements

  • Security vulnerabilities in the sampling/suppress_tokens path were addressed.
  • Sampling architecture is cleaner after moving suppress_tokens out of the core llama code.

Upgrade notes

Remove any use of `has_logit_bias` from your code and downstream bindings before upgrading, since it is gone with no replacement flag mentioned. If you set suppress_tokens through the previous API surface, verify it still routes through common/sampling. The prior CUDA MMQ low-shared-memory fix from b10181 remains in this build, so no GPU action is needed.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Refactors token suppression logic into the sampling module and addresses security vulnerabilities by removing the `has_logit_bias` flag.

Key Highlights

  • Refactoring of suppress_tokens handling
  • Security vulnerability fixes
  • Removal of `has_logit_bias` flag

Release Notes (excerpt)

<details open> llama: move suppress_tokens handling to common/sampling (#26276) * llama: move suppress_tokens handling to common/sampling * address security issues * rm has_logit_bias </details> **Website:** - <https://llama.app> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories