b9594

ggml-org/llama.cppb9594Jun 11, 2026by github-actions[bot]same day as b9592

What changed since b9592

low risk

Vocab normalizer flags refactored into an options struct with a new strip_accents option; no CLI-facing changes.

Breaking changes

  • The normalizer flags in src/llama-vocab.h were consolidated into an options struct, so any downstream code that referenced the old individual flag fields directly will need to be updated.

New features

  • Added a strip_accents option to the vocabulary normalizer for accent-insensitive token normalization.

Improvements

  • Normalizer configuration is now grouped in a dedicated options struct, making the vocab code easier to extend and maintain.
  • KleidiAI-enabled macOS Apple Silicon builds remain disabled, consistent with the previous release.

Upgrade notes

This is a small internal refactor plus one new normalizer option, so a rebuild is generally all that is required. If you compile against llama.cpp's internal headers (e.g. llama-vocab.h) rather than the public API, update any code touching the old normalizer flag fields to use the new options struct. The strip_accents behavior is not surfaced as a CLI flag in these notes, so verify exposure in your integration before relying on it.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Refactoring of vocabulary normalizer flags to improve code structure and add new options.

Key Highlights

  • Refactored normalizer flags into a dedicated options struct
  • Added strip_accents flag to vocabulary normalizer
  • Disabled KleidiAI enabled builds for macOS Apple Silicon

Release Notes (excerpt)

<details open> vocab : refactor normalizer flags into options struct, add strip_accents (#24371) * vocab : refactor normalizer flags into options struct, add strip_accents * Update src/llama-vocab.h Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> * Update src/llama-vocab.cpp Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> --------- Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> </details> **macOS/iOS:** - macOS Apple Silicon (arm64)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories