b9590

ggml-org/llama.cppb9590Jun 10, 2026by github-actions[bot]3 days after b9553

What changed since b9553

low risk

b9590 fixes LFM2/LFM2.5 chat templates silently ignoring json_schema in response_format; only this change is documented between the two builds.

Bug fixes

  • The LFM2/LFM2.5 specialized template handler now honors json_schema from response_format instead of dropping it.
  • Grammar construction for LFM2 tool-calling was corrected so structured output constraints are actually applied.

Upgrade notes

No config or API changes are required; the fix is transparent to existing callers. If you rely on structured/JSON output with LFM2 or LFM2.5 models, upgrade to get schema enforcement. Note that only this single change is described in the newer release notes, so other commits between b9553 and b9590 are undocumented here.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Bug fix for LFM2/LFM2.5 template handler to ensure JSON schema is respected.

Key Highlights

  • Fixed LFM2 specialized template handler ignoring json_schema from response_format
  • Handler now correctly builds grammar for tool-calling

New Features

  • Tool-calling grammar compliance fix

Release Notes (excerpt)

<details open> chat: fix LFM2/LFM2.5 ignoring json_schema (#24377) The LFM2 specialized template handler only built a grammar for tool-calling, silently ignoring json_schema from response_format. </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (ROCm 7.2)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories