b9870
ggml-org/llama.cppb9870Jul 3, 2026by github-actions[bot]same day as b9867
What changed since b9867
b9870 fixes StepFun chat parser long-reasoning loops by trimming messages before rendering; no breaking changes.
New features
- StepFun chat parsing now trims content parts before rendering, improving stability with long reasoning outputs.
Improvements
- Trim workaround moved ahead of message rendering so per-part whitespace remains reachable.
- Trimming now applies to content_parts text in addition to string content and reasoning_content.
- Removed a duplicate chat template as part of the parser cleanup.
Bug fixes
- Resolved infinite/long reasoning loops in chat caused by oversized StepFun parser input.
- Fixed whitespace handling in concatenated content parts that previously prevented effective trimming.
- Added a content-parts regression test to guard against recurrence.
Upgrade notes
This is a narrow chat-parser fix for StepFun models; no config or API changes are required. Users running StepFun models with long reasoning output should upgrade to avoid looping behavior. The DFlash speculative decoding parameters introduced in b9867 remain unchanged.
Analyzed Oct 28, 2026
Upgrading?
Release notes summary
Fixes long reasoning loops in chat by trimming messages sent to the StepFun parser. The trimming is applied before rendering to content parts.
Key Highlights
- Fixes infinite loops caused by long reasoning content
- Trims content parts before rendering in StepFun parser
- Adds regression tests for content parts
- Addresses issues with whitespace in concatenated parts
Release Notes (excerpt)
<details open> chat: trim messages sent to StepFun parser (fixes long reasoning loops) (#25238) * chat: trim messages sent to StepFun parser (fixes long reasoning loops) * add regression test; remove duplicate template * chat: trim StepFun content parts before rendering The StepFun trim workaround ran on the already-rendered messages, where typed content parts have been concatenated into a single string, so the per-part whitespace could no longer be reached. Move the trim ahead of…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system