v2.6.1
Gerstep/cybosv2.6.1Aug 28, 2026by github-actions[bot]
Upgrading?
AI Summary
v2.6.1 implements a unified chat-templating renderer using real GGUF templates and retires the legacy shimmy_server_gpu binary to improve prompt accuracy and code cleanliness.
Key Highlights
- Unified chat templating using real GGUF `chat_template` (Jinja) for all API endpoints and CLI.
- Retired legacy `shimmy_server_gpu` binary (1,847 lines deleted).
- Updated Airframe dependency to version 0.4.1.
Breaking Changes
- Retired legacy shimmy_server_gpu server.
New Features
- Offline routing gate for template validation.
- New docs/CHAT_TEMPLATING.md architecture reference.
- Fixed release artifact permissions and naming for platform downloads.
Full Release Notes
## [2.6.1] — 2026-08-28 — Airframe 0.4.1 and Unified Chat Templating ### Highlights - **Single chat-templating renderer.** All paths (HTTP `/api/generate`, OpenAI `/v1/chat/completions` + `/v1/completions`, Anthropic `/v1/messages`, and the CLI `generate`) now render prompts through one `prompt_render` module that uses each model's **real GGUF `chat_template`** (Jinja via shimmyjinja), with a family fallback (ChatML/Llama3/Gemma) and a `--raw` escape for base/completion models. Previously instruct models were fed raw prompts or a coarse ChatML/Llama3/OpenChat heuristic — the root cause of garbled output on Qwen3/Gemma/etc. - **Real GGUF template sourced at load.** `ModelSpec.chat_template` is populated from the GGUF header (airframe metadata), so Jinja-first rendering is automatic. - **shimmyjinja extended** for real templates: slice-with-step (`messages[::-1]`, used by Qwen3 thinking) + Gemma family fallback. - **Offline routing gate.** `tests/gguf_routing.rs` validates template routing for every model in the models dir (no GPU, ~14s) — the cheap per-model "screen test". - **Legacy server retired.** `shimmy_server_gpu` (a dead standalone GPU server with its own template renderer) removed — 1,847 lines deleted. See `CHAT_TEMPLATING.md`. ### Docs - New `docs/CHAT_TEMPLATING.md` — the canonical architecture reference. ### Release - Updated the Airframe dependency to `0.4.1`. - Published Linux x86_64, Windows x86_64, and macOS arm64 binaries. - Corrected release artifact permissions and names so platform downloads are attached to the GitHub release.
Related Repositories
openclaw/openclaw★ 392,694
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,066
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 357,563
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 219,660
The open source coding agent.
n8n-io/n8n★ 208,248
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.