v2.6.1
astral-sh/ruffv2.6.1Aug 28, 2026by github-actions[bot]
Upgrading?
AI Summary
Implements unified chat templating using real GGUF templates and retires legacy server code.
Key Highlights
- Single chat-templating renderer using real GGUF `chat_template`
- Unified routing gate for offline validation
- Retired `shimmy_server_gpu` (legacy standalone server)
- Extended `shimmyjinja` for real templates
Breaking Changes
- Retired `shimmy_server_gpu` (1,847 lines deleted)
- Unified chat templating replaces previous heuristic rendering
New Features
- Unified chat templating module
- Offline routing gate validation
- Real GGUF template sourcing
Full Release Notes
## [2.6.1] — 2026-08-28 — Airframe 0.4.1 and Unified Chat Templating ### Highlights - **Single chat-templating renderer.** All paths (HTTP `/api/generate`, OpenAI `/v1/chat/completions` + `/v1/completions`, Anthropic `/v1/messages`, and the CLI `generate`) now render prompts through one `prompt_render` module that uses each model's **real GGUF `chat_template`** (Jinja via shimmyjinja), with a family fallback (ChatML/Llama3/Gemma) and a `--raw` escape for base/completion models. Previously instruct models were fed raw prompts or a coarse ChatML/Llama3/OpenChat heuristic — the root cause of garbled output on Qwen3/Gemma/etc. - **Real GGUF template sourced at load.** `ModelSpec.chat_template` is populated from the GGUF header (airframe metadata), so Jinja-first rendering is automatic. - **shimmyjinja extended** for real templates: slice-with-step (`messages[::-1]`, used by Qwen3 thinking) + Gemma family fallback. - **Offline routing gate.** `tests/gguf_routing.rs` validates template routing for every model in the models dir (no GPU, ~14s) — the cheap per-model "screen test". - **Legacy server retired.** `shimmy_server_gpu` (a dead standalone GPU server with its own template renderer) removed — 1,847 lines deleted. See `CHAT_TEMPLATING.md`. ### Docs - New `docs/CHAT_TEMPLATING.md` — the canonical architecture reference. ### Release - Updated the Airframe dependency to `0.4.1`. - Published Linux x86_64, Windows x86_64, and macOS arm64 binaries. - Corrected release artifact permissions and names so platform downloads are attached to the GitHub release.
Related Repositories
farion1231/cc-switch★ 147,222
A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io
rustdesk/rustdesk★ 126,546
An open-source remote desktop application designed for self-hosting, as an alternative to TeamViewer.
tauri-apps/tauri★ 112,094
Build smaller, faster, and more secure desktop and mobile applications with a web frontend.
ruvnet/RuView★ 99,051
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
oven-sh/bun★ 96,338
Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one