v0.3.0
cheaper-inference/OmniRoutev0.3.0Oct 2, 2026by github-actions[bot]
Upgrading?
AI Summary
Selectively brings upstream Laya runtime fixes into the native MLX port, focusing on conversation handling, truncation logic, and validation improvements.
Key Highlights
- Preserve newest conversation turns under truncation, even with prefix-cached inference.
- Support custom noul labels and boolean criteria keys.
- Add `answer_confidence` while retaining existing `confidence` semantics.
- Update language detection and email cleaning for better multilingual routing.
- Incremental preload improvements and prompt-prefix LRU protection.
New Features
- Improved named input-validation errors.
- Report state truncation and collapsed option spans.
- Preserve Unicode in structured instructions.
- Handle empty or language-neutral hints correctly during preload.
Full Release Notes
This release selectively brings upstream Laya runtime fixes through `4aa6761` into the native MLX port. The neural architecture parity reference remains `573e5b6`; this is not full upstream API parity. Changes: - Preserve the newest conversation turns under truncation, including prefix-cached inference; fix the zero-room left-truncation edge case. - Support custom noul labels and boolean criteria keys; reject criteria keys that would otherwise be silently ignored. - Preserve Unicode in structured instructions and improve named input-validation errors. - Add `answer_confidence` while retaining the existing `confidence` semantics. - Report state truncation and options whose token spans collapse under the question budget. - Update language detection and email cleaning to preserve real requests and improve multilingual routing. - Preserve resident checkpoints during incremental preload and handle empty or language-neutral hints correctly. - Protect the prompt-prefix LRU under concurrent preparation and bound cosine similarity results. Validation: 176 local tests passed, plus 162 upstream email checks and 38 upstream language-statistics checks adapted to the MLX implementation. Lint, formatting, wheel/source-distribution builds, and strict distribution checks passed. Real-checkpoint accuracy and long-running memory benchmarks were not rerun. Maintenance direction: prioritize native MLX implementations of upstream behavior over independent model variants, service APIs, and additional demos. Future `vX.Y.Z` tag pushes now run the test/build/publish workflow and create a GitHub release automatically.
Related Repositories
openclaw/openclaw★ 392,696
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,068
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 357,772
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 219,679
The open source coding agent.
n8n-io/n8n★ 208,252
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.