v0.1.7
cheaper-inference/OmniRoutev0.1.7Mar 23, 2026by chonknick
Upgrading?
AI Summary
Replaced the HuggingFace tokenizers library with `tokie` to achieve massive performance improvements in reranking, reducing initialization time and dependencies while maintaining 100% accuracy.
Key Highlights
- ~20-50x faster tokenizer initialization
- ~260 fewer transitive dependencies
- 100% token-accurate reranking results
- No runtime dependency on HuggingFace Hub
New Features
- Replaced `tokenizers` with `tokie`
- Tokenizer served from cdn.mandex.dev/models/tokenizer.tkz
Full Release Notes
## What's Changed - Replace HuggingFace `tokenizers` with `tokie` for reranking - ~20-50x faster tokenizer initialization (pre-built .tkz from CDN vs JSON parsing) - ~260 fewer transitive dependencies - 100% token-accurate, identical reranking results - No runtime dependency on HuggingFace Hub - Tokenizer served from `cdn.mandex.dev/models/tokenizer.tkz` alongside reranker model
Related Repositories
openclaw/openclaw★ 392,786
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,160
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 365,972
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 220,197
The open source coding agent.
n8n-io/n8n★ 208,350
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.