v0.1.7
meituan-longcat/LongCat-Videov0.1.7Mar 23, 2026by chonknick
Upgrading?
AI Summary
Replaces the HuggingFace tokenizer with a custom `tokie` implementation to significantly reduce initialization time and dependencies.
Key Highlights
- 20-50x faster tokenizer initialization
- 260 fewer transitive dependencies
- 100% token-accurate reranking results
- Tokenizer served from CDN
New Features
- Replacement of HuggingFace `tokenizers` with `tokie`
- No runtime dependency on HuggingFace Hub
- Tokenizer hosted at `cdn.mandex.dev/models/tokenizer.tkz`
Full Release Notes
## What's Changed - Replace HuggingFace `tokenizers` with `tokie` for reranking - ~20-50x faster tokenizer initialization (pre-built .tkz from CDN vs JSON parsing) - ~260 fewer transitive dependencies - 100% token-accurate, identical reranking results - No runtime dependency on HuggingFace Hub - Tokenizer served from `cdn.mandex.dev/models/tokenizer.tkz` alongside reranker model
Related Repositories
public-apis/public-apis★ 491,310
A collective list of free APIs
NousResearch/hermes-agent★ 256,156
The agent that grows with you
yt-dlp/yt-dlp★ 200,351
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,617
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,706
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.