v0.1.8
minitap-ai/mobile-usev0.1.8Mar 23, 2026by chonknick
Upgrading?
Release notes summary
Significantly improves reranking performance through multi-threading and optimized model formats.
Key Highlights
- 3.3x faster reranking speed achieved via single rerank pass and multi-threaded inference.
- Uses ORT format for faster deserialization with automatic fallback to .onnx.
- Zero-copy memory-mapped file access via mmap.
New Features
- Reranking performance overhaul (3.3x faster)
- Multi-threaded inference
- ORT format for faster deserialization
Full Release Notes
## What's Changed ### Reranking Performance Overhaul (3.3x faster) - **Single rerank pass** — collect all FTS5 results across packages, rerank once instead of per-package (eliminates redundant ONNX session loads) - **ORT format** — pre-optimized flatbuffer model (`reranker.ort`) for faster deserialization, with automatic fallback to `.onnx` - **mmap model loading** — zero-copy memory-mapped file access via `commit_from_memory_directly` - **Multi-threaded inference** — uses half available cores (capped at 4) for ONNX intra-op parallelism ### Benchmarks | Scenario | v0.1.7 | v0.1.8 | Speedup | |----------|--------|--------|---------| | All packages (11) | 1.01s | **0.31s** | 3.3x | | Single package | 0.09s | **0.04s** | 2.3x |
Related Repositories
public-apis/public-apis★ 491,629
A collective list of free APIs
NousResearch/hermes-agent★ 256,488
The agent that grows with you
yt-dlp/yt-dlp★ 200,877
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,797
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,717
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.