Starstruk Logo MarkStarstruk

v0.1.7

shader-effects-inc/shadersv0.1.7Mar 23, 2026by chonknick

Upgrading?

What changed from 2.2.362 → v0.1.7?What's new in v0.1.8 after v0.1.7?

AI Summary

Replaces the HuggingFace tokenizer library with tokie to significantly reduce initialization time and dependencies.

Key Highlights

  • 20-50x faster tokenizer initialization
  • 260 fewer transitive dependencies
  • No runtime dependency on HuggingFace Hub

New Features

  • tokie tokenizer replacement

Full Release Notes

## What's Changed

- Replace HuggingFace `tokenizers` with `tokie` for reranking
  - ~20-50x faster tokenizer initialization (pre-built .tkz from CDN vs JSON parsing)
  - ~260 fewer transitive dependencies
  - 100% token-accurate, identical reranking results
  - No runtime dependency on HuggingFace Hub
- Tokenizer served from `cdn.mandex.dev/models/tokenizer.tkz` alongside reranker model

Related Repositories

openclaw/openclaw★ 392,738

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

nilbuild/developer-roadmap★ 370,113

Interactive roadmaps, guides and other educational content to help developers grow in their careers.

morluto/rea★ 362,227

Reverse engineer anything with agents, from app behavior down to native binaries.

anomalyco/opencode★ 219,962

The open source coding agent.

n8n-io/n8n★ 208,304

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.