v0.9.3
webiny/webiny-jsv0.9.3Sep 7, 2026by EricLBuehler
Upgrading?
AI Summary
This release focuses on significant performance improvements through first-class FP8 support and concurrent decoding, alongside server standardization and fixes for multimodal inputs and tool templates.
Key Highlights
- First-class FP8 and concurrent DFlash decode support
- Server error codes aligned to OpenAI standard
- Separate prefill and decode throughput logging
- New NVFP4 checkpoint loading and cuTile Blackwell acceleration
New Features
- Concurrency fixes and scheduler improvements
- Mistral sequences capacity gauge
- Separate prefill and decode t/s logging
- Tool chat template JSON rendering alignment
- NVFP4 checkpoint loading and cuTile Blackwell acceleration
Full Release Notes
## What's Changed * feat(core): concurrency fixes and scheduler improvements by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2389 * perf: first-class FP8 and concurrent DFlash decode by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2390 * feat(metrics): add mistralrs_sequences_capacity gauge by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2391 * perf(core): optimize exact stochastic DFlash serving by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2392 * feat(server): align server error codes to openai standard by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2393 * feat(logging): expose separate prefill and decode t/s logging by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2395 * fix(multimodal): keep Qwen media work out of decode by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2396 * fix(ci): green the build for rust 1.98 and metal by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2397 * feat(core): report cached prompt tokens in usage by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2398 * perf(core): improve hybrid FP8 serving by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2399 * feat(server): improve Anthropic Messages and Claude Code support by @matt-minev in https://github.com/EricLBuehler/mistral.rs/pull/2400 * docs: refresh generated reference artifacts by @matt-minev in https://github.com/EricLBuehler/mistral.rs/pull/2401 * fix(website): fix handling for clipboard by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2403 * perf(cuda): scale FP8 and DFlash2 serving through C128 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2404 * feat(website): add details about v0.9.3 release by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2405 * chore(cuda): clippy by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2406 * feat(release): improve reliability, add caching by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2408 * fix(core): align tool chat template JSON rendering by @atirna in https://github.com/EricLBuehler/mistral.rs/pull/2371 * fix(lfm2): support legacy full_attn_idxs config field by @tugot17 in https://github.com/EricLBuehler/mistral.rs/pull/2305 * fix(webui): send chat images as data URLs (fix HTTP 500 on image send) by @subin9 in https://github.com/EricLBuehler/mistral.rs/pull/2338 * feat(core): bump cutile to v0.3.0 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2410 * feat(core): fp8 tensor-core gemv/gemm, cutile gdn prefill by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2412 * feat(cutile): add fp8 fused moe and a load-time kernel autotuner by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2413 * fix(cuda): restore GB10 builds with cudaforge 0.1.6 by @sizzlecar in https://github.com/EricLBuehler/mistral.rs/pull/2415 * feat(fp8): support ModelOpt and compressed-tensors checkpoints with cutile kernels by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2416 * feat(quant): add NVFP4 checkpoint loading and cuTile Blackwell acceleration by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/2418 ## New Contributors * @atirna made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/2371 * @tugot17 made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/2305 * @subin9 made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/2338 * @sizzlecar made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/2415 **Full Changelog**: https://github.com/EricLBuehler/mistral.rs/compare/v0.9.2...v0.9.3
Related Repositories
openclaw/openclaw★ 392,711
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,078
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 358,602
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 219,745
The open source coding agent.
n8n-io/n8n★ 208,266
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.