v4.4.1
DioxusLabs/dioxusv4.4.1Jun 11, 2026by mudler
AI Summary
A patch release that restores compatibility with newer versions of VLLM and introduces streaming capabilities to the realtime API pipeline.
Key Highlights
- Restores compatibility with VLLM >= 0.22 by moving tokenizer imports.
- Adds streaming capabilities to the LLM, TTS, and transcription pipeline stages in realtime mode.
- Fixes documentation links related to the realtime page.
New Features
- Realtime streaming pipeline for LLM/TTS/transcription stages
Full Release Notes
<!-- Release notes generated using configuration in .github/release.yml at master --> ## What's Changed ### Other Changes * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/10245 * chore: :arrow_up: Update antirez/ds4 to `8384adf0f9fa0f3bb342dd925372de778b95b263` by @localai-bot in https://github.com/mudler/LocalAI/pull/10242 * fix(vllm): restore compatibility with vLLM >= 0.22 (get_tokenizer moved to vllm.tokenizers) by @pos-ei-don in https://github.com/mudler/LocalAI/pull/10252 * feat(realtime): stream the LLM / TTS / transcription pipeline stages by @localai-bot in https://github.com/mudler/LocalAI/pull/10176 * docs: fix broken relref to realtime page by @localai-bot in https://github.com/mudler/LocalAI/pull/10255 ## New Contributors * @pos-ei-don made their first contribution in https://github.com/mudler/LocalAI/pull/10252 **Full Changelog**: https://github.com/mudler/LocalAI/compare/v4.4.0...v4.4.1