v4.3.5
mudler/LocalAIv4.3.5May 29, 2026by mudler
AI Summary
Focuses on fixing tool-call streaming issues, improving shutdown behavior, and adding reasoning effort support.
Key Highlights
- Fixed tool-call JSON leaks into content with stream+tools on tokenizer-template models
- Fixed streaming tool-call double-emission when autoparser is active
- Added per-request reasoning_effort support for chat completions
- Improved backend process shutdown behavior
New Features
- feat(reasoning): honor per-request reasoning_effort on chat completions
Full Release Notes
<!-- Release notes generated using configuration in .github/release.yml at master --> ## What's Changed ### Bug fixes :bug: * fix: tool-call JSON leaks into content with stream+tools on tokenizer-template models (#10052) by @localai-bot in https://github.com/mudler/LocalAI/pull/10057 * fix(openai): stop streaming tool-call double-emission when autoparser is active by @bozhouDev in https://github.com/mudler/LocalAI/pull/10055 * fix(application): stop backend processes synchronously on shutdown by @richiejp in https://github.com/mudler/LocalAI/pull/10058 * fix(functions): validate auto-detected XML tool-call names — robust glm-4.5/Hermes guard (#9722, supersedes #9940) by @localai-bot in https://github.com/mudler/LocalAI/pull/10059 * fix(model): track intentional stops, stop misreading clean shutdowns as crashes by @richiejp in https://github.com/mudler/LocalAI/pull/10060 ### Exciting New Features 🎉 * feat(reasoning): honor per-request reasoning_effort on chat completions by @localai-bot in https://github.com/mudler/LocalAI/pull/10082 ### Other Changes * chore: :arrow_up: Update mudler/rf-detr.cpp to `ecf64d7f7f20d73ebd906a983f398ed287256320` by @localai-bot in https://github.com/mudler/LocalAI/pull/10035 * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/10046 * chore: :arrow_up: Update antirez/ds4 to `22393e770ea8eb7501d8718d6f66c6374004e03f` by @localai-bot in https://github.com/mudler/LocalAI/pull/10047 * chore: :arrow_up: Update leejet/stable-diffusion.cpp to `0e4ee04488159b81d95a9ffcd983a077fd5dcb77` by @localai-bot in https://github.com/mudler/LocalAI/pull/10048 * chore: :arrow_up: Update ggml-org/llama.cpp to `751ebd17a58a8a513994509214373bb9e6a3d66c` by @localai-bot in https://github.com/mudler/LocalAI/pull/10049 * chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `6eff055a0cc0e427a6849cfcb5de531b4b82d667` by @localai-bot in https://github.com/mudler/LocalAI/pull/10050 * chore: :arrow_up: Update ggml-org/whisper.cpp to `c932729a304f7d9eb5354afa38624cfa86a780cf` by @localai-bot in https://github.com/mudler/LocalAI/pull/10051 * test(react-ui): cover models gallery empty-state reset flow by @Oceankj in https://github.com/mudler/LocalAI/pull/10019 * test(utils): cover path verification, sanitization, and unique naming by @TLoE419 in https://github.com/mudler/LocalAI/pull/9978 * chore(model gallery): :robot: add 1 new models via gallery agent by @localai-bot in https://github.com/mudler/LocalAI/pull/10061 * chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `8960c5ba5ee9db30ba838304373aa4dbec9f7cbd` by @localai-bot in https://github.com/mudler/LocalAI/pull/10077 * chore: :arrow_up: Update vllm-project/vllm cu130 wheel to `0.22.0` by @localai-bot in https://github.com/mudler/LocalAI/pull/10079 * chore(model-gallery): :arrow_up: update checksum by @localai-bot in https://github.com/mudler/LocalAI/pull/10081 * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/10074 * chore: :arrow_up: Update mudler/rf-detr.cpp to `65c0ffcc9a9bc9dae38252f63d0417c9845a6cf7` by @localai-bot in https://github.com/mudler/LocalAI/pull/10075 * chore: :arrow_up: Update ggml-org/whisper.cpp to `f24588a272ae8e23280d9c220536437164e6ed28` by @localai-bot in https://github.com/mudler/LocalAI/pull/10078 ## New Contributors * @bozhouDev made their first contribution in https://github.com/mudler/LocalAI/pull/10055 * @Oceankj made their first contribution in https://github.com/mudler/LocalAI/pull/10019 * @TLoE419 made their first contribution in https://github.com/mudler/LocalAI/pull/9978 **Full Changelog**: https://github.com/mudler/LocalAI/compare/v4.3.4...v4.3.5