v4.3.2

mudler/LocalAIv4.3.2May 27, 2026by mudler

AI Summary

Feature-rich release with distributed mode improvements, new object detection backend, and UI enhancements.

Key Highlights

  • New model routing, PII filtering, and cloud model proxy features
  • Added rfdetr-cpp native object detection and segmentation backend
  • New 'Fits in my GPU' filter in the Install Models UI
  • Enhanced distributed mode with per-request replica routing

New Features

  • Model routing middleware
  • PII filtering
  • Cloud model proxy support
  • rfdetr-cpp object detection backend
  • GPU filter for model installation

Full Release Notes

<!-- Release notes generated using configuration in .github/release.yml at master -->

## What's Changed
### 👒 Dependencies
* chore(deps): bump github.com/nats-io/nats.go from 1.50.0 to 1.52.0 by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/10003
* chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.19.15 to 1.19.17 by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/10008
* chore(deps): bump actions/stale from 10.2.0 to 10.3.0 by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/10002
* chore(deps): bump sentence-transformers from 5.5.0 to 5.5.1 in /backend/python/transformers by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/10007
* chore(deps): update transformers requirement from >=5.8.1 to >=5.9.0 in /backend/python/transformers by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/10005
* chore(deps): bump protobuf from 6.33.5 to 7.35.0 in /backend/python/transformers by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/10004
### Other Changes
* feat(middleware): Model routing, PII filtering, Cloud model proxies by @richiejp in https://github.com/mudler/LocalAI/pull/9802
* fix(intel): VRAM detection by @richiejp in https://github.com/mudler/LocalAI/pull/9944
* feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) by @localai-bot in https://github.com/mudler/LocalAI/pull/9976
* fix(distributed): persist per-model load info so reconciler survives frontend restart by @localai-bot in https://github.com/mudler/LocalAI/pull/9981
* feat(stablediffusion-ggml): LTX-2 support + LTX-2.3 GGUF gallery entries by @localai-bot in https://github.com/mudler/LocalAI/pull/9980
* fix(distributed): sync gallery OpCache + caches across frontend replicas by @localai-bot in https://github.com/mudler/LocalAI/pull/9983
* fix(gallery/ltx-2.3): add diffusion_model flag to all variants by @mudler in https://github.com/mudler/LocalAI/pull/9986
* fix(gallery/ltx-2.3): add vae_decode_only:false for i2v / flf2v by @mudler in https://github.com/mudler/LocalAI/pull/9987
* fix(reasoning): stop <think> leaking into content when autoparser is in pure-content mode by @localai-bot in https://github.com/mudler/LocalAI/pull/9991
* fix(stablediffusion-ggml): mux LTX-2 audio into output MP4 by @localai-bot in https://github.com/mudler/LocalAI/pull/9990
* feat(swagger): update swagger by @localai-bot in https://github.com/mudler/LocalAI/pull/9992
* docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/9993
* fix(streaming/tools): stop healing-marker stubs from gating off content by @localai-bot in https://github.com/mudler/LocalAI/pull/9999
* chore: :arrow_up: Update antirez/ds4 to `ad0209f6a4b067574d2b4afe896c08c177156b31` by @localai-bot in https://github.com/mudler/LocalAI/pull/9996
* chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `b4e1d916c5ec7e75ea3c124dd090425a99fc613f` by @localai-bot in https://github.com/mudler/LocalAI/pull/9995
* chore: :arrow_up: Update leejet/stable-diffusion.cpp to `1ceb5bd9df7784bcdf67dd9ed8bf0198b542ebc9` by @localai-bot in https://github.com/mudler/LocalAI/pull/9994
* chore: :arrow_up: Update ggml-org/whisper.cpp to `e0fd1f6787a5bd4a4957dd97c5b64df882ee7b0c` by @localai-bot in https://github.com/mudler/LocalAI/pull/9997
* fix(streaming/tools): don't leak prefill-misclassified content as trailing reasoning chunk by @localai-bot in https://github.com/mudler/LocalAI/pull/10000
* chore: :arrow_up: Update ggml-org/llama.cpp to `35c9b1f39ebe5a7bb83986d64415a079218be78d` by @localai-bot in https://github.com/mudler/LocalAI/pull/9998
* chore(model gallery): :robot: add 1 new models via gallery agent by @localai-bot in https://github.com/mudler/LocalAI/pull/10011
* fix(dockerignore): exclude local-only artifacts from build context by @richiejp in https://github.com/mudler/LocalAI/pull/10015
* chore(model gallery): :robot: add 1 new models via gallery agent by @localai-bot in https://github.com/mudler/LocalAI/pull/10016
* test: add Go + React UI coverage gates and fill test gaps by @richiejp in https://github.com/mudler/LocalAI/pull/9989
* fix(qwen-asr): enable timestamp output when forced_aligner is configured by @fqscfqj in https://github.com/mudler/LocalAI/pull/10013
* fix(nemo): extract Hypothesis.text for TDT/RNNT ASR models by @fqscfqj in https://github.com/mudler/LocalAI/pull/10012
* chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `d2da6da05c73aeb658a3d1751f386c24e6963856` by @localai-bot in https://github.com/mudler/LocalAI/pull/10020
* chore: :arrow_up: Update ggml-org/whisper.cpp to `27101c01dcac1676e2b6422256233cd0f1f9ae28` by @localai-bot in https://github.com/mudler/LocalAI/pull/10021
* chore: :arrow_up: Update ggml-org/llama.cpp to `0d18aaa9d1a8af3df9abccd828e22eeaac7f840b` by @localai-bot in https://github.com/mudler/LocalAI/pull/10022
* chore: :arrow_up: Update leejet/stable-diffusion.cpp to `92dc7268fc4ffb0c0cc0bd52dfcefea91326e797` by @localai-bot in https://github.com/mudler/LocalAI/pull/10023
* chore: :arrow_up: Update antirez/ds4 to `e8e8779b261c10f36ad6270ba732c8f0be5b62e3` by @localai-bot in https://github.com/mudler/LocalAI/pull/10024
* UI: add 'Fits in my GPU' filter on Install Models by @siddimore in https://github.com/mudler/LocalAI/pull/10017
* fix(react-ui): share single /api/operations poller across consumers by @localai-bot in https://github.com/mudler/LocalAI/pull/10029
* feat(backend): rfdetr-cpp native object detection + segmentation backend by @localai-bot in https://github.com/mudler/LocalAI/pull/10028
* fix(react-ui): polish 'Fits in my GPU' filter to use design-system Toggle by @localai-bot in https://github.com/mudler/LocalAI/pull/10030
* fix(react-ui): force .check() on hidden Toggle input in fits-filter e2e by @localai-bot in https://github.com/mudler/LocalAI/pull/10031

## New Contributors
* @fqscfqj made their first contribution in https://github.com/mudler/LocalAI/pull/10013

**Full Changelog**: https://github.com/mudler/LocalAI/compare/v4.3.1...v4.3.2