v4.8.1

inboundemail/inboundv4.8.1Aug 6, 2026by mudler

AI Summary

This release addresses stability issues including VRAM handling for malformed metadata, React UI crashes, and vLLM-CPP compatibility. It also adds new model variants to the gallery.

Key Highlights

Fixed VRAM handling for malformed GGUF metadata
Fixed React UI crashes when switching trace tabs
Added Qwen3.5 9B variants to the gallery
Wired full engine config surface through engine_args for vLLM-CPP
Fixed vLLM-CPP engine loading by mirroring ABI v10

New Features

Full engine config surface for vLLM-CPP
Qwen3.5 9B gallery variants (HauhauCS and Defiant Fable)
React UI stability fixes

Full Release Notes

<!-- Release notes generated using configuration in .github/release.yml at master -->

## What's Changed
### Other Changes
* docs(blog): cover the terminal agent in the 4.8 post by @localai-bot in https://github.com/mudler/LocalAI/pull/11372
* fix(vram): contain malformed GGUF metadata by @richiejp in https://github.com/mudler/LocalAI/pull/11374
* docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/11377
* chore: :arrow_up: Update 0xShug0/audio.cpp to `7efbb58def443722ea540d931dd3debee3e4d5e8` by @localai-bot in https://github.com/mudler/LocalAI/pull/11378
* chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `cf1aa57e1a0fabfd015831718fc99d1aec01ada5` by @localai-bot in https://github.com/mudler/LocalAI/pull/11380
* chore: :arrow_up: Update leejet/stable-diffusion.cpp to `c6beeef35526c6dc94b74a7fb69f9d2e6a2a7a12` by @localai-bot in https://github.com/mudler/LocalAI/pull/11384
* chore: :arrow_up: Update CrispStrobe/CrispASR to `21901d3f7c23554f072964828363e49ddbc2dc68` by @localai-bot in https://github.com/mudler/LocalAI/pull/11383
* fix(vllm-cpp): mirror the engine's ABI v10 so the backend loads again by @localai-bot in https://github.com/mudler/LocalAI/pull/11386
* fix(react-ui): stop traces page crash when switching trace tabs by @nandanadileep in https://github.com/mudler/LocalAI/pull/11387
* chore: :arrow_up: Update antirez/ds4 to `b0309611041655f4e45671cfd9c9886aff161406` by @localai-bot in https://github.com/mudler/LocalAI/pull/11381
* chore(model-gallery): :arrow_up: update checksum by @localai-bot in https://github.com/mudler/LocalAI/pull/11382
* gallery: add Qwen3.5 9B HauhauCS variants by @localai-org-maint-bot in https://github.com/mudler/LocalAI/pull/11339
* gallery: add Qwen3.5 9B Defiant Fable variants by @localai-org-maint-bot in https://github.com/mudler/LocalAI/pull/11335
* feat(vllm-cpp): wire the full engine config surface through engine_args by @localai-bot in https://github.com/mudler/LocalAI/pull/11159
* fix(react-ui): restore 3D Studio results and history by @richiejp in https://github.com/mudler/LocalAI/pull/11393
* fix(cli): ignore a half-populated socket activation environment by @localai-bot in https://github.com/mudler/LocalAI/pull/11394


**Full Changelog**: https://github.com/mudler/LocalAI/compare/v4.8.0...v4.8.1