v4.8.1

kaifcodec/user-scannerv4.8.1Aug 6, 2026by mudler

Upgrading?

AI Summary

This patch release fixes VRAM handling for malformed metadata, restores 3D Studio results, updates GGUF backends, and adds Qwen3.5 variants to the model gallery.

Key Highlights

  • Qwen3.5 9B variants (HauhauCS and Defiant Fable) are added to the gallery.
  • vllm-cpp ABI compatibility is fixed by mirroring the engine's ABI v10.
  • VRAM metadata handling is corrected to contain malformed GGUF metadata.
  • 3D Studio results and history are restored after a previous crash fix.
  • Various GGUF backends (audio.cpp, ik_llama.cpp, stable-diffusion.cpp) are updated.

New Features

  • Qwen3.5 9B model variants
  • Full engine config surface wired through engine_args for vllm-cpp
  • Fixed vllm-cpp backend loading
  • Restored 3D Studio results and history

Full Release Notes

<!-- Release notes generated using configuration in .github/release.yml at master -->

## What's Changed
### Other Changes
* docs(blog): cover the terminal agent in the 4.8 post by @localai-bot in https://github.com/mudler/LocalAI/pull/11372
* fix(vram): contain malformed GGUF metadata by @richiejp in https://github.com/mudler/LocalAI/pull/11374
* docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/11377
* chore: :arrow_up: Update 0xShug0/audio.cpp to `7efbb58def443722ea540d931dd3debee3e4d5e8` by @localai-bot in https://github.com/mudler/LocalAI/pull/11378
* chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `cf1aa57e1a0fabfd015831718fc99d1aec01ada5` by @localai-bot in https://github.com/mudler/LocalAI/pull/11380
* chore: :arrow_up: Update leejet/stable-diffusion.cpp to `c6beeef35526c6dc94b74a7fb69f9d2e6a2a7a12` by @localai-bot in https://github.com/mudler/LocalAI/pull/11384
* chore: :arrow_up: Update CrispStrobe/CrispASR to `21901d3f7c23554f072964828363e49ddbc2dc68` by @localai-bot in https://github.com/mudler/LocalAI/pull/11383
* fix(vllm-cpp): mirror the engine's ABI v10 so the backend loads again by @localai-bot in https://github.com/mudler/LocalAI/pull/11386
* fix(react-ui): stop traces page crash when switching trace tabs by @nandanadileep in https://github.com/mudler/LocalAI/pull/11387
* chore: :arrow_up: Update antirez/ds4 to `b0309611041655f4e45671cfd9c9886aff161406` by @localai-bot in https://github.com/mudler/LocalAI/pull/11381
* chore(model-gallery): :arrow_up: update checksum by @localai-bot in https://github.com/mudler/LocalAI/pull/11382
* gallery: add Qwen3.5 9B HauhauCS variants by @localai-org-maint-bot in https://github.com/mudler/LocalAI/pull/11339
* gallery: add Qwen3.5 9B Defiant Fable variants by @localai-org-maint-bot in https://github.com/mudler/LocalAI/pull/11335
* feat(vllm-cpp): wire the full engine config surface through engine_args by @localai-bot in https://github.com/mudler/LocalAI/pull/11159
* fix(react-ui): restore 3D Studio results and history by @richiejp in https://github.com/mudler/LocalAI/pull/11393
* fix(cli): ignore a half-populated socket activation environment by @localai-bot in https://github.com/mudler/LocalAI/pull/11394


**Full Changelog**: https://github.com/mudler/LocalAI/compare/v4.8.0...v4.8.1

Related Repositories