Starstruk Logo MarkStarstruk

runtime-llamacpp-v0.1.4

zaidmukaddam/sciraruntime-llamacpp-v0.1.4Jun 29, 2026by LauraGPT

AI Summary

A runtime update providing prebuilt binaries for the FunASR llama.cpp engine. This release adds explicit AVX2 assets for faster performance while maintaining conservative x64 assets for maximum CPU compatibility.

Key Highlights

  • Added explicit `x64-avx2` assets for CPUs with AVX2/FMA/F16C/BMI2
  • Kept default x64 assets conservative for maximum CPU compatibility
  • Recommended for users who found v0.1.3 too slow
  • Prebuilt self-contained binaries for SenseVoice and Paraformer

Full Release Notes

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime.

This release keeps the default x64 assets conservative for maximum CPU compatibility and adds explicit `x64-avx2` assets for CPUs with AVX2/FMA/F16C/BMI2. If v0.1.3 fixed SIGILL but was too slow on your machine, try `funasr-llamacpp-windows-x64-avx2.zip`.

Use the default x64 package if the AVX2 package fails with `Illegal instruction` / `SIGILL`.