runtime-llamacpp-v0.1.4
Mintplex-Labs/anything-llmruntime-llamacpp-v0.1.4Jun 29, 2026by LauraGPT
AI Summary
Runtime update adding AVX2 optimized assets for better performance on compatible CPUs.
Key Highlights
- AVX2 asset support
- Conservative default assets
New Features
- Explicit AVX2 assets for CPUs with AVX2/FMA/F16C/BMI2
- Default x64 assets maintained for maximum compatibility
Full Release Notes
Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime. This release keeps the default x64 assets conservative for maximum CPU compatibility and adds explicit `x64-avx2` assets for CPUs with AVX2/FMA/F16C/BMI2. If v0.1.3 fixed SIGILL but was too slow on your machine, try `funasr-llamacpp-windows-x64-avx2.zip`. Use the default x64 package if the AVX2 package fails with `Illegal instruction` / `SIGILL`.