runtime-llamacpp-v0.1.1
knavesec/CredMasterruntime-llamacpp-v0.1.1Jun 21, 2026by LauraGPT
AI Summary
This release provides a standalone runtime for FunASR llama.cpp, enabling local execution of SenseVoice and Paraformer speech recognition models without requiring Python or PyTorch.
Key Highlights
- Prebuilt binaries for Linux, macOS, and Windows.
- Built-in FSMN-VAD and whisper.cpp-style on-device ASR.
- No Python, no build, no torch dependencies required.
- Strong performance on Chinese and Cantonese.
New Features
- SenseVoice local execution runtime.
- Paraformer and Fun-ASR-Nano support.
- Built-in FSMN-VAD.
- whisper.cpp-style on-device ASR.
Full Release Notes
Prebuilt, self-contained binaries to run **SenseVoice** (and Paraformer / Fun-ASR-Nano) locally with the FunASR llama.cpp / GGUF runtime — built-in FSMN-VAD, whisper.cpp-style on-device ASR, strong on Chinese & Cantonese. ```bash bash download-funasr-model.sh sensevoice ./gguf llama-funasr-sensevoice -m ./gguf/SenseVoiceSmall-f16.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav ``` No Python, no build, no torch. Binaries for Linux (x64/arm64), macOS (arm64), Windows (x64). Docs: `runtime/llama.cpp/README.md`. CER (micro-avg): SenseVoice 8.01% vs whisper.cpp small 22%.