Starstruk Logo MarkStarstruk

runtime-llamacpp-v0.1.1

dstotijn/hettyruntime-llamacpp-v0.1.1Jun 21, 2026by LauraGPT

AI Summary

This release introduces prebuilt, self-contained binaries for the FunASR llama.cpp runtime, enabling local execution of SenseVoice and other ASR models without Python or build dependencies. It supports multiple platforms including Linux, macOS, and Windows, and includes a built-in FSMN-VAD for improved speech processing.

Key Highlights

  • Prebuilt binaries for Linux (x64/arm64), macOS (arm64), and Windows (x64)
  • Local execution of SenseVoice, Paraformer, and Fun-ASR-Nano without Python or PyTorch
  • Built-in FSMN-VAD for speech detection
  • whisper.cpp-style on-device ASR
  • Strong performance on Chinese and Cantonese languages

New Features

  • SenseVoice ASR support
  • Paraformer and Fun-ASR-Nano support
  • whisper.cpp-style on-device ASR
  • FSMN-VAD integration

Full Release Notes

Prebuilt, self-contained binaries to run **SenseVoice** (and Paraformer / Fun-ASR-Nano) locally with the FunASR llama.cpp / GGUF runtime — built-in FSMN-VAD, whisper.cpp-style on-device ASR, strong on Chinese & Cantonese.

```bash
bash download-funasr-model.sh sensevoice ./gguf
llama-funasr-sensevoice -m ./gguf/SenseVoiceSmall-f16.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav
```

No Python, no build, no torch. Binaries for Linux (x64/arm64), macOS (arm64), Windows (x64). Docs: `runtime/llama.cpp/README.md`. CER (micro-avg): SenseVoice 8.01% vs whisper.cpp small 22%.