runtime-llamacpp-v0.1.2

Michael-A-Kuykendall/shimmyruntime-llamacpp-v0.1.2Jun 21, 2026by github-actions[bot]

AI Summary

Prebuilt self-contained binaries for the FunASR llama.cpp runtime, enabling on-device ASR for SenseVoice, Paraformer, and Fun-ASR-Nano models.

Key Highlights

  • No Python or build required
  • Supports SenseVoice, Paraformer, and Fun-ASR-Nano with FSMN-VAD
  • Optimized for x64 and x64-avx2 CPU assets

New Features

  • Prebuilt self-contained binaries for SenseVoice, Paraformer, and Fun-ASR-Nano with FSMN-VAD

Full Release Notes

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with `bash download-funasr-model.sh <sensevoice|paraformer|nano>`, then run `llama-funasr-cli` / `llama-funasr-sensevoice` / `llama-funasr-paraformer`. No Python, no build. Docs: runtime/llama.cpp/README.md