runtime-llamacpp-v0.1.9
phiresky/ripgrep-allruntime-llamacpp-v0.1.9Jul 24, 2026by LauraGPT
AI Summary
Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime, featuring SenseVoice, Paraformer, and Fun-ASR-Nano support plus built-in FSMN-VAD.
Key Highlights
- Moves SenseVoice Latest Release source snapshot to main, including a security fix for `yaml.SafeLoader`.
- Offers multiple build variants including AVX2, Vulkan, and CUDA backends for different hardware.
- No Python ASR runtime or local compilation required; supports native ARM64 and MacOS ARM64 packages.
New Features
- SenseVoice ASR support
- Paraformer ASR support
- Fun-ASR-Nano support
- FSMN-VAD support
- Vulkan backend
- CUDA backend (Windows x64)
Full Release Notes
Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime, with SenseVoice, Paraformer, and Fun-ASR-Nano support plus built-in FSMN-VAD. This release moves the SenseVoice **Latest Release** source snapshot onto current `main`, including the `yaml.SafeLoader` security fix from [#312](https://github.com/QwenAudio/SenseVoice/pull/312). Users downloading GitHub's generated source archives no longer receive the older unsafe YAML loader from `runtime-llamacpp-v0.1.4`. ## Choose an asset - Default `linux-x64` / `windows-x64`: maximum CPU compatibility. - `linux-x64-avx2` / `windows-x64-avx2`: higher throughput on CPUs with AVX2, FMA, F16C, and BMI2. - `linux-x64-vulkan` / `windows-x64-vulkan`: Vulkan backend; requires a working Vulkan driver and ICD. - `windows-x64-cuda`: CUDA backend targeting architecture 86; build from source for other GPU architectures. - Native `linux-arm64` and `macos-arm64` packages are included. Download a default quantized model with: ```bash pip install -U huggingface_hub bash download-funasr-model.sh sensevoice ``` Then run `llama-funasr-sensevoice`; no Python ASR runtime or local compilation is required. All nine files are byte-for-byte identical to the digest-verified assets from [`modelscope/FunASR` runtime v0.1.9](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.1.9). Documentation: https://github.com/QwenAudio/SenseVoice/blob/runtime-llamacpp-v0.1.9/runtime/llama.cpp/README.md