v0.2.0
Kablex/ComfyUI-Ref2VA-VSAv0.2.0Oct 2, 2026by github-actions[bot]
Upgrading?
AI Summary
This release adds support for Nemotron 3 Diarization and MagpieTTS v2607, introduces the Nemotron Labs VoiceChat for speech-to-speech, and improves performance with CUDA and CPU optimizations.
Key Highlights
- Support for Nemotron 3 Diarization with high resolution and 10ms output
- MagpieTTS v2607 with frame-stacking and new languages (Arabic, Korean, Portuguese)
- Significant performance improvements for MagpieTTS on CUDA and CPU
- Introduction of Nemotron Labs VoiceChat for full-duplex speech-to-speech
- Live diarized transcription with real-time endpointing
Breaking Changes
- Upgraded llama.cpp: ggml now comes from a single pinned submodule instead of a separate one
New Features
- Nemotron 3 Diarization support
- MagpieTTS v2607 with frame-stacking and new languages
- Nemotron Labs VoiceChat (Speech-to-Speech)
- Live diarized transcription
- Nightly builds via --channel nightly
Full Release Notes
## Highlights - **[Nemotron 3 Diarization](https://huggingface.co/nvidia/Nemotron-3-Diarization).** Support for the high-resolution Sortformer architecture with native 10 ms output, for both standalone diarization and diarized ASR. (#50, #52) - **[MagpieTTS](https://huggingface.co/nvidia/magpie_tts_multilingual_357m) v2607.** Frame-stacking support, with Arabic, Korean and Portuguese added. The model index now points to the v2607 GGUF. (#17, #42) - **Faster MagpieTTS on CUDA and CPU.** Persistent decoder kernels, fused NanoCodec convolutions, prefetching across text chunks, and faster CPU GEMMs. See [BENCHMARK.md](https://github.com/NVIDIA/NeMo-Speech.cpp/blob/v0.2.0/BENCHMARK.md) for measured results. (#51) - **[Nemotron Labs VoiceChat](https://huggingface.co/nvidia/NVIDIA-NemotronLabs-VoiceChat-11B).** Full-duplex speech-to-speech with realtime audio, transcripts and tool calling, served over the realtime WebSocket API. VoiceChat is CUDA-only and is built from source with the `cuda-s2s` preset; it isn't included in the release archives. See the [VoiceChat guide](https://github.com/NVIDIA/NeMo-Speech.cpp/blob/v0.2.0/docs/s2s/README.md). (#21, #39) - **Live diarized transcription.** `transcribe --live --diarize` shows speaker turns as you speak, and `--live` now enables endpointing by default. (#50) - **Upgraded llama.cpp.** ggml now comes from a single pinned `llama.cpp` submodule (b11151) instead of a separate `ggml` submodule. The project's patches in `patches/` are applied automatically at configure time. (#57) ## Fixes - MagpieTTS no longer returns silence on M5-class Macs. (#20) - Fixed nondeterministic NanoCodec audio corruption on CUDA, caused by a fused kernel reading a buffer the graph allocator had reused. (#28) - MagpieTTS builds and runs on stock ggml (Metal, Vulkan) without the patched fused attention. (#24, #51) - Streaming ASR keeps acoustic and decoder context across endpoints, and late punctuation no longer leaks into the next final. (#50) - Skinny-Q8 CUDA results no longer depend on earlier requests. (#51) - Linux Vulkan archives use the system C++ runtime, so Mesa drivers (AMD, Intel) load on current distributions. (#58) ## Notes - **Nightly builds.** Install the latest `main` with `--channel nightly`, rebuilt daily. (#58) - **Text normalization.** Linux and macOS archives now include inverse text normalization (ITN) and text normalization (TN). (#58) ## New Contributors * @danilogr made their first contribution in https://github.com/NVIDIA/NeMo-Speech.cpp/pull/20 * @ryanleary made their first contribution in https://github.com/NVIDIA/NeMo-Speech.cpp/pull/28 * @virajkarandikar made their first contribution in https://github.com/NVIDIA/NeMo-Speech.cpp/pull/39 **Full Changelog**: https://github.com/NVIDIA/NeMo-Speech.cpp/compare/v0.1.0...v0.2.0
Related Repositories
public-apis/public-apis★ 491,302
A collective list of free APIs
NousResearch/hermes-agent★ 256,157
The agent that grows with you
yt-dlp/yt-dlp★ 200,346
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,610
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,706
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.