v1.9.0
thevoiceguy/siphon-aiv1.9.0Mar 1, 2026by FranckyB
Upgrading?
AI Summary
Implements CUDA Graph acceleration for Qwen3 and adds full multi-GPU support for subsystems.
Key Highlights
- 5-10x faster Qwen3 inference via CUDA Graph acceleration.
- Multi-GPU support allowing assignment of TTS, ASR, and LLM to separate GPUs.
- Automatic fallback to standard Qwen3TTSModel if CUDA graphs fail.
- Trained model caching to prevent reloading between generations.
New Features
- Faster-Qwen3-TTS integration
- CUDA Graph acceleration toggle (CUDA only)
- Multi-GPU assignment dropdowns
- Automatic GPU detection
- Saved GPU preferences in config.json
- Conversation tab component fix
Full Release Notes
**Faster-Qwen3-TTS Integration** - **5-10x Faster Inference** - Integrated [Faster-Qwen3-TTS](https://github.com/andimarafioti/faster-qwen3-tts) for CUDA graph-accelerated Qwen3 generation with bit-identical output quality - **All Qwen3 Models** - Acceleration applies to Base, CustomVoice, VoiceDesign, and Trained Model checkpoints - **Toggle in Settings** - Enable/disable CUDA Graphs Acceleration under Faster-Qwen3-TTS section (CUDA only) - **Automatic Fallback** - Gracefully falls back to standard Qwen3TTSModel when CUDA graphs are unavailable or fail - **Setup Scripts Updated** - `setup-windows.bat` and `setup-linux.sh` auto-install the package (not on macOS) - **Trained Model Caching** - Trained model checkpoints are now cached between generations instead of reloading every time **Multi-GPU Support** - **GPU Assignment Dropdowns** - Assign TTS, ASR, and Llama.cpp to different GPUs on multi-GPU systems - **Per-Subsystem Control** - Each subsystem (TTS, ASR, LLM) can run on a separate GPU to maximize throughput - **Automatic Detection** - GPU dropdowns only appear when multiple CUDA GPUs are detected - **Saved Preferences** - GPU assignments persist across restarts via config.json **Bug Fixes** - **Conversation Tab Fix** - Fixed a broken component reference (`vv_conv_sentences_per_chunk` → `vv_conv_paragraph_per_chunk`) that prevented all interactive elements from working on the Conversation tab
Related Repositories
farion1231/cc-switch★ 147,662
A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io
rustdesk/rustdesk★ 126,634
An open-source remote desktop application designed for self-hosting, as an alternative to TeamViewer.
tauri-apps/tauri★ 112,124
Build smaller, faster, and more secure desktop and mobile applications with a web frontend.
ruvnet/RuView★ 99,183
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
oven-sh/bun★ 96,346
Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one