v0.8.10
azophy/sshifuv0.8.10Sep 27, 2026by KoljaB
Upgrading?
AI Summary
Improves Qwen streaming startup by removing CPU quiet-onset retries and introduces CPU core splitting for better performance on Windows.
Key Highlights
- CPU synthesis continues through initial quiet audio without retrying.
- Voice Studio defaults to 0ms browser buffering.
- New `--cpu-core-split` flag for Windows to separate generation and decoder workers.
- Demo voice cloning example added.
New Features
- Qwen streaming startup improvements.
- Voice Studio buffer configuration.
- CPU core splitting for Windows.
- Demo voice support.
- Server logging improvements.
Full Release Notes
RealtimeTTS 0.8.10 improves Qwen streaming startup and removes CPU quiet-onset retries. - CPU synthesis now continues through initial quiet audio and trims it in the original stream, without cancelling and generating the fragment again. - Voice Studio defaults to **0 ms additional browser buffering**, configurable in the playback options. It prepares and reuses the audio context before speech requests. - Server logging runs outside the request event loop. The CPU extra now uses native 0.4.2, which also routes prompt diagnostics through the native logging callback. - CPU and NVIDIA GPU server extras include the optional `--demo-voice` cloning example. - The new opt-in `--cpu-core-split` discovers Windows physical cores and places generation and decoder workers separately, without raising process priority. Windows CPU (example for 12 physical cores): ```bat uv venv --python 3.11 --managed-python .venv-cpu uv pip install --python .venv-cpu\Scripts\python.exe "realtimetts[qwen-cpu-server]==0.8.10" .venv-cpu\Scripts\realtimetts-qwen-server.exe --device cpu --cpu-threads 6 --cpu-codec-threads 6 --cpu-core-split --cpu-stream-frames 1 --cpu-fused-attention --startup-buffer-ms 80 --onset-silence-profile qwen3_tts_12hz_0_6b_base_q8_v1 --demo-voice ``` This uses six generation workers and six decoder workers with an 80 ms server reserve. Adjust both counts to the available physical cores. On hybrid CPUs, core splitting uses the highest performance core class; too few cores produce a clear error. The short `--device cpu --cpu-fused-attention` command alone does not enable decoder overlap. Core splitting is Windows-only; omit that flag on Linux/macOS. Windows NVIDIA GPU: ```bat uv venv --python 3.11 --managed-python .venv-gpu uv pip install --python .venv-gpu\Scripts\python.exe "realtimetts[qwen-server]==0.8.10" .venv-gpu\Scripts\realtimetts-qwen-server.exe --device gpu --clone-mode speaker_only --demo-voice ``` Open http://127.0.0.1:8080/studio and select **demo-neutral**. The GPU command uses the existing 160 ms server reserve. Server reserve and browser buffering are separate, configurable controls. See the [installation and tuning guide](https://github.com/KoljaB/RealtimeTTS/blob/v0.8.10/docs/qwen-studio.md) for manual CPU settings and voice cloning. Performance depends on hardware, text, voice, and concurrent load.
Related Repositories
asheshgoplani/agent-deck★ 359,427
Terminal session manager for AI coding agents. One TUI for Claude, Gemini, OpenCode, Codex, and more.
ollama/ollama★ 184,227
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
fatedier/frp★ 110,060
A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
infiniflow/ragflow★ 92,627
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
gohugoio/hugo★ 90,197
The world’s fastest framework for building websites.