v0.8.8
passteque/gluetunv0.8.8Sep 26, 2026by KoljaB
Upgrading?
AI Summary
Adds optional Qwen CPU decoder overlap to improve performance and startup latency. Introduces Numba selection for Intel Macs.
Key Highlights
- Optional CPU decoder overlap allows concurrent generation and decoding
- Linux CPU config reduced RTF by 23-26%
- Startup priority recovered 18-23 ms of audible-start latency
- Qwen extras select Numba 0.62.x on Intel Macs
- Pin CPU native to 0.4.0
New Features
- Decoder overlap
- Performance optimizations
- Numba selection for Intel Macs
- Native version pinning
Full Release Notes
# RealtimeTTS 0.8.8 This release adds optional Qwen CPU decoder overlap: acoustic-code generation can continue while the preceding chunk is decoded, using a separate CPU worker pool. Worker counts, chunk cadence and CPU affinity are configurable. The tested Linux CPU configuration reduced RTF by 23-26%, with identical PCM in the paired cases. Results depend on hardware and settings. Optional startup priority recovered 18-23 ms of audible-start latency in the measured cases, with a 2-6% generation-time cost. The full editable emotional demo is restored in tests/faster_qwen_emotions.py. Compact colored output is the default; --verbose enables native diagnostics. Compact output now shuts down cleanly when a child process retains the stderr pipe. Qwen extras select Numba 0.62.x on Intel Macs to retain binary dependency installation. Intel Mac installations use Python 3.10-3.13. Windows, Linux and Apple Silicon dependency selections are unchanged. CPU extras pin realtimetts-qwen-native-cpu 0.4.0. Serial/unpinned defaults and the 160 ms startup reserve remain unchanged. Models, precision and sampling are unchanged. GPU native remains at 0.2.0; the experimental GPU startup schedule is not included. Version 0.8.7 remains a TestPyPI rehearsal version; 0.8.8 includes the installation and shutdown fixes found during that rehearsal. Install: pip install --upgrade "realtimetts[qwen-cpu]==0.8.8" For the CPU server: pip install --upgrade "realtimetts[qwen-cpu-server]==0.8.8"
Related Repositories
ollama/ollama★ 184,212
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
fatedier/frp★ 110,052
A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
infiniflow/ragflow★ 92,612
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
gohugoio/hugo★ 90,198
The world’s fastest framework for building websites.
junegunn/fzf★ 83,716
:cherry_blossom: A command-line fuzzy finder