v0.8.8
Gentleman-Programming/engramv0.8.8Sep 26, 2026by KoljaB
Upgrading?
AI Summary
Adds optional Qwen CPU decoder overlap to improve performance and reduce latency. Fixes installation and shutdown issues, and updates dependency selections for Macs.
Key Highlights
- Optional CPU decoder overlap reduces RTF by 23-26%.
- Startup priority recovery reduces audible-start latency.
- Restores the full editable emotional demo.
- Fixes compact output shutdown when retaining stderr pipe.
- Selects Numba 0.62.x for Intel Macs.
New Features
- Decoder overlap feature
- Startup priority optimization
- Emotional demo restoration
- Mac dependency updates
- Installation and shutdown fixes
Full Release Notes
# RealtimeTTS 0.8.8 This release adds optional Qwen CPU decoder overlap: acoustic-code generation can continue while the preceding chunk is decoded, using a separate CPU worker pool. Worker counts, chunk cadence and CPU affinity are configurable. The tested Linux CPU configuration reduced RTF by 23-26%, with identical PCM in the paired cases. Results depend on hardware and settings. Optional startup priority recovered 18-23 ms of audible-start latency in the measured cases, with a 2-6% generation-time cost. The full editable emotional demo is restored in tests/faster_qwen_emotions.py. Compact colored output is the default; --verbose enables native diagnostics. Compact output now shuts down cleanly when a child process retains the stderr pipe. Qwen extras select Numba 0.62.x on Intel Macs to retain binary dependency installation. Intel Mac installations use Python 3.10-3.13. Windows, Linux and Apple Silicon dependency selections are unchanged. CPU extras pin realtimetts-qwen-native-cpu 0.4.0. Serial/unpinned defaults and the 160 ms startup reserve remain unchanged. Models, precision and sampling are unchanged. GPU native remains at 0.2.0; the experimental GPU startup schedule is not included. Version 0.8.7 remains a TestPyPI rehearsal version; 0.8.8 includes the installation and shutdown fixes found during that rehearsal. Install: pip install --upgrade "realtimetts[qwen-cpu]==0.8.8" For the CPU server: pip install --upgrade "realtimetts[qwen-cpu-server]==0.8.8"
Related Repositories
ollama/ollama★ 184,212
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
fatedier/frp★ 110,052
A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
infiniflow/ragflow★ 92,612
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
gohugoio/hugo★ 90,198
The world’s fastest framework for building websites.
junegunn/fzf★ 83,716
:cherry_blossom: A command-line fuzzy finder