Starstruk Logo MarkStarstruk

v0.7.2

caddyserver/caddyv0.7.2May 25, 2026by KoljaB

AI Summary

This release significantly improves the PocketTTS engine by introducing persistent worker threads and serial streaming to resolve memory retention issues on Windows and Torch CPU.

Key Highlights

  • Reworked `PocketTTSEngine` to run synthesis through a persistent worker thread.
  • Patched PocketTTS short-text streaming to decode serially, avoiding memory retention on Windows/Torch CPU.
  • Added new streaming controls: `streaming`, `max_tokens`, and `frames_after_eos`.
  • Added support for cached voice states via `state_path` and directory-based caching.

New Features

  • Streaming controls (`streaming`, `max_tokens`, `frames_after_eos`)
  • Custom PocketTTS model configs via `model_config`
  • Cached voice states via `PocketTTSVoice(state_path=...)`
  • Optional voice-state caching via `voice_cache_dir` and `cache_voice_states`

Full Release Notes

# RealtimeTTS v0.7.2

### Improvements

* Reworked `PocketTTSEngine` to run synthesis through a persistent worker thread.
* Patched PocketTTS short-text streaming to decode serially, avoiding Windows/Torch CPU memory retention during repeated short generations.
* Added PocketTTS streaming controls: `streaming`, `max_tokens`, and `frames_after_eos`.
* Added support for custom PocketTTS model configs via `model_config`.
* Added support for cached voice states through `PocketTTSVoice(state_path=...)`.
* Added optional voice-state caching through `voice_cache_dir` and `cache_voice_states`.
* Improved PocketTTS audio conversion, queueing, duration tracking, and shutdown cleanup.

### Packaging

* Bumped package version to `0.7.2`.
* Set the PocketTTS dependency to `pocket-tts>=2.1.0`.
* Refreshed explicit dependency versions, including `stream2sentence`, `openai`, `elevenlabs`, `edge-tts`, `requests`, `cartesia`, `camb-sdk`, `omnivoice`, and `typecast-python`.

### Documentation

* Added PocketTTS runtime notes for the persistent worker and serial streaming behavior.
* Cleaned up the README support section.