v0.4.10

KoljaB/RealtimeTTSv0.4.10Nov 7, 2024by KoljaB

AI Summary

Significant updates to stream2sentence and the Coqui engine include async stream support and a new load balancing parameter for GPU efficiency.

Key Highlights

Updated stream2sentence to 0.2.7 with bug fixes and async stream support
Added load balancing parameter to Coqui engine
Upgraded dependencies (coqui tts, elevenlabs, openai)

New Features

stream2sentence 0.2.7 with async stream support
Load balancing parameter for Coqui engine
Dependency upgrades

Full Release Notes

- new stream2sentence version 0.2.7
  - bugfix for [#5](https://github.com/KoljaB/stream2sentence/issues/5) (causing a whitespace between words to get lost sometimes)
  - upgrade to latest NLTK and Stanza versions including new "punkt-tab" model
  - allow offline environment for stanza
  - adds support for async streams (preparations for async in RealtimeTTS)
- dependency upgrades to latest version (coqui tts 0.24.2 ➡️ 0.24.3, elevenlabs 1.11.0 ➡️ 1.12.1, openai 1.52.2 ➡️ 1.54.3)
- added load_balancing parameter to coqui engine 
  - if you have a fast machine with a realtime factor way lower than 1, we infer way faster then we need to
  - this parameter allows you to infer with a rt factor closer to 1, so you will still have streaming voice inference BUT your GPU load goes down to the minimum that is needed to produce chunks in realtime
  - if you do LLM inference in parallel this will be faster now because TTS takes less load