v0.4.8

KoljaB/RealtimeTTSv0.4.8Oct 29, 2024by KoljaB

AI Summary

The ParlerEngine is now available, requiring specific installation steps for Flash Attention to enable realtime inference.

Key Highlights

Added ParlerEngine support
Installation instructions for Flash Attention on Windows

New Features

ParlerEngine support
Flash Attention installation instructions

Full Release Notes

- added ParlerEngine. Needs flash attention, then barely runs fast enough for realtime inference on a 4090.  

  Parler Installation for Windows (after installing RealtimeTTS):

  ```python
  pip install git+https://github.com/huggingface/parler-tts.git
  pip install torch==2.3.1+cu121 torchaudio==2.3.1 --index-url https://download.pytorch.org/whl/cu121
  pip install https://github.com/oobabooga/flash-attention/releases/download/v2.6.3/flash_attn-2.6.3+cu122torch2.3.1cxx11abiFALSE-cp310-cp310-win_amd64.whl
  pip install "numpy<2"
  ```