v2.2
DigitalPhonetics/IMS-Toucanv2.2May 20, 2022by Flux9665
AI Summary
Expands language support to include all IPA phonemes, suprasegmental markers, and tonal languages like Chinese and Vietnamese.
Key Highlights
- Full IPA phoneme support.
- Suprasegmental marker parsing.
- Praat-parselmouth integration for pitch extraction.
- Tonal language support (Chinese, Vietnamese).
- Scorer class for data inspection.
Breaking Changes
- Backwards compatibility is broken.
New Features
- Full IPA phoneme support
- Suprasegmental markers
- Praat-parselmouth integration
- Faster phonemization
- Word boundaries
- Tonal language support
- Scorer class
- Duration and variance controls
Full Release Notes
This release extends the toolkits functionality and provides new checkpoints.
**New Features:**
- support for all phonemes in the IPA standard through an extended lookup of articulatory features
- support for some suprasegmental markers in the IPA standard through parsing (tone, lengthening, primary stress)
- praat-parselmouth for greatly improved pitch extraction
- faster phonemizaton
- word boundaries are added, which are invisible to the aligner and the decoder, but can help the encoder in multilingual scenarios
- tonal languages added, tested and included into the pretraining (Chinese, Vietnamese)
- Scorer class to inspect data given a trained model and dataset cache (provided pretrained models can be used for this)
- intuitive controls for scaling durations and variance in pitch and energy
- divese bugfixes and speed increases
**Note:**
- This release breaks backwards compatibility. Make sure you are using the associated pretrained models. Old checkpoints and dataset caches become incompatible. Only HiFiGAN remains compatible.
- Work on upcoming releases is already in progress. Improved voice adaptation will be our next goal.
- To use the pretrained checkpoints, download them, create their corresponding directories and place them into your clone as follows (you have to rename the HiFiGAN and FastSpeech2 checkpoints once in place):
```
...
Models
└─ Aligner
└─ aligner.pt
└─ FastSpeech2_Meta
└─ best.pt
└─ HiFiGAN_combined
└─ best.pt
...
```