Starstruk Logo MarkStarstruk

r1.0.0

PaddlePaddle/PaddleSpeechr1.0.0May 13, 2022by zh794390558

AI Summary

The initial stable release (v1.0) of PaddleSpeech, introducing industrial-grade Streaming ASR (PP-ASR), Streaming TTS (PP-TTS), and Voiceprint Recognition (PP-VPR).

Key Highlights

  • Release of PP-ASR (Streaming ASR)
  • Release of PP-TTS (Streaming TTS)
  • Release of PP-VPR (Voiceprint Recognition)
  • Support for Custom ASR and MDTC KWS

New Features

  • PP-ASR
  • PP-TTS
  • PP-VPR
  • Custom ASR
  • KWS support

Full Release Notes

## Highlight
* Release [PP-ASR](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/docs/source/asr/PPASR_cn.md): Streaming ASR with timestamp and punctuation restoration, uses [WenetSpeech Streaming Conformer and DeepSpeech2 ASR model](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/docs/source/released_model.md). 
* Release [PP-TTS](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/docs/source/tts/PPTTS.md): Streaming TTS system for industrial application.
* Release [PP-VPR](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/docs/source/vpr/PPVPR.md): [Industrial Voiceprint Recognition system](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/demos/audio_searching/README.md) and ECAPA-TDNN model.
* [Custom ASR](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/demos/custom_streaming_asr/README.md) apply reimbursement for transportation
* Support MDTC [KWS](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/examples/hey_snips/README.md) model

## More
### ASR
* DeepSpeech2 streaming model aishell cer 6.66%
* DeepSpeech2 streaming model wenetspeech cer: 15.2% (test_net, w/o LM), 24.17% (test_meeting, w/o LM), 5.3% (aishell, w/ LM)
* Conformer aishell cer 4.64%
* Conformer streaming model aishell cer 5.44%
* Conformer streaming model  wenetspeech cer: 11.0% (test_net), 18.79% (test_meeting)

### Speechx
* [SpeechX] DeepSpeech2 streaming with WFST in [streaming asr example](https://github.com/PaddlePaddle/PaddleSpeech/tree/develop/speechx/examples/ds2_ol/aishell)
* [SpeechX] Add websocket [websocket example](https://github.com/PaddlePaddle/PaddleSpeech/tree/develop/speechx/examples/ds2_ol/websocket)
* [SpeechX] custom asr, apply reimbursement for transportation [demo](https://github.com/PaddlePaddle/PaddleSpeech/blob/develop/demos/custom_streaming_asr/README.md)

### KWS
* [KWS] Add kws example on HeySnips dataset. by @KPatr1ck in https://github.com/PaddlePaddle/PaddleSpeech/pull/1558
* [KWS] Update KWS example. by @KPatr1ck in https://github.com/PaddlePaddle/PaddleSpeech/pull/1783

### Audio
* [Audio] rename paddleaudio to audio, since confilict with pkg name by @zh794390558 in https://github.com/PaddlePaddle/PaddleSpeech/pull/1758
* [Audio] Fix mcd issue. by @KPatr1ck in https://github.com/PaddlePaddle/PaddleSpeech/pull/1658
* [Audio] Remove mcd. by @KPatr1ck in https://github.com/PaddlePaddle/PaddleSpeech/pull/1659
* [Audio] Add `VoxCeleb` dataset for speaker recognition.
* [Audio] Add `HeySnips` dataset for keyword spotting.

## What's Changed
* [R1.0][asr][server]add vector server  by @Honei in https://github.com/PaddlePaddle/PaddleSpeech/pull/1845
* [R1.0][asr][server]join streaming asr and punc server by @Honei in https://github.com/PaddlePaddle/PaddleSpeech/pull/1846
* [R1.0]asr streaming server add time stamp by @Honei in https://github.com/PaddlePaddle/PaddleSpeech/pull/1850
* [R1.0][tts][server] update readme by @lym0302 in https://github.com/PaddlePaddle/PaddleSpeech/pull/1852
* [R1.0] update cli by @Jackwaterveg in https://github.com/PaddlePaddle/PaddleSpeech/pull/1854
* [r1.0] update version to r1.0.0 by @zh794390558 in https://github.com/PaddlePaddle/PaddleSpeech/pull/1857
* [R1.0] Add doc for wenetspeech model (ds2 online, conformer online) by @Jackwaterveg in https://github.com/PaddlePaddle/PaddleSpeech/pull/1862
* [R1.0][server] improve server code by @lym0302 in https://github.com/PaddlePaddle/PaddleSpeech/pull/1866
* [R1.0][asr][server]update the streaming asr readme by @Honei in https://github.com/PaddlePaddle/PaddleSpeech/pull/1871
* [R1.0] Updata released model info ( Wenetspeech ds2 online, conformer online) by @Jackwaterveg in https://github.com/PaddlePaddle/PaddleSpeech/pull/1869
* [R1.0]fix server doc and decode_method by @Jackwaterveg in https://github.com/PaddlePaddle/PaddleSpeech/pull/1889
* [speechx] add custom_streaming_asr @SmileGoat #1891
* [speechx] speedup ngram building @zh794390558  #1729
* [speechx] refactor egs and more egs for TLG wfst graph build @zh794390558  #1715
* [speechx]add aishell test script & json parser & no db norm linear feature & json2kaldi type cmvn  @SmileGoat  #1676
* [speechx] Add websocket & make it work @SmileGoat  #1720
* [speechx] Frontend refactor @SmileGoat  #1640
* [Speechx] add tlg decoder @SmileGoat  #1599



**Full Changelog**: https://github.com/PaddlePaddle/PaddleSpeech/compare/r1.0.0a...r1.0.0