[R] NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers

Microsoft Research Proposes NaturalSpeech 2.
Paper Link: [https://arxiv.org/abs/2304.09116](https://arxiv.org/abs/2304.09116)
Demo Link: [https://speechresearch.github.io/naturalspeech2/](https://speechresearch.github.io/naturalspeech2/)

Last year, NaturalSpeech achieved recording-level quality in speech synthesis. Now, after a year of development, we're proud to introduce our latest and most powerful upgrade: NaturalSpeech 2, a large speech synthesis model.

Some key features of NaturalSpeech 2 include:

1. The Latent Diffusion Model+Continuous Codec, which overcomes the challenges of the Language Model+Discrete Codec approach.
2. NaturalSpeech 2 is highly stable in synthesizing speech, producing excellent rhythm, high audio …

art audio challenges codec continuous development diffusion diffusion model diffusion models features language language model machinelearning microsoft microsoft research natural quality recording research speech state synthesis upgrade