[R] Microsoft Research unveils NaturalSpeech 3, a significant advancement in zero-shot text-to-speech technology.

Paper Link: [https://arxiv.org/abs/2403.03100](https://arxiv.org/abs/2403.03100)

Demo Link: [https://speechresearch.github.io/naturalspeech3/](https://speechresearch.github.io/naturalspeech3/)

​

Building upon the successes of NaturalSpeech series, NaturalSpeech 3 not only inherits the high-quality synthesis capabilities but also advances further by factorizing speech attributes, allowing for a more detailed and controlled synthesis process.

​

Key highlights of NaturalSpeech 3 include:

1.Factorized Codec: A neural codec with factorized vector quantization expertly disentangles speech into distinct subspaces, enabling targeted improvements in speech generation.

2.Factorized Diffusion Model: The factorized diffusion model is designed to generate speech …

advances building capabilities codec enabling highlights improvements key key highlights machinelearning process quality quantization series speech synthesis vector