[R] XPhoneBERT: A Pre-trained Multilingual Model for Phoneme Representations for Text-to-Speech

[https://github.com/VinAIResearch/XPhoneBERT](https://github.com/VinAIResearch/XPhoneBERT)

XPhoneBERT is the first multilingual model pre-trained to learn phoneme representations for the downstream text-to-speech (TTS) task. Our XPhoneBERT has the same model architecture as BERT-base, trained using the RoBERTa pre-training approach on 330M phoneme-level sentences from nearly 100 languages and locales. Employing XPhoneBERT as an input phoneme encoder significantly boosts the performance of a strong neural TTS model in terms of naturalness and prosody and also helps produce fairly high-quality speech with limited training data.

XPhoneBERT can be …

architecture bert encoder languages learn machinelearning multilingual performance pre-training roberta speech text text-to-speech training tts