Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis. (arXiv:2110.04482v2 [eess.AS] UPDATED)

This work presents a lifelong learning approach to train a multilingual
Text-To-Speech (TTS) system, where each language was seen as an individual task
and was learned sequentially and continually. It does not require pooled data
from all languages altogether, and thus alleviates the storage and computation
burden. One of the challenges of lifelong learning methods is "catastrophic
forgetting": in TTS scenario it means that model performance quickly degrades
on previous languages when adapted to a new language. We approach this …

arxiv learning speech text text-to-speech