Generative Pre-training for Speech with Flow Matching

arXiv:2310.16338v2 Announce Type: replace-cross
Abstract: Generative models have gained more and more attention in recent years for their remarkable success in tasks that required estimating and sampling data distribution to generate high-fidelity synthetic data. In speech, text-to-speech synthesis and neural vocoder are good examples where generative models have shined. While generative models have been applied to different applications in speech, there exists no general-purpose generative model that models speech directly. In this work, we take a step toward this direction …

abstract arxiv attention cs.cl cs.lg cs.sd data distribution eess.as examples fidelity flow generate generative generative models good neural vocoder pre-training sampling speech success synthesis synthetic synthetic data tasks text text-to-speech training type