MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement. (arXiv:2104.08223v2 [cs.CV] UPDATED)

This paper presents a generic method for generating full facial 3D animation
from speech. Existing approaches to audio-driven facial animation exhibit
uncanny or static upper face animation, fail to produce accurate and plausible
co-articulation or rely on person-specific models that limit their scalability.
To improve upon existing models, we propose a generic audio-driven facial
animation approach that achieves highly realistic motion synthesis results for
the entire face. At the core of our approach is a categorical latent space for
facial …

3d animation arxiv cv face speech