CSTalk: Correlation Supervised Speech-driven 3D Emotional Facial Animation Generation

arXiv:2404.18604v1 Announce Type: new
Abstract: Speech-driven 3D facial animation technology has been developed for years, but its practical application still lacks expectations. The main challenges lie in data limitations, lip alignment, and the naturalness of facial expressions. Although lip alignment has seen many related studies, existing methods struggle to synthesize natural and realistic expressions, resulting in a mechanical and stiff appearance of facial animations. Even with some research extracting emotional features from speech, the randomness of facial movements limits the …

abstract alignment animation animation generation application arxiv challenges correlation cs.ai cs.cv data limitations natural practical speech struggle studies technology type