FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization

arXiv:2403.06375v1 Announce Type: new
Abstract: Generating emotional talking faces is a practical yet challenging endeavor. To create a lifelike avatar, we draw upon two critical insights from a human perspective: 1) The connection between audio and the non-deterministic facial dynamics, encompassing expressions, blinks, poses, should exhibit synchronous and one-to-many mapping. 2) Vibrant expressions are often accompanied by emotion-aware high-definition (HD) textures and finely detailed teeth. However, both aspects are frequently overlooked by existing methods. To this end, this paper proposes …

abstract arxiv audio avatar cs.cv dynamics endeavor face flow human insights perspective practical quality quantization through type