Learn2Talk: 3D Talking Face Learns from 2D Talking Face

arXiv:2404.12888v1 Announce Type: cross
Abstract: Speech-driven facial animation methods usually contain two main classes, 3D and 2D talking face, both of which attract considerable research attention in recent years. However, to the best of our knowledge, the research on 3D talking face does not go deeper as 2D talking face, in the aspect of lip-synchronization (lip-sync) and speech perception. To mind the gap between the two sub-fields, we propose a learning framework named Learn2Talk, which can construct a better 3D …

abstract animation arxiv attention best of cs.cv cs.gr cs.lg face however knowledge research speech type