Embedded Representation Learning Network for Animating Styled Video Portrait

arXiv:2404.19038v1 Announce Type: new
Abstract: The talking head generation recently attracted considerable attention due to its widespread application prospects, especially for digital avatars and 3D animation design. Inspired by this practical demand, several works explored Neural Radiance Fields (NeRF) to synthesize the talking heads. However, these methods based on NeRF face two challenges: (1) Difficulty in generating style-controllable talking heads. (2) Displacement artifacts around the neck in rendered images. To overcome these two challenges, we propose a novel generative paradigm …

abstract animation application arxiv attention avatars cs.ai cs.cv demand design digital digital avatars embedded face fields head however nerf network neural radiance fields portrait practical prospects representation representation learning talking head type video