Video-Driven Animation of Neural Head Avatars

arXiv:2403.04380v1 Announce Type: new
Abstract: We present a new approach for video-driven animation of high-quality neural 3D head models, addressing the challenge of person-independent animation from video input. Typically, high-quality generative models are learned for specific individuals from multi-view video footage, resulting in person-specific latent representations that drive the generation process. In order to achieve person-independent animation from video input, we introduce an LSTM-based animation network capable of translating person-independent expression features into personalized animation parameters of person-specific 3D head …

abstract animation arxiv avatars challenge cs.cv drive generative generative models head independent person process quality type video view