Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework

arXiv:2403.16510v1 Announce Type: new
Abstract: Despite the remarkable process of talking-head-based avatar-creating solutions, directly generating anchor-style videos with full-body motions remains challenging. In this study, we propose Make-Your-Anchor, a novel system necessitating only a one-minute video clip of an individual for training, subsequently enabling the automatic generation of anchor-style videos with precise torso and hand movements. Specifically, we finetune a proposed structure-guided diffusion model on input video to render 3D mesh conditions into human appearances. We adopt a two-stage training …

anchor arxiv avatar cs.cv diffusion framework type