Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animation

arXiv:2404.00636v1 Announce Type: new
Abstract: In this paper, we present Export3D, a one-shot 3D-aware portrait animation method that is able to control the facial expression and camera view of a given portrait image. To achieve this, we introduce a tri-plane generator that directly generates a tri-plane of 3D prior by transferring the expression parameter of 3DMM into the source image. The tri-plane is then decoded into the image of different view through a differentiable volume rendering. Existing portrait animation methods …

abstract animation arxiv control cs.ai cs.cv cs.mm generate generator image paper plane prior type view