TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting

arXiv:2404.15264v1 Announce Type: new
Abstract: Radiance fields have demonstrated impressive performance in synthesizing lifelike 3D talking heads. However, due to the difficulty in fitting steep appearance changes, the prevailing paradigm that presents facial motions by directly modifying point appearance may lead to distortions in dynamic regions. To tackle this challenge, we introduce TalkingGaussian, a deformation-based radiance fields framework for high-fidelity talking head synthesis. Leveraging the point-based Gaussian Splatting, facial motions can be represented in our method by applying smooth and …

abstract arxiv challenge cs.cv dynamic fields head however paradigm performance synthesis talking head type via