GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting

arXiv:2404.14037v1 Announce Type: new
Abstract: Recent works on audio-driven talking head synthesis using Neural Radiance Fields (NeRF) have achieved impressive results. However, due to inadequate pose and expression control caused by NeRF implicit representation, these methods still have some limitations, such as unsynchronized or unnatural lip movements, and visual jitter and artifacts. In this paper, we propose GaussianTalker, a novel method for audio-driven talking head synthesis based on 3D Gaussian Splatting. With the explicit representation property of 3D Gaussians, intuitive …

abstract arxiv audio control cs.cv cs.mm fields head however limitations movements nerf neural radiance fields representation results speaker synthesis talking head type via visual