Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style

arXiv:2403.06365v1 Announce Type: new
Abstract: Although automatically animating audio-driven talking heads has recently received growing interest, previous efforts have mainly concentrated on achieving lip synchronization with the audio, neglecting two crucial elements for generating expressive videos: emotion style and art style. In this paper, we present an innovative audio-driven talking face generation method called Style2Talker. It involves two stylized stages, namely Style-E and Style-A, which integrate text-controlled emotion style and picture-controlled art style into the final output. In order to …

abstract art arxiv audio cs.cv emotion head paper style synchronization talking head type videos