A Comparative Study of Perceptual Quality Metrics for Audio-driven Talking Head Videos

arXiv:2403.06421v1 Announce Type: new
Abstract: The rapid advancement of Artificial Intelligence Generated Content (AIGC) technology has propelled audio-driven talking head generation, gaining considerable research attention for practical applications. However, performance evaluation research lags behind the development of talking head generation techniques. Existing literature relies on heuristic quantitative metrics without human validation, hindering accurate progress assessment. To address this gap, we collect talking head videos generated from four generative methods and conduct controlled psychophysical experiments on visual quality, lip-audio synchronization, and …

arxiv audio cs.cv head metrics quality study talking head type videos