Driving Animatronic Robot Facial Expression From Speech

arXiv:2403.12670v1 Announce Type: cross
Abstract: Animatronic robots aim to enable natural human-robot interaction through lifelike facial expressions. However, generating realistic, speech-synchronized robot expressions is challenging due to the complexities of facial biomechanics and responsive motion synthesis. This paper presents a principled, skinning-centric approach to drive animatronic robot facial expressions from speech. The proposed approach employs linear blend skinning (LBS) as the core representation to guide tightly integrated innovations in embodiment design and motion synthesis. LBS informs the actuation topology, enables …

abstract aim arxiv biomechanics complexities cs.cv cs.ro drive driving however human natural paper responsive robot robots speech synthesis through type