Dyadic Interaction Modeling for Social Behavior Generation

arXiv:2403.09069v1 Announce Type: new
Abstract: Human-human communication is like a delicate dance where listeners and speakers concurrently interact to maintain conversational dynamics. Hence, an effective model for generating listener nonverbal behaviors requires understanding the dyadic context and interaction. In this paper, we present an effective framework for creating 3D facial motions in dyadic interactions. Existing work consider a listener as a reactive agent with reflexive behaviors to the speaker's voice and facial motions. The heart of our framework is Dyadic …

abstract arxiv behavior behavior generation communication context conversational cs.cv dance dynamics framework human modeling nonverbal paper social speakers type understanding