Contact-aware Human Motion Generation from Textual Descriptions

arXiv:2403.15709v1 Announce Type: new
Abstract: This paper addresses the problem of generating 3D interactive human motion from text. Given a textual description depicting the actions of different body parts in contact with objects, we synthesize sequences of 3D body poses that are visually natural and physically plausible. Yet, this task poses a significant challenge due to the inadequate consideration of interactions by physical contacts in both motion and textual descriptions, leading to unnatural and implausible sequences. To tackle this challenge, …

abstract arxiv cs.ai cs.cv human interactive natural objects paper text textual type