Motion Generation from Fine-grained Textual Descriptions

arXiv:2403.13518v1 Announce Type: cross
Abstract: The task of text2motion is to generate motion sequences from given textual descriptions, where a model should explore the interactions between natural language instructions and human body movements. While most existing works are confined to coarse-grained motion descriptions (e.g., "A man squats."), fine-grained ones specifying movements of relevant body parts are barely explored. Models trained with coarse texts may not be able to learn mappings from fine-grained motion-related words to motion primitives, resulting in the …

abstract arxiv cs.ai cs.cl cs.cv cs.ro explore fine-grained generate human interactions language movements natural natural language textual type