MCM: Multi-condition Motion Synthesis Framework

arXiv:2404.12886v1 Announce Type: cross
Abstract: Conditional human motion synthesis (HMS) aims to generate human motion sequences that conform to specific conditions. Text and audio represent the two predominant modalities employed as HMS control conditions. While existing research has primarily focused on single conditions, the multi-condition human motion synthesis remains underexplored. In this study, we propose a multi-condition HMS framework, termed MCM, based on a dual-branch structure composed of a main branch and a control branch. This framework effectively extends the …

abstract arxiv audio control cs.cv cs.lg framework generate hms human research study synthesis text type