Large Motion Model for Unified Multi-Modal Motion Generation

arXiv:2404.01284v1 Announce Type: new
Abstract: Human motion generation, a cornerstone technique in animation and video production, has widespread applications in various tasks like text-to-motion and music-to-dance. Previous works focus on developing specialist models tailored for each task without scalability. In this work, we present Large Motion Model (LMM), a motion-centric, multi-modal framework that unifies mainstream motion generation tasks into a generalist model. A unified motion model is appealing since it can leverage a wide range of motion data to achieve …

abstract animation applications arxiv cs.cv dance focus framework human lmm modal multi-modal music production scalability specialist tasks text type video video production work