LM2D: Lyrics- and Music-Driven Dance Synthesis

arXiv:2403.09407v1 Announce Type: cross
Abstract: Dance typically involves professional choreography with complex movements that follow a musical rhythm and can also be influenced by lyrical content. The integration of lyrics in addition to the auditory dimension, enriches the foundational tone and makes motion generation more amenable to its semantic meanings. However, existing dance synthesis methods tend to model motions only conditioned on audio signals. In this work, we make two contributions to bridge this gap. First, we propose LM2D, a …

arxiv cs.ai cs.lg cs.mm cs.sd dance eess.as lyrics music synthesis type