Dance Style Transfer with Cross-modal Transformer. (arXiv:2208.09406v1 [cs.LG])

We present CycleDance, a dance style transfer system to transform an existing
motion clip in one dance style to a motion clip in another dance style while
attempting to preserve motion context of the dance. Our method extends an
existing CycleGAN architecture for modeling audio sequences and integrates
multimodal transformer encoders to account for music context. We adopt sequence
length-based curriculum learning to stabilize training. Our approach captures
rich and long-term intra-relations between motion frames, which is a common
challenge …

arxiv lg style transfer transfer transformer