MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Models

arXiv:2403.09471v1 Announce Type: new
Abstract: Gesture synthesis is a vital realm of human-computer interaction, with wide-ranging applications across various fields like film, robotics, and virtual reality. Recent advancements have utilized the diffusion model and attention mechanisms to improve gesture synthesis. However, due to the high computational complexity of these techniques, generating long and diverse sequences with low latency remains a challenge. We explore the potential of state space models (SSMs) to address the challenge, implementing a two-stage modeling strategy with …

abstract applications arxiv attention attention mechanisms complexity computational computer cs.cv cs.hc diffusion diffusion model fields film however human human-computer interaction reality robotics space state synthesis type virtual virtual reality vital