Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs

arXiv:2406.05038v1 Announce Type: cross
Abstract: Recent advancements in sequence modeling have led to the development of the Mamba architecture, noted for its selective state space approach, offering a promising avenue for efficient long sequence handling. However, its application in 3D shape generation, particularly at high resolutions, remains underexplored. Traditional diffusion transformers (DiT) with self-attention mechanisms, despite their potential, face scalability challenges due to the cubic complexity of attention operations as input length increases. This complexity becomes a significant hurdle when …

abstract application architecture arxiv cs.ai cs.cv cs.lg development diffusion however mamba modeling shape space ssms state type via