WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generation

arXiv:2312.02934v3 Announce Type: replace
Abstract: Generating multi-camera street-view videos is critical for augmenting autonomous driving datasets, addressing the urgent demand for extensive and varied data. Due to the limitations in diversity and challenges in handling lighting conditions, traditional rendering-based methods are increasingly being supplanted by diffusion-based methods. However, a significant challenge in diffusion-based methods is ensuring that the generated sensor data preserve both intra-world consistency and inter-sensor coherence. To address these challenges, we combine an additional explicit world volume and …

abstract arxiv autonomous autonomous driving challenges cs.cv data datasets demand diffusion diversity driving however lighting limitations rendering street type videos view world