Are NeRFs ready for autonomous driving? Towards closing the real-to-simulation gap

arXiv:2403.16092v1 Announce Type: new
Abstract: Neural Radiance Fields (NeRFs) have emerged as promising tools for advancing autonomous driving (AD) research, offering scalable closed-loop simulation and data augmentation capabilities. However, to trust the results achieved in simulation, one needs to ensure that AD systems perceive real and rendered data in the same way. Although the performance of rendering methods is increasing, many scenarios will remain inherently challenging to reconstruct faithfully. To this end, we propose a novel perspective for addressing the …

abstract arxiv augmentation autonomous autonomous driving capabilities cs.cv cs.ro data driving fields gap however loop neural radiance fields research results scalable simulation systems tools trust type