SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior

arXiv:2403.20079v1 Announce Type: new
Abstract: Novel View Synthesis (NVS) for street scenes play a critical role in the autonomous driving simulation. The current mainstream technique to achieve it is neural rendering, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS). Although thrilling progress has been made, when handling street scenes, current methods struggle to maintain rendering quality at the viewpoint that deviates significantly from the training viewpoints. This issue stems from the sparse training views captured by a …

abstract arxiv autonomous autonomous driving cs.cv current diffusion driving fields nerf neural radiance fields neural rendering novel prior progress rendering role simulation street synthesis type view