SIGNeRF: Scene Integrated Generation for Neural Radiance Fields

arXiv:2401.01647v2 Announce Type: replace
Abstract: Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most generative 3D approaches are object-centric and applying them to editing existing photorealistic scenes is not trivial. We propose SIGNeRF, a novel approach for fast and controllable NeRF scene editing and scene-integrated object generation. A new generative update strategy ensures 3D consistency across …

abstract advances arxiv combination cs.cv cs.gr diffusion diffusion models editing fields generative however image image diffusion images improvements neural radiance fields object opportunities photorealistic quality them type