Taming Latent Diffusion Model for Neural Radiance Field Inpainting

arXiv:2404.09995v1 Announce Type: cross
Abstract: Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize reasonable geometry in completely uncovered regions. One major reason is the high diversity of synthetic contents from the diffusion model, which hinders the radiance field from converging to a crisp and deterministic geometry. Moreover, applying latent diffusion models on real data often …

arxiv cs.ai cs.cv cs.lg diffusion diffusion model inpainting neural radiance field type