MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior

arXiv:2405.02859v1 Announce Type: new
Abstract: Despite the emergence of successful NeRF inpainting methods built upon explicit RGB and depth 2D inpainting supervisions, these methods are inherently constrained by the capabilities of their underlying 2D inpainters. This is due to two key reasons: (i) independently inpainting constituent images results in view-inconsistent imagery, and (ii) 2D inpainters struggle to ensure high-quality geometry completion and alignment with inpainted RGB images.
To overcome these limitations, we propose a novel approach called MVIP-NeRF that harnesses …

abstract arxiv capabilities cs.cv diffusion emergence images inpainting key nerf prior results type via view