GS-IR: 3D Gaussian Splatting for Inverse Rendering

arXiv:2311.16473v3 Announce Type: replace
Abstract: We propose GS-IR, a novel inverse rendering approach based on 3D Gaussian Splatting (GS) that leverages forward mapping volume rendering to achieve photorealistic novel view synthesis and relighting results. Unlike previous works that use implicit neural representations and volume rendering (e.g. NeRF), which suffer from low expressive power and high computational complexity, we extend GS, a top-performance representation for novel view synthesis, to estimate scene geometry, surface material, and environment illumination from multi-view images captured …

abstract arxiv cs.cv implicit neural representations inverse rendering low mapping nerf novel photorealistic power rendering results synthesis type view