Differentiable Point-based Inverse Rendering

arXiv:2312.02480v2 Announce Type: replace
Abstract: We present differentiable point-based inverse rendering, DPIR, an analysis-by-synthesis method that processes images captured under diverse illuminations to estimate shape and spatially-varying BRDF. To this end, we adopt point-based rendering, eliminating the need for multiple samplings per ray, typical of volumetric rendering, thus significantly enhancing the speed of inverse rendering. To realize this idea, we devise a hybrid point-volumetric representation for geometry and a regularized basis-BRDF representation for reflectance. The hybrid geometric representation enables fast …

abstract analysis arxiv cs.cv differentiable diverse images inverse rendering multiple per processes ray rendering speed synthesis type