Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectance

arXiv:2312.04529v2 Announce Type: replace
Abstract: Reflectance bounds the frequency spectrum of illumination in the object appearance. In this paper, we introduce the first stochastic inverse rendering method, which recovers the attenuated frequency spectrum of an illumination jointly with the reflectance of an object of known geometry from a single image. Our key idea is to solve this blind inverse problem in the reflectance map, an appearance representation invariant to the underlying geometry, by learning to reverse the image formation with …

abstract arxiv cs.cv diffusion geometry image inverse rendering map object paper rendering spectrum stochastic type