Denoising Monte Carlo Renders With Diffusion Models

arXiv:2404.00491v1 Announce Type: new
Abstract: Physically-based renderings contain Monte-Carlo noise, with variance that increases as the number of rays per pixel decreases. This noise, while zero-mean for good modern renderers, can have heavy tails (most notably, for scenes containing specular or refractive objects). Learned methods for restoring low fidelity renders are highly developed, because suppressing render noise means one can save compute and use fast renders with few rays per pixel. We demonstrate that a diffusion model can denoise low …

abstract arxiv cs.cv denoising diffusion diffusion models fidelity good low mean modern monte-carlo noise objects per pixel type variance