Rasterized Edge Gradients: Handling Discontinuities Differentiably

arXiv:2405.02508v1 Announce Type: new
Abstract: Computing the gradients of a rendering process is paramount for diverse applications in computer vision and graphics. However, accurate computation of these gradients is challenging due to discontinuities and rendering approximations, particularly for surface-based representations and rasterization-based rendering. We present a novel method for computing gradients at visibility discontinuities for rasterization-based differentiable renderers. Our method elegantly simplifies the traditionally complex problem through a carefully designed approximation strategy, allowing for a straightforward, effective, and performant solution. …

abstract applications arxiv computation computer computer vision computing cs.cv cs.gr diverse diverse applications edge graphics however novel process rendering surface type visibility vision