Differentiable Rendering with Reparameterized Volume Sampling

arXiv:2302.10970v3 Announce Type: replace
Abstract: In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes a weighted sum of radiance emitted from a dense set of ray points. This rendering algorithm is fully differentiable and facilitates gradient-based optimization of the fields. However, in practice, only a tiny opaque portion of the ray …

abstract arxiv cs.cv differentiable fields generate neural radiance field novel pixel ray rendering sampling set synthesis through type view