Flying With Photons: Rendering Novel Views of Propagating Light

arXiv:2404.06493v1 Announce Type: new
Abstract: We present an imaging and neural rendering technique that seeks to synthesize videos of light propagating through a scene from novel, moving camera viewpoints. Our approach relies on a new ultrafast imaging setup to capture a first-of-its kind, multi-viewpoint video dataset with picosecond-level temporal resolution. Combined with this dataset, we introduce an efficient neural volume rendering framework based on the transient field. This field is defined as a mapping from a 3D point and 2D …

abstract arxiv cs.cv dataset eess.iv flying imaging kind light moving neural rendering novel rendering resolution setup temporal through type video videos