HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion

https://arxiv.org/pdf/2305.06356.pdf

By Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, Matt Niessner

block in diverse applications, such as film production, computer games or videoconferencing. To close the gap to production-level quality, we intro- duce HumanRF1, a 4D dynamic neural scene representation that captures full-body appearance in motion from multi-view video input, and enables playback from novel, unseen viewpoints. Our novel representation acts as a dynamic video encoding that captures fine details at high compression rates by …

applications computer computervision diverse dynamic film games gap jonathan neural scene representation novel production quality representation video videoconferencing