They found a new NeRF technique to turn videos into controllable 3D models

The key challenge is that NeRFs typically require multiple view images to reconstruct a scene in 3D, whereas videos provide only a single view over time. But that means we have to capture a lot of data to create a NeRF.

What if there was a way to create **3D animated models of humans from monocular video footage** using NeRFs?

A new paper addresses this with a novel approach.

1. First, they fit a parametric model (SMPL) to align with …

3d models artificial challenge data found images multiple nerf the key videos