Fast Dynamic 3D Object Generation from a Single-view Video

arXiv:2401.08742v2 Announce Type: replace
Abstract: Generating dynamic 3D object from a single-view video is challenging due to the lack of 4D labeled data. Extending image-to-3D pipelines by transferring off-the-shelf image generation models such as score distillation sampling, existing methods tend to be slow and expensive to scale due to the need for back-propagating the information-limited supervision signals through a large pretrained model. To address this, we propose an efficient video-to-4D object generation framework called Efficient4D. It generates high-quality spacetime-consistent images …

3d object abstract arxiv cs.cv data distillation dynamic image image generation image generation models object pipelines sampling scale type video view