Animate124: Animating One Image to 4D Dynamic Scene

arXiv:2311.14603v2 Announce Type: replace
Abstract: We introduce Animate124 (Animate-one-image-to-4D), the first work to animate a single in-the-wild image into 3D video through textual motion descriptions, an underexplored problem with significant applications. Our 4D generation leverages an advanced 4D grid dynamic Neural Radiance Field (NeRF) model, optimized in three distinct stages using multiple diffusion priors. Initially, a static model is optimized using the reference image, guided by 2D and 3D diffusion priors, which serves as the initialization for the dynamic NeRF. …

abstract advanced applications arxiv cs.cv dynamic grid image multiple nerf neural radiance field textual through type video work