SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

arXiv:2403.12008v1 Announce Type: new
Abstract: We present Stable Video 3D (SV3D) -- a latent video diffusion model for high-resolution, image-to-multi-view generation of orbital videos around a 3D object. Recent work on 3D generation propose techniques to adapt 2D generative models for novel view synthesis (NVS) and 3D optimization. However, these methods have several disadvantages due to either limited views or inconsistent NVS, thereby affecting the performance of 3D object generation. In this work, we propose SV3D that adapts image-to-video diffusion …

3d object abstract adapt arxiv cs.cv diffusion diffusion model generative generative models image novel object synthesis type video video diffusion videos view work