DreamComposer: Controllable 3D Object Generation via Multi-View Conditions

arXiv:2312.03611v2 Announce Type: replace-cross
Abstract: Utilizing pre-trained 2D large-scale generative models, recent works are capable of generating high-quality novel views from a single in-the-wild image. However, due to the lack of information from multiple views, these works encounter difficulties in generating controllable novel views. In this paper, we present DreamComposer, a flexible and scalable framework that can enhance existing view-aware diffusion models by injecting multi-view conditions. Specifically, DreamComposer first uses a view-aware 3D lifting module to obtain 3D representations of …

3d object abstract arxiv cs.ai cs.cv cs.lg generative generative models however image information multiple novel object paper quality scale type via view