Free3D: Consistent Novel View Synthesis without 3D Representation

arXiv:2312.04551v2 Announce Type: replace
Abstract: We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-3, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS. Compared to other works that took a similar approach, we obtain significant improvements without resorting to an explicit 3D representation, which is slow and memory-consuming, and without training an additional network for 3D reconstruction. Our key contribution is to improve the way the …

arxiv consistent cs.cv novel representation synthesis type view