DiffPoint: Single and Multi-view Point Cloud Reconstruction with ViT Based Diffusion Model

arXiv:2402.11241v1 Announce Type: new
Abstract: As the task of 2D-to-3D reconstruction has gained significant attention in various real-world scenarios, it becomes crucial to be able to generate high-quality point clouds. Despite the recent success of deep learning models in generating point clouds, there are still challenges in producing high-fidelity results due to the disparities between images and point clouds. While vision transformers (ViT) and diffusion models have shown promise in various vision tasks, their benefits for reconstructing point clouds from …

2d-to-3d 3d reconstruction abstract arxiv attention challenges cloud cs.ai cs.cv deep learning diffusion diffusion model generate quality success type view vit world