Few shot point cloud reconstruction and denoising via learned Guassian splats renderings and fine-tuned diffusion features

arXiv:2404.01112v1 Announce Type: new
Abstract: Existing deep learning methods for the reconstruction and denoising of point clouds rely on small datasets of 3D shapes. We circumvent the problem by leveraging deep learning methods trained on billions of images. We propose a method to reconstruct point clouds from few images and to denoise point clouds from their rendering by exploiting prior knowledge distilled from image-based deep learning models. To improve reconstruction in constraint settings, we regularize the training of a differentiable …

abstract arxiv cloud cs.cg cs.cv datasets deep learning denoising diffusion features images small type via