Contrastive Gaussian Clustering: Weakly Supervised 3D Scene Segmentation

arXiv:2404.12784v1 Announce Type: cross
Abstract: We introduce Contrastive Gaussian Clustering, a novel approach capable of provide segmentation masks from any viewpoint and of enabling 3D segmentation of the scene. Recent works in novel-view synthesis have shown how to model the appearance of a scene via a cloud of 3D Gaussians, and how to generate accurate images from a given viewpoint by projecting on it the Gaussians before $\alpha$ blending their color. Following this example, we train a model to include …

abstract arxiv cloud clustering cs.cv cs.lg enabling masks novel segmentation synthesis type via view