PyTorchGeoNodes: Enabling Differentiable Shape Programs for 3D Shape Reconstruction

arXiv:2404.10620v1 Announce Type: cross
Abstract: We propose PyTorchGeoNodes, a differentiable module for reconstructing 3D objects from images using interpretable shape programs. In comparison to traditional CAD model retrieval methods, the use of shape programs for 3D reconstruction allows for reasoning about the semantic properties of reconstructed objects, editing, low memory footprint, etc. However, the utilization of shape programs for 3D scene understanding has been largely neglected in past works. As our main contribution, we enable gradient-based optimization by introducing a …

3d objects 3d reconstruction abstract arxiv cad comparison cs.cv cs.lg differentiable editing enabling images low memory objects reasoning retrieval semantic type