Re-Thinking Inverse Graphics With Large Language Models

arXiv:2404.15228v1 Announce Type: new
Abstract: Inverse graphics -- the task of inverting an image into physical variables that, when rendered, enable reproduction of the observed scene -- is a fundamental challenge in computer vision and graphics. Disentangling an image into its constituent elements, such as the shape, color, and material properties of the objects of the 3D scene that produced it, requires a comprehensive understanding of the environment. This requirement limits the ability of existing carefully engineered approaches to generalize …

arxiv cs.cl cs.cv graphics language language models large language large language models thinking type