Language-Based Depth Hints for Monocular Depth Estimation

arXiv:2403.15551v1 Announce Type: new
Abstract: Monocular depth estimation (MDE) is inherently ambiguous, as a given image may result from many different 3D scenes and vice versa. To resolve this ambiguity, an MDE system must make assumptions about the most likely 3D scenes for a given input. These assumptions can be either explicit or implicit. In this work, we demonstrate the use of natural language as a source of an explicit prior about the structure of the world. The assumption is …

3d scenes abstract arxiv assumptions cs.ai cs.cv image language mde type