HaLo-NeRF: Learning Geometry-Guided Semantics for Exploring Unconstrained Photo Collections

arXiv:2404.16845v1 Announce Type: new
Abstract: Internet image collections containing photos captured by crowds of photographers show promise for enabling digital exploration of large-scale tourist landmarks. However, prior works focus primarily on geometric reconstruction and visualization, neglecting the key role of language in providing a semantic interface for navigation and fine-grained understanding. In constrained 3D domains, recent methods have leveraged vision-and-language models as a strong prior of 2D visual semantics. While these models display an excellent understanding of broad visual semantics, …

arxiv cs.cv cs.gr geometry halo nerf photo semantics type