Cameras as Rays: Pose Estimation via Ray Diffusion

arXiv:2402.14817v1 Announce Type: cross
Abstract: Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparse views (<10). In contrast to existing approaches that pursue top-down prediction of global parametrizations of camera extrinsics, we propose a distributed representation of camera pose that treats a camera as a bundle of rays. This representation allows for a tight coupling with spatial image features improving pose precision. We observe that this representation is naturally suited for set-level level transformers …

3d reconstruction abstract arxiv cameras contrast cs.cv cs.lg diffusion distributed global prediction ray representation type via