Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

arXiv:2312.07246v2 Announce Type: replace
Abstract: This work delves into the task of pose-free novel view synthesis from stereo pairs, a challenging and pioneering task in 3D vision. Our innovative framework, unlike any before, seamlessly integrates 2D correspondence matching, camera pose estimation, and NeRF rendering, fostering a synergistic enhancement of these tasks. We achieve this through designing an architecture that utilizes a shared representation, which serves as a foundation for enhanced 3D geometry understanding. Capitalizing on the inherent interplay between the …

abstract arxiv cs.cv framework free nerf novel rendering synthesis type view vision work