Generalizable Novel-View Synthesis using a Stereo Camera

arXiv:2404.13541v1 Announce Type: new
Abstract: In this paper, we propose the first generalizable view synthesis approach that specifically targets multi-view stereo-camera images. Since recent stereo matching has demonstrated accurate geometry prediction, we introduce stereo matching into novel-view synthesis for high-quality geometry reconstruction. To this end, this paper proposes a novel framework, dubbed StereoNeRF, which integrates stereo matching into a NeRF-based generalizable view synthesis approach. StereoNeRF is equipped with three key components to effectively exploit stereo matching in novel-view synthesis: a …

abstract arxiv cs.cv framework geometry images novel paper prediction quality synthesis targets type view