Playing to Vision Foundation Model's Strengths in Stereo Matching

arXiv:2404.06261v1 Announce Type: new
Abstract: Stereo matching has become a key technique for 3D environment perception in intelligent vehicles. For a considerable time, convolutional neural networks (CNNs) have remained the mainstream choice for feature extraction in this domain. Nonetheless, there is a growing consensus that the existing paradigm should evolve towards vision foundation models (VFM), particularly those developed based on vision Transformers (ViTs) and pre-trained through self-supervision on extensive, unlabeled datasets. While VFMs are adept at extracting informative, general-purpose visual …

abstract arxiv become cnns consensus convolutional neural networks cs.ai cs.cv cs.ro domain environment extraction feature feature extraction foundation foundation model intelligent key networks neural networks paradigm perception playing type vehicles vision