How to Benchmark Vision Foundation Models for Semantic Segmentation?

arXiv:2404.12172v1 Announce Type: cross
Abstract: Recent vision foundation models (VFMs) have demonstrated proficiency in various tasks but require supervised fine-tuning to perform the task of semantic segmentation effectively. Benchmarking their performance is essential for selecting current models and guiding future model developments for this task. The lack of a standardized benchmark complicates comparisons. Therefore, the primary objective of this paper is to study how VFMs should be benchmarked for semantic segmentation. To do so, various VFMs are fine-tuned under various …

arxiv benchmark cs.ai cs.cv cs.lg cs.ro foundation segmentation semantic type vision