ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models. (arXiv:2204.08790v4 [cs.CV] UPDATED)

Learning visual representations from natural language supervision has
recently shown great promise in a number of pioneering works. In general, these
language-augmented visual models demonstrate strong transferability to a
variety of datasets and tasks. However, it remains challenging to evaluate the
transferablity of these models due to the lack of easy-to-use evaluation
toolkits and public benchmarks. To tackle this, we build ELEVATER (Evaluation
of Language-augmented Visual Task-level Transfer), the first benchmark and
toolkit for evaluating(pre-trained) language-augmented visual models. ELEVATER
is …

arxiv benchmark language toolkit