AI Researchers From PRIOR@AI2 Release ‘GRIT’: A General Robust Image Task Benchmark For Evaluating Computer Vision Model’s Performace

Most computer vision (CV) models are trained and assessed on a small number of concepts and with a strong assumption that the images and annotations in the training and test sets are distributed similarly. Therefore despite significant advances in CV, vision systems’ flexibility and generality still fall short of humans’ abilities to learn from various sources and generalize to new data sources and tasks.

The lack of a consistent technique and benchmark for measuring performance under distribution shifts is one …

ai ai2 benchmark computer computer vision computervision general image prior release researchers vision