UNK-VQA: A Dataset and A Probe into Multi-modal Large Models' Abstention Ability

arXiv:2310.10942v3 Announce Type: replace
Abstract: Teaching Visual Question Answering (VQA) models to refrain from answering unanswerable questions is necessary for building a trustworthy AI system. Existing studies, though have explored various aspects of VQA but somewhat ignored this particular attribute. This paper aims to bridge the research gap by contributing a comprehensive dataset, called UNK-VQA. The dataset is specifically designed to address the challenge of questions that models do not know. To this end, we first augment the existing data …

arxiv cs.cv dataset large models modal multi-modal probe type vqa