How Far Are We from Intelligent Visual Deductive Reasoning?

arXiv:2403.04732v1 Announce Type: cross
Abstract: Vision-Language Models (VLMs) such as GPT-4V have recently demonstrated incredible strides on diverse vision language tasks. We dig into vision-based deductive reasoning, a more sophisticated but less explored realm, and find previously unexposed blindspots in the current SOTA VLMs. Specifically, we leverage Raven's Progressive Matrices (RPMs), to assess VLMs' abilities to perform multi-hop relational and deductive reasoning relying solely on visual clues. We perform comprehensive evaluations of several popular VLMs employing standard strategies such as …

abstract arxiv cs.ai cs.cl cs.cv current diverse gpt gpt-4v intelligent language language models reasoning sota tasks type vision vision-language models visual vlms