WinoViz: Probing Visual Properties of Objects Under Different States

arXiv:2402.13584v1 Announce Type: new
Abstract: Humans perceive and comprehend different visual properties of an object based on specific contexts. For instance, we know that a banana turns brown ``when it becomes rotten,'' whereas it appears green ``when it is unripe.'' Previous studies on probing visual commonsense knowledge have primarily focused on examining language models' understanding of typical properties (e.g., colors and shapes) of objects. We present WinoViz, a text-only evaluation dataset, consisting of 1,380 examples that probe the reasoning abilities …

abstract arxiv cs.cl green humans instance knowledge objects studies type visual