Analyzing the Roles of Language and Vision in Learning from Limited Data

arXiv:2403.19669v1 Announce Type: new
Abstract: Does language help make sense of the visual world? How important is it to actually see the world rather than having it described with words? These basic questions about the nature of intelligence have been difficult to answer because we only had one example of an intelligent system -- humans -- and limited access to cases that isolated language or vision. However, the development of sophisticated Vision-Language Models (VLMs) by artificial intelligence researchers offers us …

abstract arxiv basic cs.ai cs.cl cs.cv cs.lg data intelligence language nature questions roles sense type vision visual words world