VCD: Knowledge Base Guided Visual Commonsense Discovery in Images

arXiv:2402.17213v1 Announce Type: new
Abstract: Visual commonsense contains knowledge about object properties, relationships, and behaviors in visual data. Discovering visual commonsense can provide a more comprehensive and richer understanding of images, and enhance the reasoning and decision-making capabilities of computer vision systems. However, the visual commonsense defined in existing visual commonsense discovery studies is coarse-grained and incomplete. In this work, we draw inspiration from a commonsense knowledge base ConceptNet in natural language processing, and systematically define the types of visual …

abstract arxiv capabilities computer computer vision cs.ai cs.cv data decision discovery images knowledge knowledge base making reasoning relationships systems type understanding vision visual visual data