AffordanceLLM: Grounding Affordance from Vision Language Models

arXiv:2401.06341v2 Announce Type: replace
Abstract: Affordance grounding refers to the task of finding the area of an object with which one can interact. It is a fundamental but challenging task, as a successful solution requires the comprehensive understanding of a scene in multiple aspects including detection, localization, and recognition of objects with their parts, of geo-spatial configuration/layout of the scene, of 3D shapes and physics, as well as of the functionality and potential interaction of the objects and humans. Much …

arxiv cs.cv cs.ro language language models type vision