RelationVLM: Making Large Vision-Language Models Understand Visual Relations

arXiv:2403.12801v1 Announce Type: new
Abstract: The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual contents and ground text to them. Nonetheless, current LVLMs still struggle to precisely understand visual relations due to the lack of relevant data. In this work, we present RelationVLM, a large vision-language model capable of comprehending various levels …

abstract arxiv challenges contents cs.cv current development language language models large language large language models llms making object relations success text them type vision vision-language models visual