Detect2Interact: Localizing Object Key Field in Visual Question Answering (VQA) with LLMs

arXiv:2404.01151v1 Announce Type: new
Abstract: Localization plays a crucial role in enhancing the practicality and precision of VQA systems. By enabling fine-grained identification and interaction with specific parts of an object, it significantly improves the system's ability to provide contextually relevant and spatially accurate responses, crucial for applications in dynamic environments like robotics and augmented reality. However, traditional systems face challenges in accurately mapping objects within images to generate nuanced and spatially aware responses. In this work, we introduce "Detect2Interact", …

abstract applications arxiv cs.cv enabling fine-grained identification key llms localization object precision question question answering responses role systems type visual vqa