Enhancing Visual Question Answering through Question-Driven Image Captions as Prompts

arXiv:2404.08589v1 Announce Type: new
Abstract: Visual question answering (VQA) is known as an AI-complete task as it requires understanding, reasoning, and inferring about the vision and the language content. Over the past few years, numerous neural architectures have been suggested for the VQA problem. However, achieving success in zero-shot VQA remains a challenge due to its requirement for advanced generalization and reasoning skills. This study explores the impact of incorporating image captioning as an intermediary process within the VQA pipeline. …

arxiv captions cs.ai cs.cv image prompts question question answering through type visual