Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review

arXiv:2403.02469v1 Announce Type: cross
Abstract: Medical vision-language models (VLMs) combine computer vision and natural language processing to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare, focusing on models designed for medical report generation and visual question answering. We provide background on natural language processing and computer vision, explaining how techniques from both fields are integrated into VLMs to enable learning from multimodal data. Key areas we address include the exploration of …

abstract analyze and natural language processing arxiv computer computer vision cs.cv cs.lg data healthcare language language models language processing medical medical data natural natural language natural language processing paper processing question question answering report review reviews textual type vision vision-language models visual vlms