MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

arXiv:2404.12372v1 Announce Type: new
Abstract: Medical Visual Question Answering (MedVQA), which offers language responses to image-based medical inquiries, represents a challenging task and significant advancement in healthcare. It assists medical experts to swiftly interpret medical images, thereby enabling faster and more accurate diagnoses. However, the model interpretability and transparency of existing MedVQA solutions are often limited, posing challenges in understanding their decision-making processes. To address this issue, we devise a semi-automated annotation process to streamlining data preparation and build new …

abstract advancement arxiv cs.cv decision enabling experts faster healthcare however image images interpretability language making medical model interpretability multimodal question question answering responses transparency type via visual