WoLF: Large Language Model Framework for CXR Understanding

arXiv:2403.15456v1 Announce Type: cross
Abstract: Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However, existing CXR understanding frameworks still possess several procedural caveats. (1) Previous methods solely use CXR reports, which are insufficient for comprehensive Visual Question Answering (VQA), especially when additional health-related data like medication history and prior diagnoses are needed. (2) Previous methods use raw CXR reports, which are …

abstract arxiv cs.ai cs.cl framework frameworks however language language model language models large language large language model modern question question answering ray report reports type understanding via vision vision-language models visual vlms vqa x-ray