Merlin: A Vision Language Foundation Model for 3D Computed Tomography

arXiv:2406.06512v1 Announce Type: new
Abstract: Over 85 million computed tomography (CT) scans are performed annually in the US, of which approximately one quarter focus on the abdomen. Given the current radiologist shortage, there is a large impetus to use artificial intelligence to alleviate the burden of interpreting these complex imaging studies. Prior state-of-the-art approaches for automated medical image interpretation leverage vision language models (VLMs). However, current medical VLMs are generally limited to 2D images and short reports, and do not …

abstract artificial artificial intelligence arxiv cs.ai cs.cv current focus foundation foundation model imaging intelligence language merlin radiologist scans shortage type vision