GPT-4V(ision) Unsuitable for Clinical Care and Education: A Clinician-Evaluated Assessment

arXiv:2403.12046v1 Announce Type: new
Abstract: OpenAI's large multimodal model, GPT-4V(ision), was recently developed for general image interpretation. However, less is known about its capabilities with medical image interpretation and diagnosis. Board-certified physicians and senior residents assessed GPT-4V's proficiency across a range of medical conditions using imaging modalities such as CT scans, MRIs, ECGs, and clinical photographs. Although GPT-4V is able to identify and explain medical images, its diagnostic accuracy and clinical decision-making abilities are poor, posing risks to patient safety. …

abstract arxiv assessment board capabilities clinical clinician cs.cv diagnosis education general gpt gpt-4v however image imaging interpretation medical multimodal multimodal model openai physicians type