MedDr: Diagnosis-Guided Bootstrapping for Large-Scale Medical Vision-Language Learning

arXiv:2404.15127v1 Announce Type: new
Abstract: The rapid advancement of large-scale vision-language models has showcased remarkable capabilities across various tasks. However, the lack of extensive and high-quality image-text data in medicine has greatly hindered the development of large-scale medical vision-language models. In this work, we present a diagnosis-guided bootstrapping strategy that exploits both image and label information to construct vision-language datasets. Based on the constructed dataset, we developed MedDr, a generalist foundation model for healthcare capable of handling diverse medical data …

abstract advancement arxiv bootstrapping capabilities cs.cl cs.cv data development diagnosis exploits however image language language models medical medicine quality scale strategy tasks text type vision vision-language vision-language models work