On Large Visual Language Models for Medical Imaging Analysis: An Empirical Study

arXiv:2402.14162v1 Announce Type: new
Abstract: Recently, large language models (LLMs) have taken the spotlight in natural language processing. Further, integrating LLMs with vision enables the users to explore emergent abilities with multimodal data. Visual language models (VLMs), such as LLaVA, Flamingo, or CLIP, have demonstrated impressive performance on various visio-linguistic tasks. Consequently, there are enormous applications of large models that could be potentially used in the biomedical imaging field. Along that direction, there is a lack of related work to …

abstract analysis arxiv clip cs.ai cs.cv data explore imaging language language models language processing large language large language models llava llms medical medical imaging multimodal multimodal data natural natural language natural language processing performance processing spotlight study type vision visual vlms