Enhancing Representation in Medical Vision-Language Foundation Models via Multi-Scale Information Extraction Techniques

arXiv:2401.01583v2 Announce Type: replace
Abstract: The development of medical vision-language foundation models has attracted significant attention in the field of medicine and healthcare due to their promising prospect in various clinical applications. While previous studies have commonly focused on feature learning at a single learning scale, investigation on integrating multi-scale information is lacking, which may hinder the potential for mutual reinforcement among these features. This paper aims to bridge this gap by proposing a method that effectively exploits multi-scale information …

abstract applications arxiv attention clinical cs.cv development extraction feature foundation healthcare information information extraction investigation language medical medicine representation scale studies type via vision