Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Models

arXiv:2404.12920v1 Announce Type: cross
Abstract: Localizing the exact pathological regions in a given medical scan is an important imaging problem that requires a large amount of bounding box ground truth annotations to be accurately solved. However, there exist alternative, potentially weaker, forms of supervision, such as accompanying free-text reports, which are readily available. The task of performing localization with textual guidance is commonly referred to as phrase grounding. In this work, we use a publicly available Foundation Model, namely the …

abstract annotations arxiv box cs.cv cs.lg diffusion diffusion models forms free however imaging medical reports supervision text truth type zero-shot