Robust COVID-19 Detection in CT Images with CLIP

arXiv:2403.08947v1 Announce Type: cross
Abstract: In the realm of medical imaging, particularly for COVID-19 detection, deep learning models face substantial challenges such as the necessity for extensive computational resources, the paucity of well-annotated datasets, and a significant amount of unlabeled data. In this work, we introduce the first lightweight detector designed to overcome these obstacles, leveraging a frozen CLIP image encoder and a trainable multilayer perception (MLP). Enhanced with Conditional Value at Risk (CVaR) for robustness and a loss landscape …

arxiv clip covid covid-19 cs.cv detection eess.iv images robust type