CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation

arXiv:2211.01412v2 Announce Type: replace
Abstract: Radiology report generation (RRG) has gained increasing research attention because of its huge potential to mitigate medical resource shortages and aid the process of disease decision making by radiologists. Recent advancements in RRG are largely driven by improving a model's capabilities in encoding single-modal feature representations, while few studies explicitly explore the cross-modal alignment between image regions and words. Radiologists typically focus first on abnormal image regions before composing the corresponding text descriptions, thus cross-modal …

abstract arxiv attention capabilities class cs.cv decision decision making disease encoding making map medical modal network process radiology report research type