Scene Graph Aided Radiology Report Generation

arXiv:2403.05687v1 Announce Type: new
Abstract: Radiology report generation (RRG) methods often lack sufficient medical knowledge to produce clinically accurate reports. The scene graph contains rich information to describe the objects in an image. We explore enriching the medical knowledge for RRG via a scene graph, which has not been done in the current RRG literature. To this end, we propose the Scene Graph aided RRG (SGRRG) network, a framework that generates region-level visual features, predicts anatomical attributes, and leverages an …

abstract arxiv cs.cv current explore graph image information knowledge medical objects radiology report reports type via