GREEN: Generative Radiology Report Evaluation and Error Notation

arXiv:2405.03595v1 Announce Type: new
Abstract: Evaluating radiology reports is a challenging problem as factual correctness is extremely important due to the need for accurate medical communication about medical images. Existing automatic evaluation metrics either suffer from failing to consider factual correctness (e.g., BLEU and ROUGE) or are limited in their interpretability (e.g., F1CheXpert and F1RadGraph). In this paper, we introduce GREEN (Generative Radiology Report Evaluation and Error Notation), a radiology report generation metric that leverages the natural language understanding of …

abstract arxiv bleu communication cs.ai cs.cl error evaluation evaluation metrics generative green images interpretability medical metrics notation radiology report reports type