SUDO: a framework for evaluating clinical artificial intelligence systems without ground-truth annotations

arXiv:2403.17011v1 Announce Type: new
Abstract: A clinical artificial intelligence (AI) system is often validated on a held-out set of data which it has not been exposed to before (e.g., data from a different hospital with a distinct electronic health record system). This evaluation process is meant to mimic the deployment of an AI system on data in the wild; those which are currently unseen by the system yet are expected to be encountered in a clinical setting. However, when data …

abstract annotations artificial artificial intelligence arxiv clinical cs.ai cs.cy cs.lg data electronic electronic health record evaluation framework ground-truth health hospital intelligence process set systems truth type