Precision and Recall Reject Curves for Classification

arXiv:2308.08381v3 Announce Type: replace
Abstract: For some classification scenarios, it is desirable to use only those classification instances that a trained model associates with a high certainty. To obtain such high-certainty instances, previous work has proposed accuracy-reject curves. Reject curves allow to evaluate and compare the performance of different certainty measures over a range of thresholds for accepting or rejecting classifications. However, the accuracy may not be the most suited evaluation metric for all applications, and instead precision or recall …

abstract accuracy arxiv classification cs.lg instances performance precision recall type work