Confidence Intervals for Error Rates in 1:1 Matching Tasks: Critical Statistical Analysis and Recommendations

arXiv:2306.01198v3 Announce Type: replace-cross
Abstract: Matching algorithms are commonly used to predict matches between items in a collection. For example, in 1:1 face verification, a matching algorithm predicts whether two face images depict the same person. Accurately assessing the uncertainty of the error rates of such algorithms can be challenging when data are dependent and error rates are low, two aspects that have been often overlooked in the literature. In this work, we review methods for constructing confidence intervals for …

abstract algorithm algorithms analysis arxiv collection confidence cs.cv error example face images person recommendations statistical stat.me stat.ml tasks type uncertainty verification