Multiclass ROC

arXiv:2404.13147v1 Announce Type: cross
Abstract: Model evaluation is of crucial importance in modern statistics application. The construction of ROC and calculation of AUC have been widely used for binary classification evaluation. Recent research generalizing the ROC/AUC analysis to multi-class classification has problems in at least one of the four areas: 1. failure to provide sensible plots 2. being sensitive to imbalanced data 3. unable to specify mis-classification cost and 4. unable to provide evaluation uncertainty quantification. Borrowing from a binomial …

abstract analysis application arxiv auc binary class classification construction cs.lg evaluation failure importance least modern plots research roc statistics stat.me stat.ml type