Coverage-Guaranteed Prediction Sets for Out-of-Distribution Data

arXiv:2403.19950v1 Announce Type: new
Abstract: Out-of-distribution (OOD) generalization has attracted increasing research attention in recent years, due to its promising experimental results in real-world applications. In this paper,we study the confidence set prediction problem in the OOD generalization setting. Split conformal prediction (SCP) is an efficient framework for handling the confidence set prediction problem. However, the validity of SCP requires the examples to be exchangeable, which is violated in the OOD setting. Empirically, we show that trivially applying SCP results …

abstract applications arxiv attention confidence coverage cs.lg data distribution experimental framework paper prediction research results set set prediction split study type world