Conformal Ranked Retrieval

arXiv:2404.17769v1 Announce Type: cross
Abstract: Given the wide adoption of ranked retrieval techniques in various information systems that significantly impact our daily lives, there is an increasing need to assess and address the uncertainty inherent in their predictions. This paper introduces a novel method using the conformal risk control framework to quantitatively measure and manage risks in the context of ranked retrieval problems. Our research focuses on a typical two-stage ranked retrieval problem, where the retrieval stage generates candidates for …

abstract adoption arxiv control cs.ir daily framework impact information novel paper predictions retrieval risk risks stat.me stat.ml systems type uncertainty