Beyond Relevance: Evaluate and Improve Retrievers on Perspective Awareness

arXiv:2405.02714v1 Announce Type: cross
Abstract: The task of Information Retrieval (IR) requires a system to identify relevant documents based on users' information needs. In real-world scenarios, retrievers are expected to not only rely on the semantic relevance between the documents and the queries but also recognize the nuanced intents or perspectives behind a user query. For example, when asked to verify a claim, a retrieval system is expected to identify evidence from both supporting vs. contradicting perspectives, for the downstream …

abstract arxiv beyond cs.cl cs.ir documents identify information perspective perspectives queries retrieval semantic type world