Language Fairness in Multilingual Information Retrieval

arXiv:2405.00978v1 Announce Type: cross
Abstract: Multilingual information retrieval (MLIR) considers the problem of ranking documents in several languages for a query expressed in a language that may differ from any of those languages. Recent work has observed that approaches such as combining ranked lists representing a single document language each or using multilingual pretrained language models demonstrate a preference for one language over others. This results in systematic unfair treatment of documents in different languages. This work proposes a language …

arxiv cs.cl cs.ir fairness information language multilingual retrieval type