Evaluation of Geographical Distortions in Language Models: A Crucial Step Towards Equitable Representations

arXiv:2404.17401v1 Announce Type: new
Abstract: Language models now constitute essential tools for improving efficiency for many professional tasks such as writing, coding, or learning. For this reason, it is imperative to identify inherent biases. In the field of Natural Language Processing, five sources of bias are well-identified: data, annotation, representation, models, and research design. This study focuses on biases related to geographical knowledge. We explore the connection between geography and language models by highlighting their tendency to misrepresent spatial information, …

abstract arxiv bias biases coding cs.cl efficiency evaluation five identify improving language language models language processing natural natural language natural language processing processing professional reason tasks tools type writing