What is Your Favorite Gender, MLM? Gender Bias Evaluation in Multilingual Masked Language Models

arXiv:2404.06621v1 Announce Type: new
Abstract: Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed more than ever. While many studies have evaluated gender bias in English MLMs, only a few works have been conducted for the task in other languages. This paper proposes a multilingual approach to estimate gender bias …

abstract arxiv bias cs.cl evaluation gender gender bias impact language language models multilingual nlp success tasks transformer type