A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias

arXiv:2404.00929v1 Announce Type: new
Abstract: Based on the foundation of Large Language Models (LLMs), Multilingual Large Language Models (MLLMs) have been developed to address the challenges of multilingual natural language processing tasks, hoping to achieve knowledge transfer from high-resource to low-resource languages. However, significant limitations and challenges still exist, such as language imbalance, multilingual alignment, and inherent bias. In this paper, we aim to provide a comprehensive analysis of MLLMs, delving deeply into discussions surrounding these critical issues. First of …

abstract alignment arxiv bias challenges cs.ai cs.cl foundation however knowledge language language models language processing languages large language large language models limitations llms low mllms multilingual natural natural language natural language processing processing survey tasks transfer type