Understanding Cross-Lingual Alignment -- A Survey

arXiv:2404.06228v1 Announce Type: new
Abstract: Cross-lingual alignment, the meaningful similarity of representations across languages in multilingual language models, has been an active field of research in recent years. We survey the literature of techniques to improve cross-lingual alignment, providing a taxonomy of methods and summarising insights from throughout the field. We present different understandings of cross-lingual alignment and their limitations. We provide a qualitative summary of results from a large number of surveyed papers. Finally, we discuss how these insights …

abstract alignment arxiv cross-lingual cs.cl insights language language models languages literature multilingual research survey taxonomy type understanding