Identifying the Correlation Between Language Distance and Cross-Lingual Transfer in a Multilingual Representation Space

arXiv:2305.02151v2 Announce Type: replace-cross
Abstract: Prior research has investigated the impact of various linguistic features on cross-lingual transfer performance. In this study, we investigate the manner in which this effect can be mapped onto the representation space. While past studies have focused on the impact on cross-lingual alignment in multilingual language models during fine-tuning, this study examines the absolute evolution of the respective language representation spaces produced by MLLMs. We place a specific emphasis on the role of linguistic characteristics …

abstract arxiv correlation cross-lingual cs.ai cs.cl cs.lg features impact language mapped multilingual performance prior representation research space studies study transfer type