Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Models

arXiv:2403.10258v1 Announce Type: new
Abstract: Large language models (LLMs) have demonstrated strong multilingual capabilities; yet, they are mostly English-centric due to the imbalanced training corpora. Existing works leverage this phenomenon to improve their multilingual performances on NLP tasks. In this work, we extend the evaluation from NLP tasks to real user queries. We find that even though translation into English can help improve the performance of multilingual NLP tasks for English-centric LLMs, it may not be optimal for all scenarios. …

abstract arxiv capabilities cs.cl english evaluation language language models large language large language models llms multilingual nlp performances study tasks training translation type work