What Linguistic Features and Languages are Important in LLM Translation?

arXiv:2402.13917v1 Announce Type: new
Abstract: Large Language Models (LLMs) demonstrate strong capability across multiple tasks, including machine translation. Our study focuses on evaluating Llama2's machine translation capabilities and exploring how translation depends on languages in its training data. Our experiments show that the 7B Llama2 model yields above 10 BLEU score for all languages it has seen, but not always for languages it has not seen. Most gains for those unseen languages are observed the most with the model scale …

abstract arxiv bleu capabilities capability cs.ai cs.cl data features language language models languages large language large language models llama2 llm llms machine machine translation multiple show study tasks training training data translation type