Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructions

arXiv:2305.15083v3 Announce Type: replace
Abstract: Large-scale Pretrained Language Models (LLMs), such as ChatGPT and GPT4, have shown strong abilities in multilingual translations, without being explicitly trained on parallel corpora. It is interesting how the LLMs obtain their ability to carry out translation instructions for different languages. In this paper, we present a detailed analysis by finetuning a multilingual pretrained language model, XGLM-7B, to perform multilingual translation following given instructions. Firstly, we show that multilingual LLMs have stronger translation abilities than …

abstract arxiv chatgpt cs.cl finetuning gpt4 language language models languages large language large language models llms multilingual scale translation type via