A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation. (arXiv:2205.02022v2 [cs.CL] UPDATED)

Recent advances in the pre-training of language models leverage large-scale
datasets to create multilingual models. However, low-resource languages are
mostly left out in these datasets. This is primarily because many widely spoken
languages are not well represented on the web and therefore excluded from the
large-scale crawls used to create datasets. Furthermore, downstream users of
these models are restricted to the selection of languages originally chosen for
pre-training. This work investigates how to optimally leverage existing
pre-trained models to create …

arxiv go news pre-trained models translation