MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages. (arXiv:2208.13078v1 [cs.CL])

Owing to the lack of corpora for low-resource languages, current works on
dialogue generation have mainly focused on English. In this paper, we present
mDIA, the first large-scale multilingual benchmark for dialogue generation
across low- to high-resource languages. It covers real-life conversations in 46
languages across 19 language families. We present baseline results obtained by
fine-tuning the multilingual, non-dialogue-focused pre-trained model mT5 as
well as English-centric, dialogue-focused pre-trained chatbot DialoGPT. The
results show that mT5-based models perform better on sacreBLEU …

arxiv benchmark generation