Interplay of Machine Translation, Diacritics, and Diacritization

arXiv:2404.05943v1 Announce Type: new
Abstract: We investigate two research questions: (1) how do machine translation (MT) and diacritization influence the performance of each other in a multi-task learning setting (2) the effect of keeping (vs. removing) diacritics on MT performance. We examine these two questions in both high-resource (HR) and low-resource (LR) settings across 55 different languages (36 African languages and 19 European languages). For (1), results show that diacritization significantly benefits MT in the LR scenario, doubling or even …

abstract arxiv cs.ai cs.cl influence low machine machine translation multi-task learning performance questions research translation type