Multi-Dimensional Machine Translation Evaluation: Model Evaluation and Resource for Korean

arXiv:2403.12666v1 Announce Type: new
Abstract: Almost all frameworks for the manual or automatic evaluation of machine translation characterize the quality of an MT output with a single number. An exception is the Multidimensional Quality Metrics (MQM) framework which offers a fine-grained ontology of quality dimensions for scoring (such as style, fluency, accuracy, and terminology). Previous studies have demonstrated the feasibility of MQM annotation but there are, to our knowledge, no computational models that predict MQM scores for novel texts, due …

abstract arxiv cs.cl dimensions evaluation exception fine-grained framework frameworks machine machine translation metrics multidimensional ontology quality scoring style translation type