Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing

arXiv:2310.14855v2 Announce Type: replace
Abstract: Large Language Models (LLM's) have demonstrated considerable success in various Natural Language Processing tasks, but they have yet to attain state-of-the-art performance in Neural Machine Translation (NMT). Nevertheless, their significant performance in tasks demanding a broad understanding and contextual processing shows their potential for translation. To exploit these abilities, we investigate using LLM's for MT and explore recent parameter-efficient fine-tuning techniques. Surprisingly, our initial experiments find that fine-tuning for translation purposes even led to performance …

arxiv cs.ai cs.cl document editing language language models large language large language models translations type