From LLM to NMT: Advancing Low-Resource Machine Translation with Claude

arXiv:2404.13813v1 Announce Type: new
Abstract: We show that Claude 3 Opus, a large language model (LLM) released by Anthropic in March 2024, exhibits stronger machine translation competence than other LLMs. Though we find evidence of data contamination with Claude on FLORES-200, we curate new benchmarks that corroborate the effectiveness of Claude for low-resource machine translation into English. We find that Claude has remarkable \textit{resource efficiency} -- the degree to which the quality of the translation model depends on a language …

abstract anthropic arxiv benchmarks claude claude 3 claude 3 opus cs.ai cs.cl data evidence flores-200 language language model large language large language model llm llms low machine machine translation opus show translation type