all AI news
Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation. (arXiv:2206.02368v2 [cs.CL] UPDATED)
cs.LG updates on arXiv.org arxiv.org
We introduce Bi-SimCut: a simple but effective training strategy to boost
neural machine translation (NMT) performance. It consists of two procedures:
bidirectional pretraining and unidirectional finetuning. Both procedures
utilize SimCut, a simple regularization method that forces the consistency
between the output distributions of the original and the cutoff sentence pairs.
Without leveraging extra dataset via back-translation or integrating
large-scale pretrained model, Bi-SimCut achieves strong translation performance
across five translation benchmarks (data sizes range from 160K to 20.2M): BLEU
scores of …
arxiv bi boosting machine machine translation neural machine translation strategy translation