On the Information Redundancy in Non-Autoregressive Translation

arXiv:2405.02673v1 Announce Type: new
Abstract: Token repetition is a typical form of multi-modal problem in fully non-autoregressive translation (NAT). In this work, we revisit the multi-modal problem in recently proposed NAT models. Our study reveals that these advanced models have introduced other types of information redundancy errors, which cannot be measured by the conventional metric - the continuous repetition ratio. By manually annotating the NAT outputs, we identify two types of information redundancy errors that correspond well to lexical and …

abstract advanced arxiv autoregressive cs.cl errors form information modal multi-modal nat redundancy study the information token translation type types work