Isometric MT: Neural Machine Translation for Automatic Dubbing. (arXiv:2112.08682v3 [cs.CL] UPDATED)

Automatic dubbing (AD) is among the machine translation (MT) use cases where
translations should match a given length to allow for synchronicity between
source and target speech. For neural MT, generating translations of length
close to the source length (e.g. within +-10% in character count), while
preserving quality is a challenging task. Controlling MT output length comes at
a cost to translation quality, which is usually mitigated with a two step
approach of generating N-best hypotheses and then re-ranking based …

arxiv dubbing machine machine translation neural machine translation translation