EdiT5: Semi-Autoregressive Text-Editing with T5 Warm-Start. (arXiv:2205.12209v1 [cs.CL])

We present EdiT5 - a novel semi-autoregressive text-editing approach designed
to combine the strengths of non-autoregressive text-editing and autoregressive
decoding. EdiT5 is faster at inference times than conventional
sequence-to-sequence (seq2seq) models, while being capable of modeling flexible
input-output transformations.

This is achieved by decomposing the generation process into three sub-tasks:
(1) tagging to decide on the subset of input tokens to be preserved in the
output, (2) re-ordering to define their order in the output text, and (3)
insertion to …

arxiv text