DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models. (arXiv:2210.08933v2 [cs.CL] UPDATED)

Recently, diffusion models have emerged as a new paradigm for generative
models. Despite the success in domains using continuous signals such as vision
and audio, adapting diffusion models to natural language is difficult due to
the discrete nature of text. We tackle this challenge by proposing DiffuSeq: a
diffusion model designed for sequence-to-sequence (Seq2Seq) text generation
tasks. Upon extensive evaluation over a wide range of Seq2Seq tasks, we find
DiffuSeq achieving comparable or even better performance than six established
baselines, …

arxiv diffusion diffusion models sequence to sequence text text generation