A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models. (arXiv:2201.05337v1 [cs.CL])

Controllable Text Generation (CTG) is emerging area in the field of natural
language generation (NLG). It is regarded as crucial for the development of
advanced text generation technologies that are more natural and better meet the
specific constraints in practical applications. In recent years, methods using
large-scale pre-trained language models (PLMs), in particular the widely used
transformer-based PLMs, have become a new paradigm of NLG, allowing generation
of more diverse and fluent text. However, due to the lower level of …

arxiv language language models survey text text generation transformer