Effective Unsupervised Constrained Text Generation based on Perturbed Masking

arXiv:2404.15877v1 Announce Type: new
Abstract: Unsupervised constrained text generation aims to generate text under a given set of constraints without any supervised data. Current state-of-the-art methods stochastically sample edit positions and actions, which may cause unnecessary search steps. In this paper, we propose PMCTG to improve effectiveness by searching for the best edit position and action in each step. Specifically, PMCTG extends perturbed masking technique to effectively search for the most incongruent token to edit. Then it introduces four multi-aspect …

abstract art arxiv constraints cs.cl current data edit generate masking paper sample search searching set state text text generation type unsupervised