Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs

arXiv:2402.11218v1 Announce Type: new
Abstract: Controlled Text Generation (CTG) aims to produce texts that exhibit specific desired attributes. In this study, we introduce a pluggable CTG framework for Large Language Models (LLMs) named Dynamic Attribute Graphs-based controlled text generation (DATG). This framework utilizes an attribute scorer to evaluate the attributes of sentences generated by LLMs and constructs dynamic attribute graphs. DATG modulates the occurrence of key attribute words and key anti-attribute words, achieving effective attribute control without compromising the original …

abstract arxiv controlled text generation cs.cl dynamic framework graphs language language model language models large language large language model large language models llms study text text generation type