Stanford AI Researchers Open-Source Diffusion-LM: A Novel And Controllable Language Model Based on Continuous Diffusions, Which Enables New Forms of Complex Fine-Grained Control Tasks

Language Models often behave in an unprecedented manner. Furthermore, natural language generation continues to face significant difficulties in controlling the behavior of language models without retraining. Gaining control over simple sentence properties (like sentiment) has allowed for some advancement in this area. However, the progress in intricate, fine-grained controls like syntactic structure has been little to nonexistent. Stanford University academics have developed an open-source Diffusion Language Model to solve this issue. This language model employs a plug-and-play control strategy, where …

ai continuous diffusion language language model languagetechnology researchers stanford