Structure Modeling in Language Models

Abstract: We are approaching a future where text generation technologies will allow us to generate texts that are not only fluent at a surface level, but also coherent in their overall structure. To enable this future, my research
focuses on evaluating and improving structure modeling in language models. In the first part of this talk, I will introduce a method for quantifying structural coherence in language models. This method extracts structures by projecting data into a latent space of interest …

abstract future language language models modeling part research talk technologies text text generation