What do Large Language Models Learn about Scripts?. (arXiv:2112.13834v2 [cs.CL] UPDATED)

Script Knowledge (Schank and Abelson, 1975) has long been recognized as
crucial for language understanding as it can help in filling in unstated
information in a narrative. However, such knowledge is expensive to produce
manually and difficult to induce from text due to reporting bias (Gordon and
Van Durme, 2013). In this work, we are interested in the scientific question of
whether explicit script knowledge is present and accessible through pre-trained
generative language models (LMs). To this end, we introduce …

arxiv language language models large language models