CoSe-Co: Text Conditioned Generative CommonSense Contextualizer. (arXiv:2206.05706v2 [cs.CL] UPDATED)

Web: http://arxiv.org/abs/2206.05706

Pre-trained Language Models (PTLMs) have been shown to perform well on
natural language tasks. Many prior works have leveraged structured commonsense
present in the form of entities linked through labeled relations in Knowledge
Graphs (KGs) to assist PTLMs. Retrieval approaches use KG as a separate static
module which limits coverage since KGs contain finite knowledge. Generative
methods train PTLMs on KG triples to improve the scale at which knowledge can
be obtained. However, training on symbolic KG entities limits their …

arxiv text