On Reality and the Limits of Language Data. (arXiv:2208.11981v1 [cs.CL])

Recent advances in neural network language models have shown that it is
possible to derive expressive meaning representations by leveraging linguistic
associations in large-scale natural language data. These potentially Gestalt
representations have enabled state-of-the-art performance for many practical
applications. It would appear that we are on a pathway to empirically deriving
a robust and expressive computable semantics. A key question that arises is how
far can language data alone enable computers to understand the necessary truth
about the physical world? …

arxiv data language language data reality