MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic. (arXiv:2305.03353v1 [cs.CL])

Theory of Mind (ToM) is a critical component of intelligence, yet accurately
measuring it continues to be a subject of debate. Prior research has attempted
to apply human ToM assessments to natural language processing models using
either human-created standardized tests or rule-based templates. However, these
methods primarily focus on simplistic reasoning and require further validation.
In this study, we utilize dynamic epistemic logic, which has established
overlaps with ToM, to generate more intricate problems. We also introduce novel
verbalization techniques …

apply arxiv dynamic human intelligence language language models language processing large language models logic natural natural language natural language processing prior processing research tests theory theory of mind tom