[R] CLadder: A Benchmark to Assess Causal Reasoning Capabilities of Language Models

[Paper](https://arxiv.org/abs/2312.04350). I am not affiliated with the authors.

Abstract:

>The ability to perform causal reasoning is widely considered a core feature of intelligence. In this work, we investigate whether large language models (LLMs) can coherently reason about causality. Much of the existing work in natural language processing (NLP) focuses on evaluating commonsense causal reasoning in LLMs, thus failing to assess whether a model can perform causal inference in accordance with a set of well-defined formal rules. To address this, we …

abstract causal inference causality core feature inference intelligence language language models language processing large language large language models llms machinelearning natural natural language natural language processing nlp processing reason reasoning work