Seeking Resources on Open-source Large Language Models Specializing in Causality Tasks

Happy Friday, `/r/languageTechnology` community,

I'm currently on a quest to discover resources - academic papers, GitHub repositories containing relevant experiments or testing setups, etc. - that focus on open-source large language models (LLMs) adept at handling tasks related to causality.

When I refer to LLMs, I'm particularly interested in the following established models, for which I'll also provide their Hugging Face Model Hub names where applicable:


- BERT (`bert-base-cased`, `bert-base-uncased`)
- RoBERTa (`roberta-base`)
- T5 (`t5-base`, `t5-v1_1-base`)
- DeBERTa (`deberta-v3-base`) …

academic causality community etc focus github language language models languagetechnology large language models llms resources testing