Exploring the psychology of LLMs' Moral and Legal Reasoning

arXiv:2308.01264v2 Announce Type: replace-cross
Abstract: Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models reason about moral and legal issues. In this paper, we employ the methods of experimental psychology to probe into this question. We replicate eight studies from the experimental literature with instances of Google's Gemini Pro, Anthropic's …

abstract art arxiv cs.ai cs.cl domains ethical expert future language language models large language large language models legal llms performance psychology reason reasoning state state of the art tasks type versions