Microsoft Researchers Propose AI Morality Test for LLMs in New Study

Researchers from Microsoft have just proposed using a psychological assessment tool called the Defining Issues Test (DIT) to evaluate the moral reasoning capabilities of large language models (LLMs) like GPT-3, ChatGPT, etc.

The DIT presents moral dilemmas and has subjects rate and rank the importance of various ethical considerations related to the dilemma. It allows quantifying the sophistication of moral thinking through a P-score.

In this new paper, the researchers tested prominent LLMs with adapted DIT prompts containing AI-relevant moral …

artificial assessment capabilities chatgpt dilemmas etc ethical ethical considerations gpt gpt-3 importance language language models large language large language models llms microsoft rate reasoning researchers study test tool