Testing the Depths of AI Empathy: Q1 2024 Benchmarks

This article presents benchmark results for assessing the empathetic capabilities of generative AI models using psychological and purpose-built measures. The tests include TAS-20, EQ-60, SQ-R, and IRI. The measure AEQ (Applied Empathy Quotient) was introduced. Most raw LLMs struggle to connect empathetically with users due to their balanced empathetic and systemized thinking capabilities. The closed model Willow demonstrates the highest empathetic capacity, while ChatGPT does not stand out significantly among other LLMs. Claude v3 Opus showed a decline in empathetic …

ai ai development ai models ai research article benchmark benchmarks capabilities empathy future-of-ai generative generative-ai generative ai models llms raw results struggle testing tests