Academically intelligent LLMs are not necessarily socially intelligent

arXiv:2403.06591v1 Announce Type: new
Abstract: The academic intelligence of large language models (LLMs) has made remarkable progress in recent times, but their social intelligence performance remains unclear. Inspired by established human social intelligence frameworks, particularly Daniel Goleman's social intelligence theory, we have developed a standardized social intelligence test based on real-world social scenarios to comprehensively assess the social intelligence of LLMs, termed as the Situational Evaluation of Social Intelligence (SESI). We conducted an extensive evaluation with 13 recent popular and …

abstract academic arxiv cs.cl cs.cy daniel frameworks human intelligence intelligent language language models large language large language models llms performance progress social test theory type world