Large Language Models Produce Responses Perceived to be Empathic

arXiv:2403.18148v1 Announce Type: new
Abstract: Large Language Models (LLMs) have demonstrated surprising performance on many tasks, including writing supportive messages that display empathy. Here, we had these models generate empathic messages in response to posts describing common life experiences, such as workplace situations, parenting, relationships, and other anxiety- and anger-eliciting situations. Across two studies (N=192, 202), we showed human raters a variety of responses written by several models (GPT4 Turbo, Llama2, and Mistral), and had people rate these responses on …

abstract anxiety arxiv cs.ai cs.cl empathy generate language language models large language large language models life llms messages parenting performance relationships responses tasks type workplace writing