Empathy Through Multimodality in Conversational Interfaces

arXiv:2405.04777v1 Announce Type: new
Abstract: Agents represent one of the most emerging applications of Large Language Models (LLMs) and Generative AI, with their effectiveness hinging on multimodal capabilities to navigate complex user environments. Conversational Health Agents (CHAs), a prime example of this, are redefining healthcare by offering nuanced support that transcends textual analysis to incorporate emotional intelligence. This paper introduces an LLM-based CHA engineered for rich, multimodal dialogue-especially in the realm of mental health support. It adeptly interprets and responds …

abstract agents analysis applications arxiv capabilities conversational cs.cl empathy environments example generative health healthcare interfaces language language models large language large language models llms multimodal multimodal capabilities multimodality prime support textual through type