GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computing

arXiv:2403.05916v1 Announce Type: new
Abstract: Multimodal language models (MLMs) are designed to process and integrate information from multiple sources, such as text, speech, images, and videos. Despite its success in language understanding, it is critical to evaluate the performance of downstream tasks for better human-centric applications. This paper assesses the application of MLMs with 5 crucial abilities for affective computing, spanning from visual affective tasks and reasoning tasks. The results show that GPT4 has high accuracy in facial action unit …

arxiv computing cs.ai cs.cv gpt gpt-4v type visual