EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning

arXiv:2404.16670v1 Announce Type: new
Abstract: Visual Instruction Tuning represents a novel learning paradigm involving the fine-tuning of pre-trained language models using task-specific instructions. This paradigm shows promising zero-shot results in various natural language processing tasks but is still unexplored in vision emotion understanding. In this work, we focus on enhancing the model's proficiency in understanding and adhering to instructions related to emotional contexts. Initially, we identify key visual clues critical to visual emotion recognition. Subsequently, we introduce a novel GPT-assisted …

arxiv cs.ai cs.cv emotion insights type visual