Narrative Action Evaluation with Prompt-Guided Multimodal Interaction

arXiv:2404.14471v1 Announce Type: new
Abstract: In this paper, we investigate a new problem called narrative action evaluation (NAE). NAE aims to generate professional commentary that evaluates the execution of an action. Unlike traditional tasks such as score-based action quality assessment and video captioning involving superficial sentences, NAE focuses on creating detailed narratives in natural language. These narratives provide intricate descriptions of actions along with objective evaluations. NAE is a more challenging task because it requires both narrative flexibility and evaluation …

arxiv cs.cv evaluation multimodal narrative prompt type