Open-Set Video-based Facial Expression Recognition with Human Expression-sensitive Prompting

arXiv:2404.17100v1 Announce Type: new
Abstract: In Video-based Facial Expression Recognition (V-FER), models are typically trained on closed-set datasets with a fixed number of known classes. However, these V-FER models cannot deal with unknown classes that are prevalent in real-world scenarios. In this paper, we introduce a challenging Open-set Video-based Facial Expression Recognition (OV-FER) task, aiming at identifying not only known classes but also new, unknown human facial expressions not encountered during training. While existing approaches address open-set recognition by leveraging …

abstract arxiv cs.cv datasets deal facial expression however human paper prompting recognition set type video world