Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wild. (arXiv:2205.04749v1 [cs.CV])

Web: http://arxiv.org/abs/2205.04749

Previous methods for dynamic facial expression in the wild are mainly based
on Convolutional Neural Networks (CNNs), whose local operations ignore the
long-range dependencies in videos. To solve this problem, we propose the
spatio-temporal Transformer (STT) to capture discriminative features within
each frame and model contextual relationships among frames. Spatio-temporal
dependencies are captured and integrated by our unified Transformer.
Specifically, given an image sequence consisting of multiple frames as input,
we utilize the CNN backbone to translate each frame into …

arxiv cv transformer