A Spatio-Temporal Multilayer Perceptron for Gesture Recognition. (arXiv:2204.11511v2 [cs.CV] UPDATED)

Gesture recognition is essential for the interaction of autonomous vehicles
with humans. While the current approaches focus on combining several modalities
like image features, keypoints and bone vectors, we present neural network
architecture that delivers state-of-the-art results only with body skeleton
input data. We propose the spatio-temporal multilayer perceptron for gesture
recognition in the context of autonomous vehicles. Given 3D body poses over
time, we define temporal and spatial mixing operations to extract features in
both domains. Additionally, the importance …

arxiv cv gesture recognition perceptron temporal