Vision Transformer with Convolutional Encoder-Decoder for Hand Gesture Recognition using 24 GHz Doppler Radar. (arXiv:2209.05032v1 [eess.SP])

Transformers combined with convolutional encoders have been recently used for
hand gesture recognition (HGR) using micro-Doppler signatures. We propose a
vision-transformer-based architecture for HGR with multi-antenna
continuous-wave Doppler radar receivers. The proposed architecture consists of
three modules: a convolutional encoderdecoder, an attention module with three
transformer layers, and a multi-layer perceptron. The novel convolutional
decoder helps to feed patches with larger sizes to the attention module for
improved feature extraction. Experimental results obtained with a dataset
corresponding to a two-antenna …

arxiv encoder encoder-decoder gesture recognition radar transformer vision