Multi-Stream Keypoint Attention Network for Sign Language Recognition and Translation

arXiv:2405.05672v1 Announce Type: new
Abstract: Sign language serves as a non-vocal means of communication, transmitting information and significance through gestures, facial expressions, and bodily movements. The majority of current approaches for sign language recognition (SLR) and translation rely on RGB video inputs, which are vulnerable to fluctuations in the background. Employing a keypoint-based strategy not only mitigates the effects of background alterations but also substantially diminishes the computational demands of the model. Nevertheless, contemporary keypoint-based methodologies fail to fully harness …

arxiv attention cs.cv language network recognition translation type