Continuous Sign Language Recognition Based on Motor attention mechanism and frame-level Self-distillation

arXiv:2402.19118v1 Announce Type: new
Abstract: Changes in facial expression, head movement, body movement and gesture movement are remarkable cues in sign language recognition, and most of the current continuous sign language recognition(CSLR) research methods mainly focus on static images in video sequences at the frame-level feature extraction stage, while ignoring the dynamic changes in the images. In this paper, we propose a novel motor attention mechanism to capture the distorted changes in local motion regions during sign language expression, and …

abstract arxiv attention continuous cs.cv current distillation extraction feature feature extraction focus head images language recognition research stage type video