CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation

arXiv:2404.11111v1 Announce Type: new
Abstract: In sign language, the conveyance of human body trajectories predominantly relies upon the coordinated movements of hands and facial expressions across successive frames. Despite the recent advancements of sign language understanding methods, they often solely focus on individual frames, inevitably overlooking the inter-frame correlations that are essential for effectively modeling human body trajectories. To address this limitation, this paper introduces a spatial-temporal correlation network, denoted as CorrNet+, which explicitly identifies body trajectories across multiple frames. …

arxiv correlation cs.cv language recognition spatial temporal translation type via