Neural Sign Actors: A diffusion model for 3D sign language production from text

arXiv:2312.02702v2 Announce Type: replace
Abstract: Sign Languages (SL) serve as the primary mode of communication for the Deaf and Hard of Hearing communities. Deep learning methods for SL recognition and translation have achieved promising results. However, Sign Language Production (SLP) poses a challenge as the generated motions must be realistic and have precise semantic meaning. Most SLP methods rely on 2D data, which hinders their realism. In this work, a diffusion-based SLP model is trained on a curated large-scale dataset …

abstract actors arxiv challenge communication communities cs.cv deaf deep learning diffusion diffusion model generated hearing however language languages production recognition results serve text translation type