Select and Reorder: A Novel Approach for Neural Sign Language Production

arXiv:2404.11532v1 Announce Type: new
Abstract: Sign languages, often categorised as low-resource languages, face significant challenges in achieving accurate translation due to the scarcity of parallel annotated datasets. This paper introduces Select and Reorder (S&R), a novel approach that addresses data scarcity by breaking down the translation process into two distinct steps: Gloss Selection (GS) and Gloss Reordering (GR). Our method leverages large spoken language models and the substantial lexical overlap between source spoken languages and target sign languages to establish …

abstract arxiv breaking challenges cs.cl data datasets face language languages low novel paper process production translation type