SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models

arXiv:2309.11566v2 Announce Type: replace
Abstract: We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system. In addition to previous work that employs complex factorization techniques to enable translation between text and SignWriting, we show that a traditional text-to-text translation approach performs equally effectively on the cleaned SignBank+ dataset. Our evaluation results indicate that models trained on SignBank+ surpass those on the original dataset, establishing …

abstract arxiv cs.cl dataset factorization language language models large language large language models machine machine translation multilingual spoken text translation type work writing