SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequences

arXiv:2405.02977v1 Announce Type: cross
Abstract: Numerous sign language datasets exist, yet they typically cover only a limited selection of the thousands of signs used globally. Moreover, creating diverse sign language datasets is an expensive and challenging task due to the costs associated with gathering a varied group of signers. Motivated by these challenges, we aimed to develop a solution that addresses these limitations. In this context, we focused on textually describing body movements from skeleton keypoint sequences, leading to the …

abstract arxiv automated costs cs.cv cs.lg datasets diverse language text type