MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints

arXiv:2404.07094v1 Announce Type: new
Abstract: This paper presents Key2Mesh, a model that takes a set of 2D human pose keypoints as input and estimates the corresponding body mesh. Since this process does not involve any visual (i.e. RGB image) data, the model can be trained on large-scale motion capture (MoCap) datasets, thereby overcoming the scarcity of image datasets with 3D labels. To enable the model's application on RGB images, we first run an off-the-shelf 2D pose estimator to obtain the …

arxiv cs.cv domain domain adaptation human mesh type visual