Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects

arXiv:2403.16428v1 Announce Type: new
Abstract: We interact with the world with our hands and see it through our own (egocentric) perspective. A holistic 3D understanding of such interactions from egocentric views is important for tasks in robotics, AR/VR, action recognition and motion generation. Accurately reconstructing such interactions in 3D is challenging due to heavy occlusion, viewpoint bias, camera distortion, and motion blur from the head movement. To this end, we designed the HANDS23 challenge based on the AssemblyHands and ARCTIC …

abstract action recognition arxiv benchmarks challenges cs.cv interactions objects perspective recognition robotics tasks through type understanding world