I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactions

arXiv:2312.08869v2 Announce Type: replace
Abstract: We are living in a world surrounded by diverse and "smart" devices with rich modalities of sensing ability. Conveniently capturing the interactions between us humans and these objects remains far-reaching. In this paper, we present I'm-HOI, a monocular scheme to faithfully capture the 3D motions of both the human and object in a novel setting: using a minimal amount of RGB camera and object-mounted Inertial Measurement Unit (IMU). It combines general motion inference and category-aware …

abstract arxiv cs.cv devices diverse human humans interactions object objects paper sensing smart type world