Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation

arXiv:2312.07063v3 Announce Type: replace
Abstract: Reconstructing human-object interaction in 3D from a single RGB image is a challenging task and existing data driven methods do not generalize beyond the objects present in the carefully curated 3D interaction datasets. Capturing large-scale real data to learn strong interaction and 3D shape priors is very expensive due to the combinatorial nature of human-object interactions. In this paper, we propose ProciGen (Procedural interaction Generation), a method to procedurally generate datasets with both, plausible interaction …

abstract arxiv beyond cs.cv data datasets free human image learn object objects real data scale template type