Diff-IP2D: Diffusion-Based Hand-Object Interaction Prediction on Egocentric Videos

arXiv:2405.04370v1 Announce Type: new
Abstract: Understanding how humans would behave during hand-object interaction is vital for applications in service robot manipulation and extended reality. To achieve this, some recent works have been proposed to simultaneously predict hand trajectories and object affordances on human egocentric videos. They are regarded as the representation of future hand-object interactions, indicating potential human motion and motivation. However, the existing approaches mostly adopt the autoregressive paradigm for unidirectional prediction, which lacks mutual constraints within the holistic …

arxiv cs.cv diff diffusion object prediction type videos