Gaze-guided Hand-Object Interaction Synthesis: Benchmark and Method

arXiv:2403.16169v1 Announce Type: new
Abstract: Gaze plays a crucial role in revealing human attention and intention, shedding light on the cognitive processes behind human actions. The integration of gaze guidance with the dynamics of hand-object interactions boosts the accuracy of human motion prediction. However, the lack of datasets that capture the intricate relationship and consistency among gaze, hand, and object movements remains a substantial hurdle. In this paper, we introduce the first Gaze-guided Hand-Object Interaction dataset, GazeHOI, and present a …

abstract accuracy arxiv attention benchmark cognitive cs.cv datasets dynamics guidance however human integration interactions light object prediction processes relationship role synthesis type