Are you Struggling? Dataset and Baselines for Struggle Determination in Assembly Videos

arXiv:2402.11057v1 Announce Type: new
Abstract: Determining when people are struggling from video enables a finer-grained understanding of actions and opens opportunities for building intelligent support visual interfaces. In this paper, we present a new dataset with three assembly activities and corresponding performance baselines for the determination of struggle from video. Three real-world problem-solving activities including assembling plumbing pipes (Pipes-Struggle), pitching camping tents (Tent-Struggle) and solving the Tower of Hanoi puzzle (Tower-Struggle) are introduced. Video segments were scored w.r.t. the level …

abstract arxiv assembly building cs.cv dataset intelligent interfaces opportunities paper people performance struggle support type understanding video videos visual