Skim then Focus: Integrating Contextual and Fine-grained Views for Repetitive Action Counting

arXiv:2406.08814v1 Announce Type: new
Abstract: The key to action counting is accurately locating each video's repetitive actions. Instead of estimating the probability of each frame belonging to an action directly, we propose a dual-branch network, i.e., SkimFocusNet, working in a two-step manner. The model draws inspiration from empirical observations indicating that humans typically engage in coarse skimming of entire sequences to grasp the general action pattern initially, followed by a finer, frame-by-frame focus to determine if it aligns with the …

abstract action arxiv cs.cv fine-grained focus inspiration key network probability the key type video