Every Shot Counts: Using Exemplars for Repetition Counting in Videos

arXiv:2403.18074v1 Announce Type: new
Abstract: Video repetition counting infers the number of repetitions of recurring actions or motion within a video. We propose an exemplar-based approach that discovers visual correspondence of video exemplars across repetitions within target videos. Our proposed Every Shot Counts (ESCounts) model is an attention-based encoder-decoder that encodes videos of varying lengths alongside exemplars from the same and different videos. In training, ESCounts regresses locations of high correspondence to the exemplars within the video. In tandem, our …

abstract arxiv attention cs.cv decoder eess.iv encoder encoder-decoder every type video videos visual