Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions

arXiv:2403.20254v1 Announce Type: new
Abstract: Temporal action detection (TAD) aims to locate action positions and recognize action categories in long-term untrimmed videos. Although many methods have achieved promising results, their robustness has not been thoroughly studied. In practice, we observe that temporal information in videos can be occasionally corrupted, such as missing or blurred frames. Interestingly, existing methods often incur a significant performance drop even if only one frame is affected. To formally evaluate the robustness, we establish two temporal …

arxiv benchmarking cs.cv detection robustness temporal type