Differentiable Frequency-based Disentanglement for Aerial Video Action Recognition. (arXiv:2209.09194v2 [cs.CV] UPDATED)

We present a learning algorithm for human activity recognition in videos. Our
approach is designed for UAV videos, which are mainly acquired from obliquely
placed dynamic cameras that contain a human actor along with background motion.
Typically, the human actors occupy less than one-tenth of the spatial
resolution. Our approach simultaneously harnesses the benefits of frequency
domain representations, a classical analysis tool in signal processing, and
data driven neural networks. We build a differentiable static-dynamic frequency
mask prior to model …

arxiv video