Action Detection via an Image Diffusion Process

arXiv:2404.01051v1 Announce Type: new
Abstract: Action detection aims to localize the starting and ending points of action instances in untrimmed videos, and predict the classes of those instances. In this paper, we make the observation that the outputs of the action detection task can be formulated as images. Thus, from a novel perspective, we tackle action detection via a three-image generation process to generate starting point, ending point and action-class predictions as images via our proposed Action Detection Image Diffusion …

abstract arxiv cs.cv detection diffusion image image diffusion images instances novel observation paper perspective process type via videos