Dual DETRs for Multi-Label Temporal Action Detection

arXiv:2404.00653v1 Announce Type: new
Abstract: Temporal Action Detection (TAD) aims to identify the action boundaries and the corresponding category within untrimmed videos. Inspired by the success of DETR in object detection, several methods have adapted the query-based framework to the TAD task. However, these approaches primarily followed DETR to predict actions at the instance level (i.e., identify each action by its center point), leading to sub-optimal boundary localization. To address this issue, we propose a new Dual-level query-based TAD framework, …

abstract arxiv cs.cv detection detr framework however identify object query success temporal type videos