UniMD: Towards Unifying Moment Retrieval and Temporal Action Detection

arXiv:2404.04933v1 Announce Type: new
Abstract: Temporal Action Detection (TAD) focuses on detecting pre-defined actions, while Moment Retrieval (MR) aims to identify the events described by open-ended natural language within untrimmed videos. Despite that they focus on different events, we observe they have a significant connection. For instance, most descriptions in MR involve multiple actions from TAD. In this paper, we aim to investigate the potential synergy between TAD and MR. Firstly, we propose a unified architecture, termed Unified Moment Detection …

arxiv cs.cv detection moment retrieval temporal type