DiffusionVMR: Diffusion Model for Joint Video Moment Retrieval and Highlight Detection

arXiv:2308.15109v2 Announce Type: replace
Abstract: Video moment retrieval and highlight detection have received attention in the current era of video content proliferation, aiming to localize moments and estimate clip relevances based on user-specific queries. Given that the video content is continuous in time, there is often a lack of clear boundaries between temporal events in a video. This boundary ambiguity makes it challenging for the model to learn text-video clip correspondences, resulting in the subpar performance of existing methods in …

abstract arxiv attention clip continuous cs.cv current detection diffusion diffusion model highlight moments queries retrieval type video