VideoXum: Cross-modal Visual and Textural Summarization of Videos

arXiv:2303.12060v3 Announce Type: replace
Abstract: Video summarization aims to distill the most important information from a source video to produce either an abridged clip or a textual narrative. Traditionally, different methods have been proposed depending on whether the output is a video or text, thus ignoring the correlation between the two semantically related tasks of visual summarization and textual summarization. We propose a new joint video and text summarization task. The goal is to generate both a shortened video clip …

abstract arxiv clip correlation cs.cl cs.cv information modal narrative summarization text textual type video videos visual