Multimodal Frame-Scoring Transformer for Video Summarization. (arXiv:2207.01814v1 [cs.LG])

As the number of video content has mushroomed in recent years, automatic
video summarization has come useful when we want to just peek at the content of
the video. However, there are two underlying limitations in generic video
summarization task. First, most previous approaches read in just visual
features as input, leaving other modality features behind. Second, existing
datasets for generic video summarization are relatively insufficient to train a
caption generator and multimodal feature extractors. To address these two
problems, …

arxiv lg multimodal scoring summarization transformer video