Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attention. (arXiv:2207.08352v2 [cs.CV] UPDATED)

We propose a method to detect individualized highlights for users on given
target videos based on their preferred highlight clips marked on previous
videos they have watched. Our method explicitly leverages the contents of both
the preferred clips and the target videos using pre-trained features for the
objects and the human activities. We design a multi-head attention mechanism to
adaptively weigh the preferred clips based on their object- and
human-activity-based contents, and fuse them using these weights into a single …

arxiv attention cv head multi-head attention video