Modeling Semantic Composition with Syntactic Hypergraph for Video Question Answering. (arXiv:2205.06530v1 [cs.CV])

A key challenge in video question answering is how to realize the cross-modal
semantic alignment between textual concepts and corresponding visual objects.
Existing methods mostly seek to align the word representations with the video
regions. However, word representations are often not able to convey a complete
description of textual concepts, which are in general described by the
compositions of certain words. To address this issue, we propose to first build
a syntactic dependency tree for each question with an off-the-shelf …

arxiv cv hypergraph modeling question answering semantic video