SA-VQA: Structured Alignment of Visual and Semantic Representations for Visual Question Answering. (arXiv:2201.10654v1 [cs.CV])

Web: http://arxiv.org/abs/2201.10654

Visual Question Answering (VQA) attracts much attention from both industry
and academia. As a multi-modality task, it is challenging since it requires not
only visual and textual understanding, but also the ability to align
cross-modality representations. Previous approaches extensively employ
entity-level alignments, such as the correlations between the visual regions
and their semantic labels, or the interactions across question words and object
features. These attempts aim to improve the cross-modality representations,
while ignoring their internal relations. Instead, we propose to …

arxiv cv question answering semantic