RelTR: Relation Transformer for Scene Graph Generation. (arXiv:2201.11460v1 [cs.CV])

Web: http://arxiv.org/abs/2201.11460

Different objects in the same scene are more or less related to each other,
but only a limited number of these relationships are noteworthy. Inspired by
DETR, which excels in object detection, we view scene graph generation as a set
prediction problem and propose an end-to-end scene graph generation model RelTR
which has an encoder-decoder architecture. The encoder reasons about the visual
feature context while the decoder infers a fixed-size set of triplets
subject-predicate-object using different types of attention mechanisms …

arxiv cv graph transformer