GRIT: Faster and Better Image captioning Transformer Using Dual Visual Features. (arXiv:2207.09666v1 [cs.CV])

Current state-of-the-art methods for image captioning employ region-based
features, as they provide object-level information that is essential to
describe the content of images; they are usually extracted by an object
detector such as Faster R-CNN. However, they have several issues, such as lack
of contextual information, the risk of inaccurate detection, and the high
computational cost. The first two could be resolved by additionally using
grid-based features. However, how to extract and fuse these two types of
features is uncharted. …

arxiv captioning cv features image transformer