ExpansionNet: exploring the sequence length bottleneck in the Transformer for Image Captioning. (arXiv:2207.03327v2 [cs.CV] UPDATED)

Most recent state of art architectures rely on combinations and variations of
three approaches: convolutional, recurrent and self-attentive methods. Our work
attempts in laying the basis for a new research direction for sequence modeling
based upon the idea of modifying the sequence length. In order to do that, we
propose a new method called "Expansion Mechanism" which transforms either
dynamically or statically the input sequence into a new one featuring a
different sequence length. Furthermore, we introduce a novel architecture …

arxiv captioning cv image transformer