MetaFormer: De facto need for Vision?

What is the key to the success of Vision Transformers?

Vision Transformer

Recently, Transformer has gained popularity since Alexey Dosovitskiy proposed Vision Transformer (ViT) in his paper. ViT has been shown to be able to outperform Convolutional Neural Networks (CNNs) in image classification tasks while requiring fewer computational resources.

CNNs have taken the crown in computer vision for the last decade and a young ViT which for the first time steps over to …

computer vision deep learning image-classification object-detection vision vision-transformer