From Masked Image Modeling to Autoregressive Image Modeling

A brief review of the image foundation model pre-training objectives

We crave large models, don’t we?

The GPT series has proved its ability to revolutionize the NLP world, and everyone is excited to see the same transformation in the computer vision domain. The most popular image foundation models in recent years include SegmentAnything, DINOv2, and many others. The natural question is, what are the key differences between the pre-training stage of these foundation models?

Instead of answering this …

computer vision deep learning foundation-models machine learning transformers