DINO — A Foundation Model for Computer Vision

DINO — A Foundation Model for Computer Vision

Paper Walkthrough: Emerging Properties in Self-Supervised Vision Transformers

It is an exciting decade for computer vision. Great successes from the natural language domain are transferred to the vision domain including the introduction of the ViT (vision transformer) and lately large-scale self-supervised pre-training techniques have made headlines under the name of foundation models.

Today we are looking into a framework called DINO (self DIstillation, NO labels), a visual foundation model built …

computer vision deep-dives deep learning foundation-models knowledge-distillation