I-JEPA: The first AI model based on Yann LeCun’s vision for more human-like AI

Title: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Abstract:
This paper demonstrates an approach for learning highly semantic image representations without relying on hand-crafted data-augmentations. We introduce the Imagebased Joint-Embedding Predictive Architecture (I-JEPA), a non-generative approach for self-supervised learning from images. The idea behind I-JEPA is simple: from a single context block, predict the representations of various target blocks in the same image. A core design choice to guide I-JEPA towards producing semantic representations is the masking strategy; …

abstract ai model architecture computervision data embedding generative human human-like i-jepa image images jepa paper predictive self-supervised learning semantic supervised learning vision yann lecun