Meta AI Introduces ‘Data2vec’ : A Self-Supervised Algorithm That Works For Speech, Computer Vision, and NLP

Web: https://www.reddit.com/r/artificial/comments/sew8xr/meta_ai_introduces_data2vec_a_selfsupervised/

Many critical recent developments in AI have been enabled by self-supervised learning. Machines learn by directly observing the world rather than being explicitly instructed through labeled images, text, audio, and other data sources.

However, whereas people appear to learn in similar ways regardless of how they obtain information — whether, through sight or hearing, self-supervised learning algorithms currently learn from images, speech, text, and other modalities in quite different ways.

Continue Reading.......

Paper: https://ai.facebook.com/research/data2vec-a-general-framework-for-self-supervised-learning-in-speech-vision-and-language

Github: https://github.com/pytorch/fairseq/tree/main/examples/data2vec

https://i.redd.it/02ps1fg0uge81.gif

ai algorithm artificial computer vision meta nlp speech vision