all AI news
Self-Supervised Learning for Covariance Estimation
March 14, 2024, 4:42 a.m. | Tzvi Diskin, Ami Wiesel
cs.LG updates on arXiv.org arxiv.org
Abstract: We consider the use of deep learning for covariance estimation. We propose to globally learn a neural network that will then be applied locally at inference time. Leveraging recent advancements in self-supervised foundational models, we train the network without any labeling by simply masking different samples and learning to predict their covariance given their surrounding neighbors. The architecture is based on the popular attention mechanism. Its main advantage over classical methods is the automatic exploitation …
abstract arxiv covariance cs.lg deep learning eess.sp foundational models inference labeling learn masking network neural network samples self-supervised learning supervised learning train type will
More from arxiv.org / cs.LG updates on arXiv.org
Jobs in AI, ML, Big Data
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote