Meta Develops Dataset Pruning Technique for Scaling AI Training

Researchers from Meta AI and Stanford University have developed a metric for pruning AI datasets which improves training scalability from a power-law to exponential-decay. The metric uses self-supervised learning and performs comparably to existing metrics which require more compute power.

ai ai training dataset deep learning meta ml & data engineering neural networks news pruning scaling scaling ai training