‘A Promising Direction for Semi-Supervised Learning’ – AWS Lab’s Semi-ViT Beats CNNs While Maintaining Scalability

In the new paper Semi-supervised Vision Transformers at Scale, a research team from AWS AI Labs proposes a semi-supervised learning pipeline for vision transformers that is stable, reduces hyperparameter tuning sensitivity, and outperforms conventional convolutional neural networks.

ai artificial intelligence aws cnns deep-neural-networks lab learning machine learning machine learning & data science ml research scalability semi-supervised semi-supervised learning supervised learning technology vision-transformer