Uncertainty-Aware Perceiver

The Perceiver makes few architectural assumptions about the relationship among its inputs with quadratic scalability on its memory and computation time. Indeed, the Perceiver model outpaces or is competitive with ResNet-50 and ViT in terms of accuracy to some degree. However, the Perceiver does not take predictive uncertainty and calibration into account. The Perceiver also generalizes its performance on three datasets, three models, one evaluation metric, and one hyper-parameter setting. Worst of all, the Perceiver's relative performance improvement against other …

accuracy assumptions computation cs.cv cs.lg indeed inputs memory perceiver performance predictive relationship resnet resnet-50 scalability terms uncertainty vit