[D] Problems with proprietary datasets

A lot of recent progress in AI was made on proprietary datasets e.g. ViT used JFT300M, both DALL-E/2 papers used proprietary text-image datasets. While the results are truly exceptional, a part of me keeps bothering me about the "proprietary" nature of the datasets which sometimes makes me question the actual robustness of these models. Every now and then I will have following questions about these models :

1. For pure image models (say ViT), are we sure that the proprietary …

datasets machinelearning