[D] Clean caption dataset

I am attempting to train CLIP from scratch. However, there is a lack of available datasets. The one dataset that seemed quite diverse and clean seems to be taken down (`laion-400m`). Looking at HF datasets, these are the two datasets that are promising, but wondering if there has been anything better/ cleaner.
- conceptual captions: uses alt-text.
- red_caps: reddit threads, but these are mostly the first comment on the image than an actual caption.

TIA

captions clip dataset datasets diverse however laion machinelearning scratch train