New Research: Scaling Generative AI Datasets Disproportionately Scales Racist Outputs, Especially Against Black Men

The larger the multimodal training dataset, the more likely the model will classify people of color as ‘criminals,’ research reveals

(DUBLIN, IRELAND | MONDAY, MAY 20, 2024) — In the rush to scale the datasets that train generative AI models, AI developers are also disproportionately scaling racism, according to a new investigation by Mozilla Senior Advisor Dr. Abeba Birhane and three fellow researchers.

The research — titled “The Dark Side of Dataset Scaling” — reveals that as multimodal …

ai datasets ai developers ai models color criminals dataset datasets developers dublin generative generative ai models ireland men monday multimodal people racism racist research scale scaling train training will