Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources. (arXiv:2201.10066v1 [cs.CL])

In recent years, large-scale data collection efforts have prioritized the
amount of data collected in order to improve the modeling capabilities of large
language models. This prioritization, however, has resulted in concerns with
respect to the rights of data subjects represented in data collections,
particularly when considering the difficulty in interrogating these collections
due to insufficient documentation and tools for analysis. Mindful of these
pitfalls, we present our methodology for a documentation-first, human-centered
data collection project as part of the …

arxiv bigscience data data sources language resources