BigScience AI Researchers Open-Source ‘BLOOM’: An Autoregressive Multilingual Large Language Model Larger Than GPT-3 and OPT-175B

BigScience Project introduces BLOOM (BigScience Large Open-science Open-access Multilingual Language Model), the first multilingual Large Language Model (LLM) trained in complete transparency by the largest group of AI academics. Unlike the traditional secrecy of industrial AI research laboratories, the project demonstrates the possibility of training promising AI models published by the larger research community responsibly and openly.

✅ Transformers-based LLM

✅ 176B parameters (larger than GPT-3 and OPT-175B)

✅ Trained on 1.6TB text data, the equivalent of 320 times the …

ai bigscience bloom gpt gpt-3 language language model languagetechnology large language model opt-175b researchers