EleutherAI Open-Sources 20 Billion Parameter AI Language Model GPT-NeoX-20B

Researchers from EleutherAI have open-sourced GPT-NeoX-20B, a 20-billion parameter natural language processing (NLP) AI model similar to GPT-3. The model was trained on 825GB of publicly available text data and has performance comparable to similarly-sized GPT-3 models.

ai deep learning eleutherai gpt language language model ml & data engineering natural language processing neural networks news