Google Trains 280 Billion Parameter AI Language Model Gopher

Google subsidiary DeepMind announced Gopher, a 280-billion-parameter AI natural language processing (NLP) model. Based on the Transformer architecture and trained on a 10.5TB corpus called MassiveText, Gopher outperformed the current state-of-the-art on 100 of 124 evaluation tasks.

ai deep learning google google deepmind language language model ml & data engineering natural language processing news