Releasing GPT-JT powered by open-source AI

With a new decentralized training algorithm, we fine-tuned GPT-J (6B) on
3.53 billion tokens, resulting in GPT-JT (6B), a model that outperforms
many 100B+ parameter models on classification benchmarks.

algorithm benchmarks billion classification decentralized gpt gpt-j gpt-jt open-source ai tokens training