HELM: Benchmarking Large Language Models on the Together Research Computer

The benchmark ran Large Language Models on spare GPU cycles across
thousands of servers using Together software. Over 60,000 GPU hours were
harnessed and 11 billion tokens processed.

benchmark benchmarking billion computer gpu helm language language models large language large language models research servers software together tokens