RedPajama training progress at 440 billion tokens

In this post we share progress on training RedPajama-7B and benchmark
results using several HELM scenarios, comparing to Pythian-7B and LLaMA-7B.

benchmark billion helm llama progress redpajama tokens training