Llama 3 in [8B and 70B] sizes is out

Llama 3 has just been rolled-out, exactly 9 month after the release of Llama 2. It is already available for chat at Meta web site, can be downloaded from Huggingface in safetensors or GGUF format.

While the previous generation has been trained on a dataset of 2 trillion tokens the new one utilised 15 trillion tokens.

What is fascinating is how the smaller 8B version outperformed the bigger previus-gen 70B model in every benchmark listed on the model card …

70b ai chat dataset format huggingface llama llama 2 llama 3 llm machinelearning meta release tokens web