Why is Meta spending so much on Open Source AI?

Last week, Meta released their latest set of Large Language Models – Llama 3. We continue to see that the combination of larger training datasets, more compute, and new AI research yield better models. The early data below suggests Llama 3 is the best open source model available, trailing only OpenAI’s GPT-4.

A quick caveat – Meta’s specific license for Llama allows free commercial usage for companies with less than 700 million monthly users (>99.9% of companies).

To put this …

ai ai research combination compute data datasets discuss language language models large language large language models llama llama 3 meta open source opensource open source model research set spending training training datasets