The Latest Language Model From Meta AI, ‘Atlas,’ Has Outperformed Previous Models Like ‘Palm’ And Reached Over 42% Accuracy On Natural Questions Using Only 64 Examples

Studies have shown that Large language models (LLMs) can learn new tasks from instructions or even from a few examples. This generalization results from scaling both the model’s parameter count and the volume of the training data results. A greater computational budget, more intricate reasoning, and the capacity to memorize more information relevant to subsequent tasks from the larger training set are responsible for this improvement in large language models. 

Key points:

✅ A retrieval-augmented language model, called Atlas, that …

accuracy ai atlas examples language language model machinelearningnews meta meta ai natural palm