When AI’s Large Language Models Shrink

Building ever larger language models has led to groundbreaking jumps in performance. But it’s also pushing state-of-the-art AI beyond the reach of all but the most well-resourced AI labs. That makes efforts to shrink models down to more manageable sizes more important than ever, say researchers.

In 2020, researchers at OpenAI proposed AI scaling laws that suggested increasing model size led to reliable and predictable improvements in capability. But this trend is quickly putting the cutting edge of AI research …

ai labs art artificial intelligence beyond building efficiency gpt-3 gpt-4 labs language language models large language models llms openai performance researchers scaling state