What the heck happened to the Claude 3 OPUS????

A new standard for intelligence
Opus, our most intelligent model, outperforms its peers on most of the common evaluation benchmarks for AI systems, including undergraduate level expert knowledge (MMLU), graduate level expert reasoning (GPQA), basic mathematics (GSM8K), and more. It exhibits near-human levels of comprehension and fluency on complex tasks, leading the frontier of general intelligence.

All Claude 3 models show increased capabilities in analysis and forecasting, nuanced content creation, code generation, and conversing in non-English languages like Spanish, Japanese, …

ai systems basic benchmarks claude claude 3 evaluation expert graduate human intelligence intelligent knowledge mathematics mmlu near reasoning standard systems tasks undergraduate