SmartGPT: Major Benchmark Broken - 89.0% on MMLU + Exam's Many Errors

Has GPT4, using a SmartGPT system, broken a major benchmark, the MMLU, in more ways than one? 89.0% is an unofficial record, but do we urgently need a new, authoritative benchmark, especially in the light of today's insider info of 5x compute for Gemini than for GPT 5?

Learn all about the power of exemplars, self-consistency and how you can tangibly benefit in real world examples. You'll learn more about everything from cutting edge benchmarking to AGI forecasting.

https://www.patreon.com/AIExplained

Original …

benchmark compute errors exam gemini gpt gpt4 insider light major