Oct. 3, 2023, 5:05 p.m. | /u/AIsupercharged

Artificial Intelligence www.reddit.com

ByteDance and the University of Illinois researchers have developed an improved benchmark suite with consistent parameters, called GPT-Fathom, that indicates GPT-4, the engine behind the paid version of ChatGPT, significantly outperforms leading LLMs, including its biggest competitor, Claude 2.

For the latest advancements in AI, [look here first](https://www.superchargedai.co/subscribe?utm_campaign=campaign&utm_medium=gpt-4-benchmarking&utm_source=reddit).



https://preview.redd.it/v4fo8zser0sb1.png?width=1292&format=png&auto=webp&s=7e29fe9ac1af3efcb936ee61e9202717eed7e702

**GPT-Fathom's breakthrough**

* The new benchmark suite, GPT-Fathom, addresses consistent settings issues and prompt sensitivity, attempting to reduce inconsistencies in LLM evaluation.
* In a comparison using GPT-Fathom, GPT-4 outperformed …

ai benchmark artificial benchmark bytedance chatgpt claude claude 2 consistent gpt gpt-4 illinois llms researchers university

Lead Developer (AI)

@ Cere Network | San Francisco, US

Research Engineer

@ Allora Labs | Remote

Ecosystem Manager

@ Allora Labs | Remote

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote