Everything WRONG with LLM Benchmarks (ft. MMLU)!!!

🔗 Links 🔗

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

https://arxiv.org/pdf/2402.01781.pdf


❤️ If you want to support the channel ❤️
Support here:
Patreon - https://www.patreon.com/1littlecoder/
Ko-Fi - https://ko-fi.com/1littlecoder

🧭 Follow me on 🧭
Twitter - https://twitter.com/1littlecoder
Linkedin - https://www.linkedin.com/in/amrrs/

benchmarks everything language language model large language large language model llm llm benchmarks mmlu sensitivity support targets