New LLM Benchmark Leaderboard: WildBench

WildBench is a benchmark for evaluating large language models (LLMs) on challenging tasks that are more representative of real-world applications. The examples are collected from real users by the AI2 WildChat project.

WildBench aims to provide a more realistic and challenging benchmark for evaluating LLMs, as opposed to existing benchmarks that do not capture the diversity and complexity of real-world tasks. They carefully curate a collection of 1024 hard tasks from real users, which cover common use cases such as …

ai2 applications benchmark benchmarks examples language language models large language large language models leaderboard llm llm benchmark llms project tasks world