A monster of a paper by Stanford, a 500-page report on the 2024 state of AI

https://aiindex.stanford.edu/report/

Top 10 Takeaways:

1. AI beats humans on some tasks, but not on all. AI has surpassed human performance on several benchmarks, including some in image classification, visual reasoning, and English understanding. Yet it trails behind on more complex tasks like competition-level mathematics, visual commonsense reasoning and planning.

2. Industry continues to dominate frontier AI research. In 2023, industry produced 51 notable machine learning models, while academia contributed only 15. There were also 21 notable models resulting from industry-academia …

ai research artificial benchmarks classification commonsense competition english frontier ai human human performance humans image industry mathematics performance planning reasoning research tasks top 10 understanding visual