Announcing a Benchmark to Improve AI Safety

One of the management guru Peter Drucker’s most over-quoted turns of phrase is “what gets measured gets improved.” But it’s over-quoted for a reason: It’s true.

Nowhere is it truer than in technology over the past 50 years. Moore’s law—which predicts that the number of transistors (and hence compute capacity) in a chip would double every 24 months—has become a self-fulfilling prophecy and north star for an entire ecosystem. Because engineers carefully measured each generation of manufacturing technology …

ai-safety artificial intelligence benchmark benchmarks books and literature business business and finance capacity chip compute computing economy education health and medical services health & pharma industries internet it and internet support large language models law management mlcommons news and politics reason robotics safety technology technology & computing technology industry transistors true