Outsmarting the Masters: How Weak AI Trains Super AI

A technical explainer of the paper “Weak-to-strong generalization: eliciting strong capabilities with weak supervision”

Superintelligent AI systems will be extraordinarily powerful; humans could face catastrophic risks including even extinction if those systems are misaligned or misused. It is important for AI developers to have a plan for aligning superhuman models ahead of time — before they have the potential to cause irreparable harm. (Appendex G in the paper)

Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision

Human …

ai ai developers ai-safety ai systems capabilities chatgpt developers explainer extinction face humans openai paper risks superalignment superhuman superintelligent ai supervision systems technical trains weak ai will