RLHF progress: Scaling DPO to 70B, DPO vs PPO update, Tülu 2, Zephyr-β, meaningful evaluation, data contamination

Huge steps forward in confirming that RLHF can really help you on vibes based evaluation, among many other RLHF analyses.

data evaluation ppo progress rlhf scaling vibes