How RLHF Preference Model Tuning Works (And How Things May Go Wrong)

Large Language Models like ChatGPT are trained with Reinforcement Learning From Human Feedback (RLHF) to learn human preferences. Let’s uncover how RLHF works and survey its current strongest limitations.

chatgpt current deep learning feedback human human feedback language language models large language large language models learn limitations no-chatbot popular reinforcement reinforcement learning rlhf survey