Microsoft Releases DeepSpeed-Chat for RLHF Training of ChatGPT-like Models

In a new paper DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales, a Deepspeed of Microsoft research team presents DeepSpeed-Chat, a novel end-to-end RLHF pipeline that provides easy-to-use training and inference for ChatGPT-like models at scale.

ai artificial intelligence chat chatgpt deep-neural-networks deepspeed easy inference machine learning machine learning & data science microsoft microsoft research ml novel paper pipeline reinforcement leaerning releases research research team rlhf scale team technology training