CausalLM Part 2: Finetuning a model

CausalLM Part 2: Fine-Tuning a Model

3 ways to fine-tune a CausalLM model on chat data

In this tutorial, we’ll be fine-tuning a CausalLM model to do simple translation. Photo by Rob Wilson on Unsplash

In the last post, we talked about what CausalLM is and how Hugging Face expects data to be formatted. In this post, we’re going to walk through an abridged notebook with three ways to format the data to fine-tune a model. The first is …

hugging face llm nlp supervised fine-tuning translation