Carbon footprint of LLM fine tuning — a case study

Carbon Footprint of LLM Fine Tuning — A Case Study

I got surprising results when I measured the carbon emissions from instruction fine tuning an LLM

I recently LoRA fine-tuned a Danish LLM called Munin-7b-alpha on an instruction fine tuning dataset called SkoleGPT-instruct. During the fine tuning procedure, I measured the energy consumption and computed the carbon footprint. In this article, I present the surprising results. You can find the model here.

Introduction …

ai carbon-emissions llm machine learning sustainability