[P] Finetuning a commercially viable open source LLM (Flan-UL2) using Alpaca, Dolly15K and LoRA

Links:

* [Blog Post Write Up](https://medium.com/@krohling/finetuning-a-commercially-viable-open-source-llm-flan-ul2-3b84e568c458) (includes benchmarks)
* [Flan-UL2-Alpaca (HuggingFace)](https://huggingface.co/coniferlabs/flan-ul2-alpaca-lora)
* [Flan-UL2-Alpaca (Github)](https://github.com/ConiferLabsWA/flan-ul2-alpaca)
* [Flan-UL2-Dolly15K (HuggingFace)](https://huggingface.co/coniferlabs/flan-ul2-dolly-lora)
* [Flan-UL2-Dolly15K (Github)](https://github.com/ConiferLabsWA/flan-ul2-dolly)

Hey Redditors,

This is a project I've been wanting to do for a while. I've spoken to a lot of folks lately who are interested in using LLMs for their business but there's a ton of confusion around the licensing situation. It seems like the Llama platform has been getting all the love lately and I wanted to see what …

alpaca benchmarks business finetuning hey kind licensing llama llm llms lora love machinelearning open source open source llm opinion performance platform project spoken