[D] Have you tried fine-tuning an open source LLM?

I want to build specialised LLMs that could run on edge devices.

I am interested to learn about the cheapest way to do it while having decent accuracy.

The one I know of is MPT-7B that could be instruction-tuned under $50.

If you have any experience, please share the use-case and how much it cost you.

accuracy case devices edge edge devices experience fine-tuning learn llm llms machinelearning open source open source llm