[D] Preferred fine-tuning framework for instruction tuning?

Hi everyone,

I am having a look at the different frameworks to fine-tune an LLM on a small private dataset. I don't want to go for something fancy, as I am not trying to develop custom training procedure, but just use state of the art models, fine-tuned on my data.

Therefore my criteria are mostly ease of use, availability of SOTA models like Mistral, community support, and performance (aka latest methods to train fast are implemented).

I am looking at …

art data dataset fine-tuning framework frameworks llm look machinelearning small something state state of the art training