[P] Finetuning qLoRAs for production use cases - Paraphrasing, Changing the tone of a sentence, Dialogue Summarization and Topic generation

Hello,

I've been curious as to how far we can take small(7B and less) models for production use cases with small amounts of training data for each task.

So far I've been able to fine-tune LoRAs for paraphrasing, changing the tone of a sentence, dialogue summarization and topic generation. The results look promising, especially the fact that all this can run on very modest hardware.

Finetuning was done in 4bit mode using bitsandbytes. Each task had \~1k training points.

I've …

cases data dialogue finetuning machinelearning paraphrasing production small summarization training training data use cases