[P] Working on a QLORA hub for model personalities, help needed

Hey all!

I'm building a repository of QLORA adapters that change the model's personality. The end vision is a hub of ready-to-go personality adapters.

I'm hitting a snag when training the QLORAs for Paul Graham personality on top of a 4-bit quantized StableBeluga-7B. The model just doesn't seem to learn the style.

Any thoughts on how I can improve this? Below are the details:

Data

* 3340 examples of PG passages, formatted as `{"text": "### User:\n{generic instruction}\n\n### Assistant:\n{PG-style response}"}`.
* …

building change hey hub machinelearning paul graham personalities personality training vision