FIN-LLAMA: LLAMA trained on finance data

As the name indicates, it is based on Meta's LLAMA and trained on large finance dataset including annual reports, news, or alternative data like ESG or sentiment and the cleaned oasst1 dataset. The model was trained using QLORA.

​

**Links:**

[Github](https://github.com/Bavest/fin-llama)

[Model](https://huggingface.co/bavest/fin-llama-33b-merged)

[Dataset](https://huggingface.co/datasets/bavest/fin-llama-dataset)

​

**Installation:**

To load models in 4bits with transformers and bitsandbytes, you have to install accelerate and transformers from the source and make sure you have the latest version of the bitsandbytes library (0.39.0).

pip3 install -r …

alternative data data dataset esg finance llama machinelearningnews meta reports sentiment transformers