FIN-LLAMA: LLAMA for finance

As the name indicates, it is based on Meta’s LLAMA and trained on finance datasets, including annual reports, news, or alternative data like ESG or sentiment and the cleaned oasst1 dataset. The model was trained using QLORA.


**Installation:**
To load models in 4bits with transformers and bitsandbytes, you have to install accelerate and transformers from the source and make sure you have the latest version of the bitsandbytes library (0.39.0).


pip3 install -r requirements.txt

**Fintuning:**


bash script/finetune.sh

**Prompt:**
Similar to …

alternative data data dataset datasets esg finance install languagetechnology llama meta reports sentiment transformers