fine-tuning Llama model for summarization

Has anyone attempted to fine-tune the Llama model for text summarization? I've been working on a code implementation using the Llama model and incorporating Lora, but I'm encountering an issue where I'm getting a Rouge score of 99 for both the train and test sets, even in the first epoch. I know that something is amiss, but I'm having difficulty understanding the root of the problem. Furthermore, when I examined the predictions on the test set, it appears that the …

code fine-tuning implementation issue languagetechnology llama lora predictions set summarization summary test text text summarization understanding