Train MISTRAL 7B to outperform LLama 2 70B (ZEPHYR)

How to train a MISTRAL 7B to outperform LLAMA 2 70B. With SFT trainer and DPO. New model called Zephyr 7B. According to Lewis Tunstall (all rights with him).

#aieducation
#gpt4generated
#idea

llama llama 2 mistral mistral 7b rights sft train trainer