Local GPT4 CPU with Llama2 in 5 commands

$: git clone https://github.com/ggerganov/llama.cpp
$: cd llama.cpp
$: make -j (you need to use cmake on windows)
$: wget https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML/blob/main/llama-2-13b-chat.ggmlv3.q4_0.bin
$: ./main -ins -t 8 -ngl 1 --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -s 42 -m llama-2-13b-chat.ggmlv3.q4_0.bin -p "Act as a helpful clinical research assistant" -n -1

act assistant chat clinical research color cpp deeplearning llama research research assistant windows