First steps with llama

Time to try out some coding with generative AI and LLM (Large Language Model).

I had one requirement for this and that was to run it locally on my machine and not use a web API, like the one provided by OpenAI.

To do this is I managed to stumble over this project llama.cpp by Georgi Gerganov, which also has a couple of bindings to other programming languages.

I went with Python, llama-cpp-python, since my goal is …

100daystooffload ai api coding cpp generative language language model large language large language model llama llm machine managed openai project python web