The EASIEST way to RUN Llama2 like LLMs on CPU!!!

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Models
GPT-2
GPT-J, GPT4All-J
GPT-NeoX, StableLM
Falcon
LLaMA, LLaMA 2
MPT
StarCoder, StarChat
Dolly V2
Replit

Google Colab used in the code - https://colab.research.google.com/drive/1cdPyvUBxL4HvlFfMnJsSM9-7TfESmM4R?usp=sharing

https://github.com/marella/ctransformers

❤️ If you want to support the channel ❤️
Support here:
Patreon - https://www.patreon.com/1littlecoder/
Ko-Fi - https://ko-fi.com/1littlecoder

cpu dolly falcon falcon llama gpt gpt-2 gpt4all gpt-j library llama llama 2 llama2 llms python replit stablelm starcoder support transformer transformer models