[Project] Simple FastAPI service to serve LLAMA-2 7B chat model

Hey,

I wrote a simple FastAPI service to serve the LLAMA-2 7B chat model for our internal usage (just to avoid using chatgpt in our prototypes).

I thought it could also be beneficial for you to use it if needed.

Feel free to play with it [https://github.com/mowa-ai/llm-as-a-service](https://github.com/mowa-ai/llm-as-a-service)

Tested on Nvidia L4 (24GB) with \`g2-standard-8\` VM at GCP.

​

Any feedback welcome :)

chat chatgpt fastapi gcp hey llama machinelearning nvidia project serve service simple standard thought usage