Edgen: A Local, Open Source GenAI Server Alternative to OpenAI in Rust

⚡Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

Our goal with⚡Edgen is to make privacy-centric, local development accessible to more people, offering full compliance with OpenAI's API. It's made for those who prioritize data privacy and want to experiment with or deploy AI models locally with a Rust based infrastructure.

We'd love for this community to be among the first to try it out, …

ai models api compliance deeplearning development genai gpu llama2 llms mistral mixtral openai open source open source genai people privacy rust server speech speech-to-text text whisper