Many options for running Mistral models in your terminal using LLM

Mistral AI is the most exciting AI research lab at the moment. They've now released two extremely powerful smaller Large Language Models under an Apache 2 license, and have a third much larger one that's available via their API.

I've been trying out their models using my LLM command-line tool tool. Here's what I've figured out so far.

• Mixtral 8x7B via llama.cpp and llm-llama-cpp


• Mistral 7B via llm-llama-cpp or llm-gpt4all or llm-mlc


• Using the Mistral API, which includes the …

ai ai research ai research lab apache api command generativeai lab language language models large language large language models license line llm llms mistral mistral ai plugins projects research running terminal