Options for accessing Llama 3 from the terminal using LLM

Llama 3 was released on Thursday. Early indications are that it's now the best available openly licensed model - Llama 3 70b Instruct has taken joint 5th place on the LMSYS arena leaderboard, behind only Claude 3 Opus and some GPT-4s and sharing 5th place with Gemini Pro and Claude 3 Sonnet. But unlike those other models Llama 3 70b is weights available and can even be run on a (high end) laptop!

My LLM command-line tool and …

70b ai arena claude claude 3 claude 3 opus gemini gemini pro generativeai gpt leaderboard llama llama 3 llm llms openly opus projects terminal