My LLM CLI tool now supports self-hosted language models via plugins

LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now install plugins that add support for additional models to the tool, including models that can run on your own hardware.

Highlights of today's release:

• Plugins to add support for 17 openly licensed models from the GPT4All project that can run directly on your device, plus Mosaic's MPT-30B self-hosted model and …

ai cli command feature generativeai gpt gpt-4 homebrewllms install language language models large language large language models library line llm llms plugins projects python self-hosted support tool utility