Introducing, OpenLLM 🎉

OpenLLM allows you to run inferences with any open-source LLMs, deploy to the cloud or on-premises, and build powerful AI apps. It includes simple and familiar APIs, enabling easy integration with tools such as LangChain, and BentoML! You can find more [here](https://github.com/bentoml/OpenLLM).

To start, install it with pip: `pip install -U openllm`. It currently supports all significant SOTA LLMs, including Falcon, ChatGLM, Dolly V2, StableLM, and more! To start, do `openllm start:`

openllm start dolly-v2 --model-id databricks/dolly-v2-7b

To ask this …

call cli databricks datascience dolly falcon install llm llms pip query running sdk server sota stablelm transition