101- LLM DBRX Instruct Model Serving- Saving Cost

Started exploring and trying Databricks instruct LLM. Was going over the Databricks Marketplace and installed and served the model by following steps listed in the Sample provided Notebook.

Was able to serve model successfully and interacted with it very well by proving few prompts. Its was after couple of days, got realised when saw budget alert notification that, planned budget got exceeded way beyond.

Lesson Learned,

1. LLM Download from Market place is free


2. Serving LLM - Similar to cloud hosted …

beginners cost databricks databricks marketplace dbrx llm marketplace notebook prompts sample saving serve