Self hosting LLMs: when would it make sense?

Has anyone looked into what it’d take to self host an open source LLM and the costs and complexities associated with it?

Chatting with some friends who have built AI apps, it appears the idea often comes up when wanting to keep data private or have more control and predictability over uptime and latency. Haven’t looked into it at all myself but would be curious to hear if anyone else has.

ai apps apps artificial control costs data llm llms open source open source llm sense