May 26, 2023, 1:51 a.m. | /u/geepytee

Artificial Intelligence

Has anyone looked into what it’d take to self host an open source LLM and the costs and complexities associated with it?

Chatting with some friends who have built AI apps, it appears the idea often comes up when wanting to keep data private or have more control and predictability over uptime and latency. Haven’t looked into it at all myself but would be curious to hear if anyone else has.

ai apps apps artificial control costs data llm llms open source open source llm sense

Data Scientist

@ Hubtype | Barcelona, Catalonia, Spain - Remote

Data Scientist I, SDO Privacy - PDC team

@ | Iasi, ROU

Senior Data Architect

@ Halvik | Remote

Data Analyst (Dublin or Paris)

@ PartnerRe | Dublin, Ireland

Clinical Data Manager

@ PSI CRO | Budapest, Hungary

Staff Software Engineer II-Big Data (REMOTE)

@ Vericast | Austin, TX, United States