all AI news
The Confidence Checklist for LLMs in Production // Rohit Agarwal // LLMs in Prod Conference Part 2
Aug. 9, 2023, 4:45 p.m. | MLOps.community
MLOps.community www.youtube.com
For 2 whole years of working with a large LLM deployment, I always felt uncomfortable. How is my system performing? Are my users liking the outputs? Who needs help? Probabilistic systems can make this really hard to understand. In this talk, we'll discuss practical & implementable items to secure your LLM system and gain confidence while deploying to production.
// Bio
Rohit is the Co-founder and CEO of portkey.ai which is an FMOps stack for monitoring, model management, …
abstract checklist conference confidence deployment llm llms part prod production rohit systems talk
More from www.youtube.com / MLOps.community
Jobs in AI, ML, Big Data
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Lead Data Modeler
@ Sherwin-Williams | Cleveland, OH, United States