Evaluating LLM-based Applications // Josh Tobin // LLMs in Prod Conference Part 2

This portion is sponsored by Gantry.
Website: https://gantry.io/
A simple, powerful SDK for model instrumentation
Gantry's SDK gives you easy access to all of your production data and metrics, just by adding a few lines of code.

//Abstract
Evaluating LLM-based applications can feel like more of an art than a science. In this workshop, we'll give a hands-on introduction to evaluating language models. You'll come away with knowledge and tools you can use to evaluate your own applications, and answers …

abstract applications art code conference data easy llm llms metrics part prod production production data sdk simple sponsored