Beyond the Hype: Monitoring LLMs in Production // Claire Longo // LLMs in Prod Conference Part 2

This portion is sponsored by Arize
Website: https://arize.com/
Increase model velocity and improve AI outcomes with Arize AI's ML observability platform. Discover issues, diagnose problems, and improve performance.

//Abstract
Here’s the truth: troubleshooting models based on unstructured data is notoriously difficult. The measures typically used for drift in tabular data do not extend to unstructured data. The general challenge with measuring unstructured data drift is that you need to understand the change in relationships inside the unstructured data itself. In …

abstract arize arize ai beyond claire conference data llms model velocity monitoring observability observability platform part performance platform prod production sponsored troubleshooting unstructured unstructured data