Evaluating LLMs for AI Risk // Finn Howell // LLMs in Production Conference III Lightning Talk

// Abstract
How do you write a stress test for an LLM? This talk explores cutting-edge techniques to red-team generative AI and build validation engines that algorithmically probe models for security, ethics, and safety issues. Attendees will learn a framework to manage AI risk spanning the model lifecycle, from data collection through production.

// Bio
Finn, an ML Engineering Manager at Robust Intelligence, leads a team focused on detecting and mitigating AI risk. Previously, she built the EHR backend and …

abstract build conference edge ethics finn framework generative iii learn lightning llm llms probe production risk safety security stress talk team test validation