April 11, 2024, 3:39 a.m. | Pasquale Antonante

Towards Data Science - Medium towardsdatascience.com

How to Make the Most Out of LLM Production Data: Simulated User Feedback

A novel approach to use production data to simulate user feedback for testing and evaluating your LLM app

Image by author and ChatGPT. “Image of two llamas, one with a thumbs up and another with thumbs down” prompt. ChatGPT, 4, OpenAI, April 10th 2024. https://chat.openai.com.

A series of blog posts to share our perspectives on how to evaluate and improve your GenAI application pipelines

(written by Pasquale …

genai llm llm-evaluation llmops simulation

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Business Intelligence Manager

@ Sanofi | Budapest

Principal Engineer, Data (Hybrid)

@ Homebase | Toronto, Ontario, Canada