I Made a Better Testing Plan for Google Gemini in Just 30 Minutes

Testing models: an unglamorous yet critical part of AI product management

“We definitely messed up on the image generation. I think it was mostly due to just not thorough testing.” — Sergey Brin, referring to Google’s unsuccessful rollout of Gemini on March 2, 2024.

Google wanted to get Gemini to market quickly. But there’s a big difference between reduced testing for velocity, and what happened with Gemini.

I set out to verify what kind of testing was possible …

ai testing brin gemini generative ai tools generative-ai-use-cases google google gemini image image generation management part product product management sergey sergey brin testing think