AI Evals & Discovery

episode

All Things Product with Teresa and Petra not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

A.I. Safety Goes Mainstream + a ‘Hard Fork’ Exit AMA 1h 25m · 18 Sep 2026 · Hard Fork

AWP: Beyond the Exam Room: Purpose, Myopia, and Population Health 54 min · 17 Sep 2026 · EyeCode Media

Essentials: How to Assess & Improve All Aspects of Your Fitness | Dr. Andy Galpin 35 min · 17 Sep 2026 · Huberman Lab

#502 – Psychiatry, Insane Asylums, Mental Illness, ECT, Lobotomies, Freud & Jung 3h 43m · 17 Sep 2026 · Lex Fridman Podcast

September 16, 2026 PC - Sep 16, 2026 1h 50m · 16 Sep 2026 · Fairfax County Planning Commission

Planning Commision 09/16/2026 - Sep 16, 2026 56 min · 16 Sep 2026 · Prince William County Planning Commission

Report any issue

Source

Recorded23 Sep 2025

Publisherallthingsproduct.podigee.io ↗

Handlerec:8744354

Show notes

Building AI products isn’t just about clever prompts and orchestration—it’s about knowing if what you’ve built actually works. In this episode, Teresa Torres and Petra Wille dive deep into AI evals: how they’re defined, why they’re essential, and how teams can implement them to ensure product quality. Teresa shares her journey building her Interview Coach tool and the hard lessons she learned about evals along the way. From golden datasets and synthetic data to error analysis, code-based checks, and LLM-as-judge methods, you’ll walk away with a clearer picture of how to measure and improve AI products over time.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in