Build an eval suite with real cut scores, not vibes.

In Lesson 4.6 of GROW Course 4 (Hardening & Shipping), Doug Liles works through it with you. An eval suite with thresholds you can actually gate a release on.

What you'll take away

- Why evals

- Building the gold set

- Metrics that matter

Chapters

(0:00) Cold open & the promise

(5:53) Why evals

(11:46) Building the gold set

(17:40) Metrics that matter

(23:33) Setting cut scores

(29:27) Gating on results

(35:20) The artifact & what to do Monday

Mentioned and cited

- NIST AI RMF 1.0 (2023)

Study guide, slide deck, blog companion, infographic (free)

- https://fde.goodcombinator.ai/lessons/FDE_Lesson_4_6

Audio companion is AI-narrated using NotebookLM. Explainer video is human-produced.

Public release

This full FDE Certification audio lesson is available publicly as part of GROW by Good Combinator.

Continue in GROW Skills Library: https://goodcombinator.com/grow/library

Episode metadata

Show: GROW by Good Combinator

Course: Course 4 - Hardening & Shipping

Lesson: 4.6

Season/Episode: 4/6

Runtime: 41:14

Access label: public-full-lesson

Source channel: spotify

Source audio: app/lessons/assets/course-4/4.6/4.6 audio podcast.m4a

Taxonomy: Domain=Reliability & Shipping; Career stage=Senior FDE; Skill level=Advanced; Asset type=Lesson; Outcome=Ship

CRM events: course_started, lesson_completed, cert_enrolled

Transcript and accessibility

Final transcript required before launch: https://goodcombinator.com/grow/courses/course-4/lesson-4.6/transcript

Accessibility requirement: reviewed audio, clear title, descriptive show notes, and transcript availability before launch.

Audio companion is AI-narrated using NotebookLM and disclosed here.

Credits

Host: Doug Liles

Producer: Good Combinator

Audio: NotebookLM AI narration (disclosed)