Diana Pfeil: Building Confidence in Probabilistic Systems

Software powered by AI can change its behavior without a deployment, leaving teams to maintain code, data, prompts, models, and the uncertainty between them. Diana Pfeil joins Robby to explain how evals, production monitoring, and a preference for simpler models help teams build confidence in systems they cannot completely predict.