The Pragmatic AI Podcast is sponsored by Tighten. T-I-G-H-T-E-N. We will take your AI ideas, prototypes or even vibe-coded apps, and we'll take them to production. Scalable and secure. Check us out at tighten.com.

Matt Stauffer sits down with Sam Rose, developer educator at ngrok, to unpack what’s actually happening inside the AI models we use every day. Sam breaks down ideas like parameters, gradient descent, embeddings, and vector search in a way that makes them intuitive, using simple analogies such as converting Celsius to Fahrenheit. Along the way, they explore Ethan Mollick’s concept of the “jagged frontier” of AI capability and discuss why benchmarks like SWE-bench don’t always tell the full story.

The conversation wraps with a thoughtful look at the ethical tensions around modern AI: intellectual property concerns, the massive financial momentum behind these systems, and what it means to keep using these tools thoughtfully even when you’re still wrestling with their implications.

-----

Editing and transcription sponsored by Tighten.