Transcript

Jad Abumrad (0:02)

Oh, wait, you're listening. Okay.

Dan Engber (0:04)

All right.

Jad Abumrad (0:05)

Okay.

Robert Krulwich (0:06)

All right. You're listening to Radio Lab Radio from wny.

Jad Abumrad (0:14)

See y. Do you. Can I ask you, do you. Do you just want to, like, lay out for us the chronology of your obsession? I think I feel comfortable saying it was. Has it become an obsession or just a. Just a dalliance?

Robert Krulwich (0:30)

I mean, or maybe you just noticed a crumbling building and ran over to stick your pen.

Dan Engber (0:36)

I mean, I am, I'm a contrarian and I'm interested in alternative facts about science, let's say.

Jad Abumrad (0:47)

Hey, I'm Jad Abumrad.

Michael Inslick (0:49)

I'm Robert Krulwich, this is Radiolab.

Jad Abumrad (0:51)

And a little while back, our editor Soren Wheeler and I, we. We talked to a science journalist named Dan Engber who got us kind of tangled up about something that we thought we knew about the world, about ourselves.

Narrator/Additional Commentator (1:02)

Something beautiful, as I recall.

Jad Abumrad (1:04)

Yeah. That we talked about at great length on this show.

Claude Steele (1:06)

Okay.

Jad Abumrad (1:07)

Hello.

Claude Steele (1:07)

Hello.

Robert Krulwich (1:08)

And to set that conversation up, we're gonna start with this guy.

Jad Abumrad (1:11)

Hi, is this Claude Steele?

Robert Krulwich (1:12)

Yes, Professor Claude Steele.

Claude Steele (1:13)

I'm the Lucy Stearns Emeritus professor of Psychology at Stanford University.

Robert Krulwich (1:18)

We actually had him on the show a number of years ago, some time ago.

Radiolab – "Stereothreat" (November 23, 2017)

Main Theme / Purpose

This episode of Radiolab, hosted by Jad Abumrad and Robert Krulwich, probes the origins, science, and recent challenges surrounding "stereotype threat"—the idea that being reminded of a negative stereotype about your social group can undermine your performance, especially in academic settings. The episode traces how this idea revolutionized social psychology, was championed as a force for social justice and educational reform, then weathered questions about its robustness during social psychology’s “replication crisis.” The hosts and guests offer a nuanced view of how stereotype threat stands up to modern scientific scrutiny and what the debates reveal about science itself.

Key Discussion Points & Insights

1. The Discovery of Stereotype Threat (00:14 – 13:01)

Claude Steele’s Background: Raised by civil rights activists, Steele was acutely aware of race and its social consequences (01:41).
The Achievement Gap: At the University of Michigan, Steele puzzled over why black and white students with identical academic credentials had very different outcomes after one semester. Black students’ grades were strikingly lower than their white peers' (02:34).
Not Just Race: A similar gap existed between women and men in advanced math courses (03:00).
Initial Explanations: While systemic racism and opportunity gaps were recognized, these didn’t explain performance differences among students entering college with equivalent academic histories (05:43).
Influence of "The Bell Curve": The controversial 1994 book fueled genetic explanations for group differences, which deeply troubled Steele, both scientifically and personally (04:39, 05:08).
Steele’s Experiments: He and colleagues designed experiments to test whether performance gaps could be induced or eliminated by altering test conditions (06:22). Notably, simple reassurances before a challenging test—telling women that a math test does “not show gender differences” or telling black students that a test is “not diagnostic of ability”—erased the performance gap between groups (07:38).

2. Stereotype Threat in Action (08:42 – 13:55)

"Puzzle" vs. "Test": A nonverbal IQ test framed as a "puzzle" (instead of an "IQ test") led to black students matching white students’ performance (09:15).
Where It Appears: Stereotype threat only kicks in when tasks are sufficiently hard: “As soon as the test gets difficult, that’s where the voices kick in.” (10:16).
The "Gremlin": This metaphorical gremlin “whispers” distracting, self-doubt-inducing thoughts, even if the student doesn’t personally believe the negative stereotype (10:45–11:16).
Distraction, Not Inability: The stereotype doesn’t “prevent” achievement, but “distracts you for just a beat,” which can make all the difference (11:22).

3. Stereotype Threat Goes Mainstream (12:02 – 14:11)

Academic Fame: The theory was widely replicated and inspired a new wave of social psychology research into bias, discrimination, and academic achievement (12:45).
For Social Justice: For researchers—including Michael Inzlicht, featured guest—the appeal was that stereotype threat offered a hopeful, actionable way to address inequities (13:19).

4. The Replication Crisis (14:11 – 25:10)

Research Wobbles: Inzlicht struggled to reproduce stereotype threat effects at the University of Toronto, perhaps due to a more diverse, less stereotype-aware student body (16:18–17:36).
False Positive Psychology (18:09): A pivotal 2011 paper showed how standard research practices could skew results—selectively reporting only those measures that confirmed the hypothesis (19:03).
Emergency Meetings: Social psychologists realized these practices could “turn up spurious findings” and called urgent meetings to re-evaluate their work (19:52).
Replication Attempts: The field moved toward “high powered replication” studies—larger samples, strict methods, pre-declared analyses (21:03).
Early Results: Some previously celebrated effects (willpower depletion from resisting cookies, "power poses" changing hormones) failed to replicate (22:00–25:15).
Civil War in Psychology: The field split, with some researchers defending their theories and others insisting on new standards and skepticism (26:00).

5. Stereotype Threat Under Scrutiny (26:20 – 34:12)

Mixed Replication Results: No massive, multi-site preregistered replications of stereotype threat have taken place, but smaller efforts have had mixed results—occasionally even reversing the effect (“students did better” after being exposed to stereotype threat) (26:45–27:04).
Claude Steele’s Defense: Steele points out that stereotype threat has been “dramatically well replicated,” though not in every context. “If you can’t replicate one of them or six of them, I wouldn’t—that doesn’t surprise me.” (27:29).
Evolving Contexts: Steele cautions that stereotypes—and who they affect—change over time, so sticking to 25-year-old experimental protocols may not reflect current reality. “Social psychology… the meanings come from the contemporary moment, the state of the culture at that time” (28:13).
Publication Bias: Concerns persist that repeated “trials” until a positive result is found, then published, could bias the entire field—though Steele views wholesale fabrication as unlikely (29:13, 29:49).

6. Real-World Impact & Openness (30:17 – 32:49)

Beyond the Lab: Stereotype threat interventions have been tested in schools, producing, in some cases, dramatic, lasting gains in achievement (30:28).
Replication Failures: Still, some large, real-world replications have failed (31:02).
Transparency: Steve Spencer, an early collaborator, is preparing to publish all his data and questionable research practices and is participating in adversarial collaborations—cooperating with skeptics on large replication projects (32:00–32:29).
Emotional Toll: For some, the replication crisis provokes unsettling doubts: “Was I doing good work? Was I part of the problem? Was I chasing signal...or chasing noise?... It might be there, but it might be so small as to not be meaningfully important.” (33:13)

7. Growing Up, Moving Forward (34:12 – End)

Simple Fixes Fade: Radiolab’s hosts reflect on their own desire for “a very simple fix that would work everywhere…and sort of save the world.” The growing realization is that solutions may have to be smaller, targeted, and more context-dependent (34:55–35:04).
Mature Uncertainty: “Maybe that’s exactly what you need in order to be able to find the smaller places where you can have an effect, you know, right here, right now, with this person trying to do this particular thing.” (35:04)

Notable Quotes & Memorable Moments

On the Discovery of Stereotype Threat:
- “So if going forward and taking a test, the black kid gets a lower score...then something must be happening right there. Right there.” — Claude Steele (05:43)
On the Subtlety of the Effect:
- “The real subtle power of a stereotype isn’t that it prevents you from doing the thing you want to do. It distracts you for just a beat from doing the thing you want to do. And that may be all the difference.” — Jad Abumrad (11:22)
On the Replication Crisis:
- “My jaw dropped. I sent this paper, I circulated it...we called an emergency meeting.” — Michael Inzlicht, on reading "False Positive Psychology" (19:35)
- “You don’t really know how many things were tried in each individual lab.” — Dan Engber (24:55)
On Shifting Standards:
- “Maybe that’s exactly what you need in order to be able to find the smaller places where you can have an effect.” — Robert Krulwich (35:04)
On Scientific Humility:
- “I want the truth out there more than I want anything else.” — Steve Spencer (31:35)
- “It might be there, but it might be so small as to not be meaningfully important.” — Michael Inzlicht (33:13)

Timestamps for Key Segments

00:14 – 06:12: Claude Steele’s background and the origins of stereotype threat research
07:06 – 08:34: The experiment—removing threat from test instructions, performance gap disappears
09:02 – 09:35: "Puzzle" vs. "IQ test" framing, and group performance equalizes
10:04 – 11:22: How and when stereotype threat manifests; "the gremlin"
12:02 – 13:19: Stereotype threat goes mainstream in social psychology
16:18 – 17:36: Inzlicht’s failures to replicate; possible reasons
18:09 – 19:35: The "False Positive Psychology" paper and its impact
21:03 – 22:14: High-powered replications and the replication crisis
26:20 – 27:00: Replicating stereotype threat; sometimes results reverse
28:13 – 29:49: Claude Steele on shifting cultural contexts and bias
30:28 – 31:16: Real-world interventions and mixed replication results
32:00 – 32:45: Steve Spencer’s openness to scrutiny and replication
33:09 – 33:54: Michael Inzlicht reflects on the emotional burden of doubt
34:12 – 35:32: The hosts’ reflections—growing up, letting go of “big, simple promises”

Tone and Style:
Conversational, intellectually curious, self-reflective, occasionally rueful but generally hopeful. The episode balances personal stories (from researchers and hosts) with careful explanations of science and its pitfalls.

Summary Takeaway

Radiolab’s "Stereothreat" unpacks a watershed theory in social psychology—not just for its explanatory power, but as a lens on how science, ambition, and culture shape what we think we know. Stereotype threat remains real for many researchers, but its scope, mechanisms, and interventions are more complex and context-dependent than initially hoped. The scientific process—messy, self-correcting, and human—continues, moving from grand solutions toward humility and precision.