Cautionary Tales with Tim Harford: "Captain Kirk Forgot to Put the Machine on Stun"
Release Date: July 18, 2025
Hosted by: Pushkin Industries
Introduction to the Therac-25 Tragedy
In the episode titled "Captain Kirk Forgot to Put the Machine on Stun," Tim Harford delves into the harrowing story of the Therac-25, a radiation therapy machine whose software malfunctions led to multiple patient injuries and deaths during the mid-1980s. This cautionary tale highlights the interplay between human error, software bugs, and systemic failures within medical technology.
The Therac-25: Design and Intended Functionality
The Therac-25 was an advanced radiation therapy machine designed to treat cancer patients by delivering precise doses of radiation. Unlike its predecessors, the Therac-25 was fully computer-controlled, utilizing servomotors to position its components swiftly and accurately. It operated in two modes:
- Electron Mode: Targets cancer near the surface using a spread-out electron beam.
- X-Ray Mode: Targets deeper-seated tumors with a focused X-ray beam through a device called a flattener.
Notable Quote:
"The Therac 25 was fully controlled by a computer, unremarkable these days, but radical for the mid-1980s." [00:45]
Early Warning Signs: Katie Yarborough and Frances Hill
Katie Yarborough's Case
In the summer of 1985, Katie Yarborough, a 61-year-old patient in Georgia, experienced unexpected and severe burns during her electron therapy sessions. Despite reporting intense pain, the technicians and physicists at the Keniston Oncology Center were unable to identify the cause, attributing the burns to other factors. This incident marked one of the first known overdoses caused by the Therac-25's malfunction.
Frances Hill's Experience
Just nine months prior, Frances Hill in Ontario faced similar issues. Her treatments with the Therac-25 frequently resulted in error messages without administering the intended radiation dose. While the machine was deemed "safe" after software updates by AECL (Atomic Energy of Canada Ltd.), Hill still suffered radiation burns, indicating unresolved technical flaws.
Notable Quote:
"The machine relied on the software being perfect. The shielding components were put in place by the software." [20:15]
Ray Cox: A Case Study in Systemic Failure
Ray Cox, a 33-year-old cancer patient, became a central figure in the Therac-25 saga. During his ninth radiation session in March 1986, Mary Beth, the machine operator, inadvertently input the wrong mode due to a software glitch. The Therac-25 administered a lethal dose of radiation, causing severe burns and ultimately leading to Cox's death in August 1986.
Key Events:
- Incorrect Mode Selection: Mary Beth pressed 'X' instead of 'E,' triggering the X-ray mode without the flattener in place.
- Error Message Misinterpretation: The machine displayed "malfunction 54," a vague error that operators commonly encountered but didn't understand.
- Lack of Immediate Safeguards: Despite the error, Mary Beth reset the machine rapidly, not realizing the gravity of the malfunction.
Notable Quote:
"Captain Kirk forgot to put the machine on stun." [45:30]
— Ray Cox, metaphorically highlighting the oversight leading to the tragedy.
The Swiss Cheese Model and Systemic Safeguards
Tim Harford introduces James Reason's Swiss Cheese Model to explain how multiple layers of defense can fail simultaneously, leading to accidents. Each "slice" represents a safeguard, and the "holes" symbolize potential failures. In the case of the Therac-25, the alignment of these holes—software bugs, inadequate error reporting, and insufficient human oversight—resulted in catastrophic outcomes.
Notable Quote:
"Safety is not a function of good software alone. It's the function of the whole system." [35:50]
Subsequent Malfunctions: Dora Moss and Vernon Kidd
Dora Moss's Incident
In December 1985, Dora Moss at Yakima Valley Memorial Hospital suffered mysterious striped radiation burns during her therapy session with the Therac-25. Despite diagnostic efforts, the cause remained unidentified, and AECL dismissed the possibility of machine malfunction without acknowledging the injuries' severity.
Vernon Kidd's Fatal Overdose
Three weeks after Ray Cox's incident, Vernon Kidd, a 66-year-old patient, received a fatal overdose of radiation from the Therac-25. His treatment malfunctioned similarly due to the same underlying software bug, leading to his untimely death before his cancer could claim him.
Notable Quote:
"Glitches didn't seem strange to the operator, something seemed strange to Frances." [15:30]
Uncovering the Software Bug
The root cause of the Therac-25's malfunctions was traced to a software bug that mishandled rapid mode corrections. When operators swiftly corrected an initial input error, the machine's subroutines became confused, setting the X-ray beam to full power without the necessary flattener in place. This bug prevented the software from accurately monitoring and reporting the administered dose.
Notable Quote:
"The result? The beam was set to full X ray power. But the flattener that would absorb most of the radiation wasn't in position." [50:10]
Organizational and Communication Failures
A critical aspect of the Therac-25 disaster was the lack of effective communication and reporting within and between institutions. AECL failed to adequately acknowledge and address the recurring malfunctions. Hospitals did not report incidents comprehensively, leading to isolated and unconnected cases that obscured the true extent of the problem.
Notable Quote:
"There was no proper process for noting anomalous incidents, suspected malfunctions or possible injuries." [1:10:25]
Lessons Learned: Beyond Software Bugs
The Therac-25 case underscores that ensuring safety in complex systems extends beyond eliminating software bugs. It requires robust processes for incident reporting, thorough investigations, and comprehensive safeguards that consider both human and technological factors. Effective communication among all stakeholders is paramount to prevent similar tragedies.
Notable Quote:
"The real lesson here is that safety is not a function of good software alone. It's the function of the whole system." [1:05:40]
Conclusion: A Systemic Failure
Tim Harford's "Captain Kirk Forgot to Put the Machine on Stun" serves as a poignant reminder of the multifaceted nature of safety in technological systems. The Therac-25 tragedy exemplifies how intertwined software reliability, human oversight, and organizational communication must be to safeguard lives effectively.
Additional Resources
-
Books:
- Set Phasers on Stun by Stephen M. Casey
- Investigative Authority on the Therac-25 Case by Nancy Levison and Clark Turner
-
Related Episodes:
- Glowing Peril: The Magical Glitter that Poisoned a City
- Radium Girls: How They Fought Back
For a comprehensive list of sources and further reading, visit show notes@timharford.com.
Production Credits:
Written by Tim Harford with Andrew Wright. Produced by Alice Fiennes and Marilyn Rust. Sound design and music by Paul Pascal Wise. Edited by Sarah Nix. Voice talents include Ben Crow, Melanie Gutteridge, Stella Harford, Gemma Saunders, and Rufus Wright.
If you found this summary insightful, please share, rate, and review "Cautionary Tales with Tim Harford" on your preferred podcast platform.