← Freakonomics Radio
Freakonomics Radio
How to Succeed at Failing, Part 2: Life and Death (Update)
00:53:19
In medicine, failure can be catastrophic. It can also produce discoveries that save millions of lives. Tales from the front line, the lab, and the I.T. department.
Loading summary
Transcript171 lines
- [00:01]
Stephen Dubner
Freakonomics Radio is sponsored by Capital One Banking with Capital One helps you keep more money in your wallet with no fees or minimums on checking accounts and no overdraft fees. Just ask the Capital One bank guy. It's pretty much all he talks about in a good way. He'd also tell you that this podcast is his favorite podcast. Thanks Capital One Bank Guy. What's in your wallet? Terms apply. See capitalone.com bank Capital One NA member FDIC Freakonomics radio is sponsored by Mint Mobile this spring and summer everyone wants skimpy wireless bills and fat wallets. Mint Mobile has premium wireless plans for just 15 bucks a month this year. Skip breaking a sweat and breaking the bank. Get your summer savings and shop premium wireless plans@mintmobile.com free. That's mintmobile.com freak upfront payment of $45 for a three month five gigabyte plan required equivalent to $15 per month new customer offer for the first three months only. Then full price plan options available, taxes and fees extra. See Mint Mobile for details. Hey there Steven Dubner. We are replaying a series we made in 20 called how to succeed at failing. This is the second episode. We have updated all facts and figures as necessary. As always, thanks for listening. In early 2007, Carol Hemmelgarn's life was forever changed by a failure. A tragic medical failure. At the time she was working for Pfizer, the huge US pharmaceutical firm, so she was familiar with the the healthcare system. But what changed her life wasn't a professional failure. This was personal.
- [02:07]
Carol Hemmelgarn
My 9 year old daughter, Alyssa was diagnosed with leukemia all on a Monday afternoon and she died 10 days later. In this day and age of healthcare, children don't die of leukemia. In nine days she died from multiple medical errors. She got a hospital acquired infection which we know today can be prevented. She was labeled. And when you attach labels to patients, a bias is formed and it's often difficult to look beyond that bias. So one of the failures in my daughter's care is that she was labeled with anxiety. The young resident treating her never asked myself or her father if she was an anxious child. And she wasn't. What happens is we treat anxiety, but we don't treat scared, afraid and frightened. And that's what my daughter was. Hospitals are frightening places to children. So my daughter, with her hospital acquired infection became septic. But they were not treating her for the sepsis because all they could focus on is they thought she was anxious and they kept giving her drugs for anxiety. Even though the signs, the symptoms and me, as her mother kept telling them something was wrong, something wasn't right. They wouldn't listen to me. So by the time, by the time she was failing so poorly and rushed to surgery and brought back out, there was nothing they could do for her. The first harm was unintentional that they did to our daughter. It was all the intentional harms after that where we were lied to, the medical records were hidden from us, people were told not to talk to us. And the fact that it took the organization three years, seven months and 28 days to have the first honest conversation with us, those were all intentional harms. And that's why in healthcare, we have to have transparency, because how many other children suffered because of the learning that didn't take place?
- [04:41]
Stephen Dubner
Hemelgarn says she filed a claim against the hospital, but she didn't move forward with a lawsuit because of the emotional toll. She ultimately took a different path. In 2021, she co founded an advocacy group called Patients for Patient Safety Us. It is aligned with the World Health Organization. She also runs a master's program at Georgetown University called Clinical Quality Safety Leadership.
- [05:09]
Carol Hemmelgarn
When harm does reach the patient or family, that is the time to really analyze what happened. And while you never want to harm a patient or family, one of the things you'll hear from patients and families after they have been harmed is they want to make sure that what happened to them or their loved one never happens again. The example I can give for myself personally is I did go back to the very organization where my daughter died, and I have done work there.
- [05:45]
Stephen Dubner
Today on Freakonomics Radio, we continue with our series on failure. In the first episode, we acknowledge that some failure is inevitable.
- [05:54]
Amy Edmondson
We are by definition fallible human beings, each and every one of us.
- [05:59]
Stephen Dubner
And that failure can be painful.
- [06:01]
Gary Klein
I don't think we should enjoy failure. I think failure needs to burn on us.
- [06:06]
Stephen Dubner
This week we focus on the healthcare system where failure is literally a matter of life or death.
- [06:12]
Carol Hemmelgarn
Some organizations felt like they had already achieved the patient safety mission. Others, it wasn't even part of their strategic plan.
- [06:20]
Stephen Dubner
And we will learn where on a spectrum to place every failure from inexcusable.
- [06:28]
John Van Reenen
There's lots of examples of huge public sector failures, but this was one of.
- [06:32]
Stephen Dubner
The biggest to life saving.
- [06:35]
Bob Langer
I really believe that if we could do this, it would make a big difference in medicine.
- [06:40]
Stephen Dubner
How to succeed at Failing Part two Beginning now, this is Freakonomics Radio, the podcast that explores the hidden side of everything.
- [07:04]
Carol Hemmelgarn
With your host, Stephen Dubner.
- [07:12]
Stephen Dubner
The story of Carol Hemmelgaard's daughter is tragic. A hospital death caused by something other than the reason the patient was in the hospital. Unfortunately, that type of death is not as rare as you might think. Consider the case of Redonda Vaught, a nurse at Vanderbilt University's Medical Center. In 2019, she was prosecuted for having administered the wrong medication to to a patient who subsequently died. The patient was a 75 year old woman who had been admitted to the hospital for a subdural hematoma or bleeding in the brain. Here is Redonda Vaught testifying at her trial.
- [07:48]
Redonda Vaught
I was pulling this medication. I didn't think to double check what I thought I had pulled from the machine. I used the override function. I don't recall ever seeing any warnings that showed up on the monitor.
- [08:05]
Stephen Dubner
The medication that Vought meant to pull from the Acudose machine was a sedative called Versed. What she mistakenly pulled was a paralytic called Vecuronium. Vecuronium instead of Versed.
- [08:19]
Redonda Vaught
I won't ever be the same person. It's really.
- [08:28]
Stephen Dubner
I.
- [08:30]
Redonda Vaught
When I started being a nurse, I told myself that I wanted to take care of people the way that I would want my grandmother to be taken care of.
- [08:42]
Stephen Dubner
Redonda Vaught was convicted of negligent homicide and gross neglect of an impaired adult. Her sentence was three years probation. You might expect a patient safety advocate like Carol Hemmelgarn to celebrate Vaught's prosecution, but she doesn't.
- [08:59]
Carol Hemmelgarn
This doesn't solve problems. All this does is it creates silence and barriers when errors happen. So often the frontline workers, your nurses, allied health physicians were blamed. But what we've come to realize is it's really a systemic problem. They happen to be at the front line. But it's underlying issues that are at the root of these problems. It can be policies that aren't the right policies. It could be shortages of staff. It can be equipment failures that are known at device companies but haven't been shared with those using the devices. It can be medication errors because of labels that look similar or drug names.
- [09:48]
Stephen Dubner
That are similar to get at the systemic problem. In the Vanderbilt case, Hemmelgaarden's advocacy group filed a complaint with the Office of Inspector General in the Department of Health and Human Services.
- [09:59]
Carol Hemmelgarn
What we found most frustrating was the lack of leadership from Vanderbilt. Leadership never came out and took any responsibility. They never said anything. They never talked to the community. It was essentially silence from leadership. I think one of the other big failures we have in healthcare is fear. Healthcare is rooted in fear because of the fear of litigation. When there's a fear of litigation, silence happens. And until we flip that model, we're going to continue down this road.
- [10:43]
Amy Edmondson
I absolutely share that worry. And that case was, in my mind, a classic case of a complex failure. Yes, there was a human error. We also had faulty medication, labeling and storing practices with alphabetical organization of drugs, which is not how you do it.
- [11:03]
Stephen Dubner
That's Amy Edmondson. We heard from her in our last episode. She is an organizational psychologist at the Harvard Business School. She recently published a book called Right Kind of the Science of Failing. Well, the Vanderbilt case was not an example of failing. Well, Redonda Vaught, you will remember, dispensed vecuronium instead of Versed.
- [11:24]
Amy Edmondson
You know, you don't have a dangerous, potentially fatal drug next to one that's routinely used in a particular procedure. It's what we might call an accident waiting to happen. With that perspective in mind, Redonda is as much a victim of a system failure as a perpetuator of the failure. Right. So this reaction, human error, is almost never criminal to criminalize this, I think, reflects an erroneous belief that by doing so, we'll preclude human error. No, what we will do is preclude speaking up about human error. And to her credit, she spoke up. And that, one could argue, ultimately led her to the conviction she would have been better off somehow trying to hide it, which I wouldn't advocate, obviously. But when we recognize, deeply recognize, that errors will happen, then that means that what excellence looks like is catching and correcting errors and then being forever on the lookout for vulnerabilities in our systems.
- [12:30]
Stephen Dubner
How often do these kinds of deaths happen? Researchers have a hard time answering that question. In 1999, the Institute of Medicine, known today as the National Academy of Medicine, found that medical error causes between 44 and 98,000 deaths per year. A 2013 study in the Journal of Patient Safety estimated the number of preventable deaths at U.S. hospitals at 200,000 a year. But in 2020, a meta analysis done by researchers at the Yale School of Medicine re evaluated those past estimates. They put the number at 22,000 a year. Still, even 22,000 preventable deaths a year is way too many. This issue has gotten a lot of attention within the medical community, but Carol Hemmelgarn says the ATT tension hasn't produced enough change.
- [13:19]
Carol Hemmelgarn
Some organizations felt like they had already achieved the patient safety mission. Others, it wasn't even part of their strategic plan. There's areas where improvement has definitely escalated since the report came out over 20 years ago, but it hasn't been fast enough. What we see is that not everything is implemented in the system that you can oftentimes have champions that are doing this work, and if they leave, the work isn't embedded and sustainable.
- [13:58]
Stephen Dubner
Amy Edmondson at Harvard has been doing research on medical failure for a long time. But she didn't set out to be a failure researcher.
- [14:08]
Amy Edmondson
As an undergraduate, I studied engineering sciences and design.
- [14:13]
Stephen Dubner
Tell me about the first phase of your professional life, including with Buckminster Fuller.
- [14:18]
Amy Edmondson
Yeah, so I'm answering that question with a huge smile on my face. I worked three years for Buckminster Fuller, who was an octogenarian, creative person, an inventor, a genius, a writer, a teacher, best known for the geodesic dome, which he invented. But single mindedly about how do we use design to make a better world. You can't sort of get people to change. You have to change the environment and then they'll change with. It was a kind of notion that he had. My part was just doing engineering drawings and building models and doing the mathematics behind new, simpler geodesic configurations. And it was so much fun.
- [14:57]
Stephen Dubner
And what was his view on failure generally?
- [15:00]
Amy Edmondson
Oh, he was a very enthusiastic proponent of using failure to learn. He said, often the only mistake we make is thinking we shouldn't make mistakes. He would give the example of the very first time he got a group of students together to build a geodesic dome that he had. You know, he'd done the math, he'd come up with this idea, and he got, you know, 20 students together, they're outside, they built the thing, and it immediately collapsed.
- [15:28]
Stephen Dubner
Okay.
- [15:28]
Amy Edmondson
And he enthusiastically said, okay, that didn't work. Now what went wrong? And it was really the materials they were using, which were, I think the best way to describe them is venetian blind materials. They had the tensile strength, but they certainly didn't have the compressive strength to do their job.
- [15:44]
Stephen Dubner
Okay, and what are the steps you take to turn that failure into a useful learning, I guess is the noun we use these days.
- [15:53]
Amy Edmondson
Immediate diagnosis. Right. We had a step back. Okay, what did we set out to do? What actually happened? What, why might that be the case? What do we do differently next time? I mean, that's a sort of a rough outline of an after action review. It could be flawed assumptions, it could be flawed calculations, it could be any number of things. And we don't know until we put our heads together and try to figure it out.
- [16:17]
Stephen Dubner
It was several years into her engineering career that Edmondson decided to get a PhD in organizational behavior.
- [16:24]
Amy Edmondson
I was Interested in learning in organizations. And I got invited to be a member of a large team studying medication errors in hospitals. And the reason I said yes was first of all, I was a first year graduate student. I needed to do something. And second of all, I saw a very obvious link between mistakes and learning. And so I thought, here we've got these really smart people who will be identifying mistakes. And then I can look at how do people learn from them and how easy is it and how hard is it? That's how I got in there. And then one thing led to another. After doing that study, people kept inviting me back.
- [17:03]
Stephen Dubner
I see she loves failure, they say.
- [17:05]
Amy Edmondson
That's right.
- [17:09]
Stephen Dubner
Edmondson focused her research on what are called preventable adverse drug events, like the one from the Redonda Vaught case.
- [17:17]
Amy Edmondson
Now, you can divide adverse drug events into two categories. One, which is related to some kind of human error or system breakdown, and the other, which is a previously unknown allergy. So it literally couldn't have been predicted. And those are still adverse drug events, but they're not called preventable adverse drug events.
- [17:35]
Stephen Dubner
But within the first category, there's probably 10 subcategories at least, Right? There's bad data entry, bad handwriting, wrong.
- [17:42]
Amy Edmondson
Eyeglasses, on and on it goes. Yep. Or, you know, using language badly so that people didn't understand what you said and they didn't feel safe asking.
- [17:50]
Stephen Dubner
My wife had a knee surgery, easy knee surgery. And the painkiller that they prescribed on the spot, the doc actually stood there and wrote it was for 100x nurses. The dosage.
- [18:01]
Amy Edmondson
Oh, no, no.
- [18:02]
Stephen Dubner
Yeah, yeah.
- [18:03]
Amy Edmondson
See, that's an error driven, preventable adverse drug event.
- [18:07]
Stephen Dubner
Yes, I agree.
- [18:10]
Amy Edmondson
You know, there will always be things that go wrong, or at least not the way we wanted them to. And my observation in studying teams in a variety of industries and settings was that responses to failure were rather uniform, inappropriately uniform. The natural response and even the formal response was to find the culprit as if there was a culprit, and either discipline or retrain or, you know, shame and blame the culprit. And it wasn't a very effective solution because the only way to prevent those kinds of system breakdowns is to be highly vigilant to how little things can line up and produce failures.
- [18:58]
Stephen Dubner
Based on what she was learning from medical mistakes, Edmondson wanted to come up with a more general theory of failure, or if not a theory, at least a way to think about it more systematically, to remove some of the blame, to make the responses to failure less uniform. Over time, she produced what she calls here. Let's have Edmondson say it.
- [19:21]
Amy Edmondson
My Spectrum of causes of Failures.
- [19:25]
Stephen Dubner
After the break, we will hear about that spectrum of causes of failures. It can clarify some things, but not everything.
- [19:33]
Amy Edmondson
Uncertainty is everywhere.
- [19:35]
Stephen Dubner
I'm Stephen Dubner and you are listening to Freakonomics Radio. We will be right back with how to Succeed at Failing. Freakonomics Radio is sponsored by ebay. Picture this. You're halfway through a DIY car fix, tools scattered everywhere and you realize you're missing a part. It's okay because whatever it is, it's on ebay. Brakes, headlights, cold air intakes. Whatever you need. Guaranteed to fit. No more crossing your fingers and hoping you ordered the right thing. All the parts you need at prices you will love. Guaranteed to fit every time. Ebay Things people love Freakonomics Radio is sponsored by Progressive, where drivers who save by switching save nearly $750 on average. Plus auto customers qualify for an average of 7 discounts. Get a quote now@progressive.com to see if you could save Progressive Casualty Insurance Company and affiliates national average 12 month savings of $744 by new customers surveyed who saved with Progressive between June 2022 and May 2023. Potential savings will vary. Discounts not available in all states and situations. Freakonomics Radio is sponsored by E Trade from Morgan Stanley. Dive into the market with E Trade's easy to use tools. Now there's even more more to love. Get access to expert insights from Morgan Stanley to help navigate the markets. Open an account and get up to $1,000 or more with a qualifying deposit. Learn more@e trade.com terms and other fees apply. Investing involves risks. Morgan Stanley Smith Barney LLC Member SIPIC E Trade is a business of Morgan Stanley how did Amy Edmondson become so driven to study failure? Well, here's one path to it. Her whole life she had been a straight A student, right?
- [21:45]
Amy Edmondson
I never had an A minus. Well, you know, I once had one in 10th grade. It just was so devastating I resolved not to have one again. And I'm only partly joking.
- [21:53]
Stephen Dubner
But then she went to college.
- [21:55]
Amy Edmondson
I got an F on my first semester multivariable calculus exam. An F? Like I failed the exam? I mean that's unheard of.
- [22:04]
Stephen Dubner
What'd that feel like?
- [22:05]
Amy Edmondson
I didn't see it coming. But I wasn't baffled. After the fact, after the fact it was very clear to me that I hadn't studied enough.
- [22:14]
Stephen Dubner
In the years since then, Edmondson has been refining what she calls a spectrum of causes of failure. The spectrum ranges from blameworthy to praiseworthy. And it contains six distinct categories of failure.
- [22:29]
Amy Edmondson
Let's take two extremes. Let's say something goes wrong, we achieve an undesired result. On one end of the spectrum, it's sabotage. Someone literally tanked the process. They threw a wrench into the works. On the other end of the spectrum, we have a scientist or an engineer hypothesizing some new tweak that might solve a really important problem. And they try it, and it fails. And of course, we praise the scientist and we punish the saboteur, but the gradations in between often lull us into a false sense that it's blameworthy all the way.
- [23:10]
Stephen Dubner
Okay, so let's start at the blameworthy end of the spectrum and move our way along. Number one of the six, My spectrum.
- [23:19]
Amy Edmondson
Of causes of failures starts with sabotage or deviance. I soak a rag in lighter fluids, set it on fire, throw it into a building, Right? Or I'm a physician in a hospital. I'm a surgeon, and I come to work drunk and do an operation.
- [23:36]
Stephen Dubner
You describe this as the individual chooses to violate a prescribed process or practice. Now, I could imagine there are some cases where people violate because they think that the process is wrong.
- [23:48]
Amy Edmondson
That's right. There has to be intent here to label something a true sabotage. It has to be. My intent is to break something. It's not a mistake, and it's not a thoughtful experiment. There certainly are protocols in hospitals, for example, where thoughtful physicians will deliberately depart from the protocol because their clinical judgment suggests that would be better. They may be right, they may be wrong, but that would not qualify as a blameworthy act.
- [24:19]
Stephen Dubner
After sabotage on the spectrum comes inattention.
- [24:23]
Amy Edmondson
Inattention is when something goes wrong because you just were mailing it in. You spaced out, you didn't hear what someone said, and you didn't ask, and then you just tried to wing it. Or you maybe are driving. You're a trucker, and you're driving, and you look away. Or fiddle with the radio and have a car crash.
- [24:42]
Stephen Dubner
Now, it sounds like those are mostly blameworthy. But what about inattention caused by external factors?
- [24:49]
Amy Edmondson
Well, that's exactly right. Once we leave sabotage and move to the right in the spectrum, it will never be immediately obvious whether something's blameworthy or not. It's always going to need further analysis. So when we say the failure was caused by someone not paying attention, that just brings up more questions. Okay, why weren't they paying attention? Now, it could be that this poor nurse was on a double shift, and that is not Necessarily the nurse's fault. It might be the nurse manager who assigned that double shift, or it might be the fact that someone else didn't show up and so they have to just do it and they're quite literally too tired to pay attention fully. Right. So we always want to say, well, wait, let's see, what are the other contributing factors to this inattention?
- [25:38]
Stephen Dubner
Can you think of a large scale failure, a corporate or institutional failure that was caused largely by inattention? Yes.
- [25:47]
Amy Edmondson
One that comes to mind was a devastating collapse with the loss of many lives when a Hyatt Regency atrium collapsed in Kansas City in the early 80s. And the inattention there was the engineer on record's failure to pay close attention when the builder decided out loud, not hidden, to swap one long beam for two smaller connected steel beams. It would have been a 5 calculation to show that won't work with the loads that were expected. It was a change that didn't obtain the attention it needed to have avoided this catastrophic failure.
- [26:32]
Stephen Dubner
And was that change done to save money or was it even more benign than that?
- [26:36]
Amy Edmondson
I think it was a combination of speed and money. Speed is money.
- [26:41]
Stephen Dubner
Wow. Wow, wow, wow. That's a great example. Okay, let's go to the next one, inability. I'm reading one version of your spectrum here which describes this as the individual lacks the knowledge, attitudes, skills or perceptions required to execute a task. That's quite a portfolio of potential failure.
- [26:59]
Amy Edmondson
That's right. And that spans from a young child who doesn't yet know how to ride a bicycle. So as soon as they hop on that bicycle, they're going to fall off because they don't have the ability yet to, you know, multivariable calculus, which, at least when you're not studying hard enough, you don't have the ability. So it's something that you just don't have the ability to do to success but usually could develop.
- [27:27]
Stephen Dubner
This reminds me of the Peter Principle where people get promoted to a position higher than they're capable based on their past experience, but their past experience may not have been so relevant to this.
- [27:39]
Amy Edmondson
That's a great connection. Yeah, the Peter Principle where the failure gets caused by the fact that you don't have the ability to do the new role. But no one really paused to reflect on that.
- [27:52]
Stephen Dubner
I sometimes think about this in the political realm too. The ability to get elected and the ability to govern effectively seem to be almost uncorrelated to me, I'm sorry to say. Do you think that's the case and do you apply this Spectrum, sometimes to the political realm.
- [28:09]
Amy Edmondson
I don't think it was always the case, but I think it might be increasingly the case. There's no theoretical reason why the two abilities to be compelling and win people over to your point of view should be at odds with the capability to do it. But the way it is increasingly set up in our society might be putting them at odds.
- [28:34]
Stephen Dubner
After inability comes what Edmondson calls task challenge.
- [28:39]
Amy Edmondson
Yes, the task is too challenging for reliable failure free performance.
- [28:44]
Stephen Dubner
Example.
- [28:45]
Amy Edmondson
A great example is an Olympic gymnast who is training all the time and is able to do some of the most challenging maneuvers but will not do them 100% of the time. And so when that person experiences a failure, they trip during their routine, then we would call that a failure that was largely caused by the inherent challenge of the task.
- [29:10]
Stephen Dubner
Can you give an example in either the corporate or maybe academic realm?
- [29:15]
Amy Edmondson
Let's go to NASA, for example. The shuttle program is very, very challenging. I think we can all agree to that. And over time they started to think of it as not challenging, but really it's, you know, a remarkably challenging thing to send a rocket into space and bring it back safely.
- [29:33]
Stephen Dubner
Kind of paradoxical then that the thing was actually called Challenger.
- [29:37]
Amy Edmondson
That's a good point. Actually. I love Richard Feynman, looking back on the Challenger accident, his sort of simple willingness to just put the piece of O ring in the ice water, see what happens, right? That's something that in a better run, more psychologically safe, more creative, generative work environment, someone else would have done in real time.
- [29:58]
Stephen Dubner
But you know, if I recall correctly, even though he was on that commission to investigate, they tried to essentially shut him up. They didn't want that news coming out at the hearing. They wanted, you know, they didn't want the failure to be so explicit.
- [30:13]
Amy Edmondson
That's right. But that's, I mean, that's not a good thing.
- [30:16]
Stephen Dubner
That's not a good thing.
- [30:17]
Amy Edmondson
You've got to learn from it so that it doesn't happen again.
- [30:21]
Stephen Dubner
By the way, if you don't remember the story of Richard Feynman and the Challenger investigation and the O rings, don't worry. Last year we made a three part series about Feynman. The story of his role in the Challenger investigation is covered in part one of that series called the Curious Mr. Feynman. Okay, back to failure. The fifth cause of failure on Amy Edmondson's spectrum is uncertainty.
- [30:49]
Amy Edmondson
So uncertainty is everywhere. There's probably, you know, an infinite number of examples here, but let me pick a silly one. A friend sets you up on a blind date and you like the friend and you think, okay, sure. And then you go out on the date and it's a terrible bore. Or worse. Right, It's a failure. But you couldn't have known in advance it was uncertain.
- [31:12]
Stephen Dubner
How about a less silly example?
- [31:15]
Amy Edmondson
You're in a company setting, you have an idea for a strategic shift or a product that you could launch, and there's very good reasons to believe this could work, but it's not 100% the.
- [31:28]
Stephen Dubner
Final cause of failure. We have by now moved all the way from the blameworthy end of the spectrum to the praiseworthy is simply called experimentation.
- [31:38]
Amy Edmondson
I'm being fairly formal when I say experimentation. Right. The most obvious example is a scientist in a lab and probably really believes it will work and puts the chemicals in, and lo and behold, it fails. Or in much smaller scale, I'm going to experiment with being more assertive in my next meeting and doesn't quite work out the way I had hoped. It's the Edison quote, you know, 10,000 ways that didn't work. He's perfectly, perfectly willing to share that because he's proud of each and every one of those 10,000 experiments.
- [32:15]
Stephen Dubner
So that is Amy Edmondson's entire spectrum of the causes of failure. Sabotage, inattention, inability, task challenge, uncertainty, and experimentation. If you're like me, as you hear each of the categories, you automatically try to match them up with specific failures of your own. If nothing else, you may find that thinking about failure on a spectrum from blameworthy to praiseworthy is more useful than the standard blaming and shaming. It may even make you less afraid of failure. That said, not everyone is a fan of Edmondson's ethos of embracing failure. A research article by Jeffrey Ray at the University of Maryland, Baltimore county, is called Dispelling the Myth that Organizations Learn from failure. He writes, failure shouldn't even be in a firm's vocabulary. To learn from failure or otherwise, a firm must have an organizational learning capability. If the firm has the learning capability in the first instance, why not apply it at the beginning of a project to prevent a failure, rather than waiting for a failure to occur and then reacting to it? But Amy Edmondson's failure spectrum has been winning admirers, including Gary Klein, the research psychologist best known as the pioneer of naturalistic decision making.
- [33:37]
Gary Klein
I'm very impressed by it. I'm impressed because it's sophisticated, it's not simplistic. There's a variety of levels and a variety of reasons. And before we start making policies about what to do about failure, we need to look at things like her spectrum and identify what kind of a failure is it so that we can formulate a more effective strategy.
- [34:04]
Stephen Dubner
Okay, let's do that after the break. Two case studies of failure. One of them toward the blameworthy end of the spectrum.
- [34:13]
John Van Reenen
It was very much driven by, you.
- [34:15]
Stephen Dubner
Know, the Prime Minister Tony Blair, the other quite praiseworthy.
- [34:20]
Bob Langer
I failed over 200 times before I finally got something to work.
- [34:24]
Stephen Dubner
I'm Stephen Dubner. This is Freakonomics Radio. We'll be right back. Freakonomics Radio is sponsored by Stripe. AI companies need to launch business models as revolutionary as their products and they need to do it fast. Stripe billing powers leaders like OpenAI, anthropic and perplexity. In fact, every single one of The Forbes Top 50 AI companies that has a product on the market today uses Stripe to monetize it. So whether you're starting an AI company or just looking for advanced billing software, learn more at stripe.com billing Freakonomics Radio is sponsored by Whole Foods Market. There's so much to celebrate in May. From graduations to pool parties and beyond. Whole Foods Market helps you save on everything you need with the quality and ingredient standards you expect. Look for hundreds of yellow low price signs that help you save without compromising the quality you expect. Find them with their no antibiotics ever Ground Beef 365 by Whole Foods Market, organic salad kits and more. Save on May celebrations with great everyday prices at Whole Foods Market. This message is brought to you by Apple Card. Apply for Apple Card today and start earning up to 3% daily cash back on everyday purchases. And that daily cash can even grow automatically when you open a high yield savings account through Apple Card. What are you waiting for? Visit Apple Co CardCalculator today to see how much daily cash you can earn. Subject to credit approval savings available to Apple Card owners Subject to eligibility savings and Apple Card by Goldman Sachs Bank USA Member FDIC terms and more at applecard.com John Van Reenen is a professor at the London School of Economics. He studies innovation, but years ago he did some time in the British Civil Service.
- [36:36]
John Van Reenen
I spent a year of my life working in the Department of Health when there was a big expansion in the UK National Health Service of Resources and various attempts at reforms.
- [36:46]
Stephen Dubner
The National Health Service is the UK's publicly funded health care system and there was one particular reform that Van Reinen got to see up close.
- [36:55]
John Van Reenen
One of the key things that was thought could really be a game changer was to have electronic patient records so you can see the History of patients, their conditions, what they've been treated with. And having that information, instead of having all this pieces of paper written illegibly by different physicians, you could actually have this in a single record. Would not only make it much easier to find what was going on with patients, but could also be used as a data source to try and help think about how patients could have more joined up care and could even maybe predict what kind of conditions they might have in the future.
- [37:30]
Stephen Dubner
The project was called Connecting for Health and there was substantial enthusiasm for it. At least the ad campaign was enthusiastic.
- [37:39]
John Van Reenen
All this is a key element in the future of the nhs. One day, not too far away, you'll wonder how you, how do you live.
- [37:46]
Stephen Dubner
Without.
- [37:48]
John Van Reenen
Was very much driven by the Prime Minister, Tony Blair. This was a centralized, top down approach in order to have a single IT system where you could access information instead of having all these different IT systems, these different siloed pieces of paper, to have it in one consistent national system.
- [38:08]
Stephen Dubner
The NHS is a big operation, one of the biggest employers in the world.
- [38:14]
John Van Reenen
But then if you drill down into it, it is pretty fragmented. Each local general practitioner unit is self employed. Each trust has a lot of autonomy. And that's part of the issue, is that this was a centralized top down program in a system where there's a lot of different fiefdoms, a lot of different pockets of power who are quite capable of resisting this and disliked very strongly being told, this is what you're going to have, this is what you're going to do without really being engaged and consulted properly.
- [38:49]
Stephen Dubner
But the train rolled on. Despite these potential problems, Connecting for Health required a massive overhaul of hardware systems as well as software systems.
- [38:59]
John Van Reenen
And the delivery of those was. There was a guy called Richard Granger who was brought in. I think it was the highest paid public servant in the country. He was at Deloitte's before he came and then after he left, he went to work for Accenture. He was brought in to do this and he designed these contracts, very tough contracts, which loaded the risk of things going wrong very strongly onto the private sector providers. I think just about every single quote, unquote winner eventually either went bankrupt or walked away from the contract. The estimates vary of the cost of this, but estimates are up to $20 billion lost on this project. It was the biggest civilian IT project in the Western world. I mean, there's lots of examples of huge public sector failures and private sector failures as well, but this was one of the biggest.
- [39:50]
Stephen Dubner
British Parliament ultimately called this attempted reform. One of the Worst and most expensive contracting fiascos ever. So what kind of lessons can be learned from this failure?
- [40:03]
John Van Reenen
I think it's a failure of many, many different causes on many different levels. That, that top downness, not really understanding what was going on at a grassroots level, and the haste it was attempted on very quickly.
- [40:15]
Stephen Dubner
I've read that the haste, especially the haste of awarding contracts at the time was considered a great thing because it was so atypical of how government worked and it was hailed as a new way of the government doing business. In the end, that haste turned out to be a problem though. Correct?
- [40:32]
John Van Reenen
Correct. I mean, it seemed at the time when these contracts were formed, the government was getting a good deal, they were doing it quickly, they were loading the risks onto the suppliers. So it wasn't obvious from the get go that this was going to be as bad as it turned out to be. Looking back, trying to do things quickly in such a complicated system, there was so much complexity that a lot of these contracts effectively had to be rewritten afterwards. And I think another general lesson is that when you're doing a long term, important big contract, you can't get everything written down quickly. There has to be a lot of give and take. It's a kind of relationship that you have to adjust as things go. Contracts are very fuzzy, they're very incomplete, you just have to accept that. But you're going to have to not get things right, but not try to do everything really, really, really quickly. An IT project's never just about it. It's also about the way you change a whole organization. And to do it, it's not just about spending money. You also have to get players in that system on board because it's very difficult to just get them to do things. Especially in a public system where you can't just fire people if you want to fire them. You really have to have a culture of kind of bringing people on board if you want to make these type of changes. And that just didn't happen. So I don't think it's just one thing you could think of. There's the haste, there's the design, which worked out badly, and there's cultural aspects that we've talked about when you're trying to innovate. You want to have a way of allowing people to take risks and do things wrong, but then you also have to have feedback mechanisms to figure out, well, you know, what has gone wrong. So creating an attitude of saying, well, we actually don't know what the right thing to do is. So we're prepared to do experimentations and learn from that.
- [42:28]
Stephen Dubner
If you were the kind of person who likes to understand and analyze failure in order to mitigate future failures, what might be useful here is to overlay the National Health Service's IT fiasco onto Amy Edmondson's spectrum of causes of failure. Reconfiguring a huge IT system certainly qualifies as a task challenge, but there were shades of inability and inattention at work here as well. All of those causes reside toward the blameworthy end of the scale. As for the praiseworthy end of the spectrum, that's where experimentation can be found. The NHS project didn't incorporate much experimentation. It was more command and control, top down, with little room for adjustment and little opportunity to learn from the small failures that experimentation can produce and which can prevent big failures. Experimentation, if you think about it, is the foundation of just about all the learning we do as humans. And yet we seem to constantly forget this. Maybe that's because experimentation will inevitably produce a lot of failure. I mean, that's the point. And most of us just don't want to fail at all, even if it's in the service of long term success. So let's see if we can't adjust our focus here. Let's talk about real experimentation. And for that we will need not another social scientist like John Van Reenen or Amy Edmondson, as capable as they are, but an actual science scientist. Here is one of the most acclaimed scientists of the modern era.
- [44:16]
Bob Langer
My name's Bob Langer and I'm an institute professor at mit. I do research, but I've also been involved in health, helping get companies started. And I've done various advising to the government, FDA and places like that.
- [44:29]
Stephen Dubner
And if I say to you, Bob, what kind of scientist are you exactly? How do you answer that question?
- [44:35]
Bob Langer
Well, I would say I'm a chemical engineer or a biomedical engineer, but people have called me all kinds of things. They've called me a biochemist. We do very interdisciplinary work. So I end up getting called more than one thing.
- [44:49]
Stephen Dubner
Do you care what people call you?
- [44:51]
Bob Langer
I just like them to call me Bob.
- [44:56]
Stephen Dubner
Langer holds more than 1500 patents, including those that are pending. He runs the world's largest biomedical engineering lab at mit, and he is one of the world's most highly cited biotech researchers. He also played a role in the founding of dozens of biotech firms, including Moderna, which produced one of the most effective Covid vaccines. One thing Langer is particularly known for is drug delivery, that is developing and refining How a given drug is delivered and absorbed at the cellular level. A time release drug, for instance, is the sort of thing we take for granted today. But it took a while to get there. One problem Langer worked on back in the 1970s was finding a drug delivery system that would prevent the abnormal growth of blood vessels. The chemical that inhibits the growth is quite large by biological standards. And there was consensus at the time that a time release wouldn't work on large molecules. But as Langer once put it, I didn't know you couldn't do it because I hadn't read the literature. So he ran experiment after experiment after experiment before finally developing a recipe that worked decades later. Thanks to all that failure, his discovery played a key role in how Moderna used messenger RNA to create its COVID vaccine. So in your line of work, when I say the word failure, what comes to mind?
- [46:29]
Bob Langer
Well, I mean a lot of things, but I go back to my own career. I failed at trying to get research grants. My first nine research grants were turned down. I sent them to places like National Institutes of Health and they have study sections, reviewers. Mine would go, just because of the work I was doing, to what was called a pathology B study section, and they would review it. And they said, well, Dr. Langer, he's an engineer, he doesn't know anything about biology or cancer. I failed over and over again. Other things. Like I failed to get a job in a chemical engineering department as an assistant professor even. Nobody would hire me, they said. Actually the opposite. They said chemical engineers don't do experimental biomedical engineering work. So, you know, they should work on oil or energy. When I first started working on creating these micro nanoparticles to try to get large molecules to be delivered, I failed over 200 times. I mean, before I finally got something to work, I could go on and on in my failures.
- [47:25]
Stephen Dubner
What kept you going during all this failure?
- [47:28]
Bob Langer
I really believe that if we could do this, it would make a big difference in science and I hoped a big difference in medicine. Secondly, as I did some of it, you know, I could see some of these results with my own eyes. You know, when we were trying to deliver some of these molecules to stop blood vessel growth, I could see we were doing this double blind, but I could still see that we were stopping the vessels from growing. That's such a visual thing. And I also developed these ways of studying delivery out of the little particles by putting certain enzymes in them and putting dyes in a little gel that would turn color if the enzymes came out. And I Could see that happening, like I said, the first 200 times or first 200 designs or more, it didn't happen. But finally I came up with a way where I'd see it come out after an hour, after two hours, after a day, after a second day, up to over 100 days, some cases. So I could see with my own eyes this was working. So that made an enormous difference to me too.
- [48:23]
Stephen Dubner
But failing 200 times costs a lot of money and obviously a lot of time. Did you ever almost run out of one or the other?
- [48:31]
Bob Langer
The experiments I was doing weren't that expensive, especially the delivery ones initially because they were in test tubes. I worked probably 20 hour days and so the expense wasn't that great. And I've always been good at manufacturing time.
- [48:45]
Stephen Dubner
Hmm. Now, let's say someone is in a similar situation today to where you were then with an idea or a set of ideas that they believe in, that they think they are right about, they think it's an important idea, and yet they are failing and failing to get the attention of the people who can help manufacture success. How do you think about the line? I think of it sometimes as a line between grit and quit. Right. Economists talk about opportunity cost. Every hour you spend on something that isn't working is an hour you could spend on something that is working. But then psychologists talk about grittiness and how useful it can be to stick things out. Do you have anything to say to people who might be wrestling with that?
- [49:28]
Bob Langer
Well, I think it's a great question and I ultimately think it's a judgment call and we can never be sure of our judgment. You like to try to think, are these things scientifically possible? I think that's one thing. Secondly, it's good to get advice from people. That doesn't mean you have to take it, but it's good to get advice. I certainly personally have always erred on the side of the, I guess not quitting. And maybe that's sometimes a mistake. I don't think so. I think it depends on what could happen if you are successful. You know, if you are successful, could it make a giant difference in the world? Could it help science a lot? Could it help patients lives a lot. And so if you really feel that it. Can you try that much harder? If it's incremental, sure. Then it's much easier to quit.
- [50:12]
Stephen Dubner
Is that ability to persevere within yourself at least? Do you think that's your natural temperament? Is that something you learned? Did you find incentives to lead you there?
- [50:21]
Bob Langer
I think for me There are a couple things. One, I guess I've always been very stubborn. My parents told me that. But secondly, I think there's a whole thing with role models, too. When I was a postdoc, the man that I worked with, Judah Folkman, he experienced the same thing. He had this theory that if you could stop blood vessels, you could stop cancer. And that was mediated by chemical signals. And everyone told him he was wrong. But I would watch him every day, and he believed anything was possible. And he kept sticking to it. And, of course, eventually he was right. I think seeing his example probably also had a big effect on me.
- [50:59]
Stephen Dubner
Can you talk to me about how scientific failure is treated generally? Let's assume a spectrum. And on one end of the spectrum is that every failure is written up and published and perhaps even celebrated as having discovered a definitive wrong path to pursue. So everybody coming after you can cross that off their list. And on the other end of the spectrum, every failure is hidden away, which allows many other people to make the same failure. Can you talk about where the reality is?
- [51:29]
Bob Langer
I think that's an interesting question. A lot of it even depends how you define failure. You know, when you're trying to learn about something, you try different things. And embedded in the scientific papers we write, like when we wrote this paper in nature in 1976, which was the first time you could get small particles to release large molecules from biocompatible materials. Well, some of the materials we use failed. A lot of them did, actually, because they would either cause inflammation or the drug would come out way too fast or not come out at all. We found one fraction that worked and stopped blood vessels, and probably 50 or 100 that didn't. So the failures and successes are maybe in the same papers sometimes. What I've tried to do, even to give more detail, is you put all the data in, even if it makes for a very long thesis. So not only are the graphs there and the papers, but there's even the raw data that people can look at and analyze. And I try to get people to do as much of that as possible. So I guess what I'm trying to say is that the failures and successes are almost intertwined.
- [52:34]
Stephen Dubner
I'd like to hear you talk about how failure is discussed or thought of in the lab. Maybe it's nothing overt, but I am curious, especially when you bring in young people, researchers, whether they're, you know, postdoc or undergrad, do you give pep talks about failure? Do you kind of have a philosophy that you want to instill in These people, that failure is an essential component of research and success.
- [52:59]
Bob Langer
Yes, yes. And I do, and I. Whether it's my own talks or just meeting with students and brainstorming with them about those things. But to me, that research, scientific research, I mean, you just fail way more than. At least I do way more than you succeed. It's just part of the process. I mean, that's experimentation, and that's okay.
- [53:21]
Stephen Dubner
A lot of your colleagues and students go on to start companies, and that's a whole different ball of wax. How do you think about failure in the entrepreneurial process?
- [53:32]
Bob Langer
Obviously, the easy criteria is a successful company having a good financial exit, I suppose. But I don't necessarily think of it as just that way. I mean, that's certainly going to be important. I've been involved in things where you've advanced science and you learn some things and there's degrees of success. You just don't know. I've been pretty fortunate in the companies we've started in terms of the exits that they've had, but I just think there's no simple criteria. I feel like we've turned out a lot of great scientists and entrepreneurs, and not all their companies have had great financial exits, but I think they've also created products that can change people's lives. And that, to me, is also very, very important. Obviously, that's why we do it in the first place. I have never done it for money, and I don't think they do it for money. They do it to try to make a difference in the world.
- [54:23]
Stephen Dubner
Do you think failure is, however, a different animal in the research sphere, as in the entrepreneurial sphere?
- [54:29]
Bob Langer
I would say yes, I think it is. But I also think, you know, there's different cultures, too. I think the good thing about the United States culture, maybe in contrast to some cultures, is failure's widely accepted. I'll give you one of my examples, actually, in the business sphere. So I'm a big fan of chocolate.
- [54:49]
Stephen Dubner
Of eating it or making it or.
- [54:50]
Bob Langer
Researching it, probably any part, but mostly eating it. But at any rate, one of the books I read, and I'm actually not a fan of their chocolate, is a book on Milton Hershey. And so this really gets to your point on failure. Milton Hershey, he had this idea when he was young, very young, of starting a candy company. And I remember the first candy company, he went bankrupt, you know, and he tried to raise more money, started another one. I think, like the first six or seven totally failed, but not the last one, obviously, and he became a millionaire at a time when there weren't very many. Was that really failure or was it just being an apprentice to trying to learn how to succeed? And I think that's true in a lot of things. The reason I brought it up is I don't think there's a shame and failure in either area, or I hope there's not. I think you have to feel it's okay and then you keep going on.
- [55:43]
Stephen Dubner
What do you think? Would you like to live in a world where there's no shame in failure?
- [55:50]
Amy Edmondson
Or.
- [55:50]
Stephen Dubner
Or do you think it's important for failure to hurt, to burn, as one of our guests put it last week? Maybe that creates a stronger incentive to succeed. I'd love to know your thoughts on this question and on this series so far. Send an email to radioreconomics.com or you can leave a review or rating in your podcast app. Coming up next time on the show, we will dig deeper into the idea of grit versus Quit. When you're failing, how do you know if it's time to move on? We just could not stop it from leaking and I was no longer willing.
- [56:29]
Alyssa Hemmelgarn
To just keep pouring more and more of my money into it.
- [56:32]
Amy Edmondson
He dumped me when I was 70.
- [56:34]
Bob Langer
And I married him again at age 75.
- [56:37]
Stephen Dubner
You know, hope springs eternal.
- [56:38]
Amy Edmondson
This is a great idea.
- [56:39]
Stephen Dubner
You just have to raise a quarter million dollars. Case studies in Failure and in Grit versus Quit it, including stories from you, our listeners. That's in the next part of our series on failure. Until then, take care of yourself and if you can, someone else too. Freakonomics Radio is produced by Stitcher and Renbud Radio. This episode was produced by Zach Lipinski. He and Dalvin Abuaji worked on the update. It was mixed by Eleanor Osborne and Jasmine Klinger, with help from Jeremy Johnston. The Freakonomics Radio National Network staff also includes Alina Coleman, Augusta Chapman, Ellen Frankman, Elsa Hernandez, Gabriel Roth, Greg Rippon, Morgan Levy, Sarah Lilly and Teo Jacobs. You can find our entire archive on any podcast app. Also@freakonomics.com where we publish transcripts and show notes. Our theme song is Mr. Fortune by the Hitchhikers, and our composer is Luis Guerra. The conversation that we had casually last year was a great conversation. If we can essentially do something similar, that'll be fantastic for our listeners.
- [57:48]
Bob Langer
I'll try to remember what I said.
- [57:55]
Redonda Vaught
The Freakonomics Radio Network the Hidden side.
- [57:59]
Carol Hemmelgarn
Of Everything Stitcher.
- [58:08]
Unknown
Pilots know that weather factors like pop up storms, turbulence and unexpected icing can turn a routine flight into a challenge. But what if you had satellite delivered weather data giving you the full picture of what's around you directly on your tablet or display. SiriusXM Aviation brings you coast to coast high resolution weather info including radar, winds, icing T, VFRs, Pireps and more without altitude limitations or line of sight restrictions. Plus it includes features not found on ads B such as storm tracks, echo tops and both cloud to cloud and cloud to ground lightning. SiriusXM's aviation services are compatible with the Foreflight and Garmin pilot apps. You can also add SiriusXM Entertainment and listen to ad free music plus sports talk, comedy news and more while you fly. Fly confidently, knowing you have the best information available to make decisions in flight. Visit SiriusXM.com aviation to learn more.
- [59:09]
Amy Edmondson
Psoriatic arthritis symptoms can be unpredictable I had joint pain and I couldn't move like I used to.
- [59:17]
Stephen Dubner
I needed relief.
- [59:19]
Carol Hemmelgarn
I got Cosentyx.
- [59:21]
Bob Langer
It helped me move better.
- [59:23]
Alyssa Hemmelgarn
Cosentix Secukenumab is prescribed for people 2 years of age and older with active psoriatic arthritis. Don't use if you're allergic to Cosentyx. Before starting, get checked for tuberculosis. An increased risk of infections and lowered ability to fight them may occur like tuberculosis or other serious bacterial, fungal or viral infections. Some were fatal. Tell your doctor if you have an infection or symptoms like fevers, sweats, chills, muscle aches or cough had a vaccine or plan to or if inflammatory bowel disease symptoms develop or worsen serious allergic reactions and severe eczema like skin reactions may occur. Learn more at 1-844-cosentix or cosentyx.com.
- [60:04]
Stephen Dubner
Ask your dermatologist about Cosentyx.
- [60:12]
Unknown
Lowe's knows to bring your vision to life. It's important to find the right color. That's why Mylo's Rewards members get a free paint or exterior stain sample to test your look and find the perfect color to confidently refresh your space. Lowes we help you save Offer Valid in store only 58 through 5 14. Limit one per customer while supplies last. Discount taken at time of purchase. See Associate for details Program subject to terms and conditions details@lowes.com terms subject to change.