AI in Healthcare Isn’t What You Think

Summary

Curiosity Weekly (April 29, 2026)

Episode: AI in Healthcare Isn’t What You Think

Host: Dr. Samantha Yammine ("Sam")
Featured Guest: Dr. Nina Kotler, Radiologist & Chief Medical AI Officer, Mosaic Clinical Technologies

---

Episode Overview

In this week’s episode, Dr. Samantha Yammine explores the current and future roles of artificial intelligence (AI) in healthcare, with a special focus on radiology. The featured interview is with Dr. Nina Kotler, who provides an expert, insider’s perspective on where the AI “hype” meets healthcare reality. The discussion candidly unpacks where AI offers real promise, why some bold predictions haven’t come true, and what it will genuinely take for AI to transform the industry—balancing hope, practicality, and patient trust.

Additional brief segments highlight new discoveries in koala genetic diversity and a study about how social cues influence our pain and effort expectations.

---

Key Segments & Discussion Points

1. Koala Genetics Surprising Discovery (01:59–07:33)

• Summary: Dr. Yammine discusses a recent study challenging long-held beliefs about genetic diversity in small, recovering koala populations in Australia.
  • Expectations were that a population bottleneck would cause lasting loss of genetic diversity.
  • Researchers found Victorian koalas exhibited surprising genetic recovery—likely due to factors like rapid population growth and “effective population size.”
  • Memorable Explanation:
    “In a boardroom of 30 executives, but only six doing all the talking… the board is essentially behaving like a six person group. That’s the effective size.” (03:58)
• Takeaway: Even when numbers are low, populations can bounce back with the right conditions, but ongoing monitoring is critical.
  [Segment ends at 07:33]

---

2. Main Interview: AI in Healthcare with Dr. Nina Kotler (07:33–28:40)

AI’s Current Use and Potential in Healthcare (Radiology Focus)

(07:33–12:40)

• Dr. Kotler explains “AI in healthcare” at a high level:

  • Medical AI leverages vast datasets—especially digital images (CT, X-ray, ultrasound) plus patient info.
  • Radiology is the earliest and most digitalized medical field to adopt AI (since 2016).
  • The main roles for AI:
    • Diagnostics: Early AI focused on recognizing specific things in images ("hot dog / not hot dog" models).
    • Workflow Efficiency: The focus is now shifting toward automating workflow tasks, not just clinical interpretation.

  “Radiology is one of the earliest spaces…that AI came out in healthcare, and that was back in 2016. That’s because radiology is so very digital…” – Dr. Kotler (09:32)

• Healthcare Capacity Crisis:

  • There is a massive and growing shortfall in medical imaging capacity vs. staffing.
  • In radiology, imaging volume is growing 10x faster per year than the workforce.
  • This leads to increased wait times and backlogs—AI’s role is to help bridge this gap.

  “Every year…there’s a 10x difference in the amount of imaging versus people…in 2022, that gap crossed the threshold where we can’t manage it anymore…turnaround times have been increasing.” – Dr. Kotler (13:11)

Why Geoffrey Hinton Was Wrong: Limits of Current Medical AI

(14:15–17:46)

• Dr. Yammine cites Hinton’s (2015) prediction that radiologists’ training should stop because AI would surpass them within five years.

• Dr. Kotler’s Insights:

  • That prediction discouraged medical students, worsening today’s shortages.
  • Medical AI (“narrow AI”) is not the same as general consumer models (e.g., ChatGPT).
    • Most AI in medicine still does specific, single tasks (“hot dog / not hot dog”) rather than comprehensive assessments.
  • General foundation models are not yet widely operational in clinical settings due to regulation and the complexity of integration.

  “It’s very easy to just assume that we’re as far ahead as where everyone else is…but there’s regulation, systems that don’t connect…we’re at what we call narrow AI. It’s a hot dog, not-hot-dog model.” – Dr. Kotler (15:49)

Where AI Delivers Now—And Where It Falls Short

(17:46–20:52)

• Biggest Near-Term Win: Workflow automation (editing reports, finding prior images, managing bureaucracy), not actual interpreting of images.

• What AI Can’t Do (Yet):

  • It cannot assume clinical accountability or judgment.
  • Struggles with rare conditions because these are underrepresented in training data.
  • AI alone still produces too many false positives/negatives—the best outcomes come from physicians using AI as a “second set of eyes.”

  “What it doesn’t do is take accountability for the patient…AI produces a lot of incorrect results. The physician with the AI together makes the better combination.” – Dr. Kotler (19:04)

Evaluating AI’s Real Impact in Practice

(20:52–23:45)

• AI’s technical accuracy metric isn’t enough; usability and workflow integration matter more.

• Real-world physician acceptance is the bottleneck—as shown by hospitals buying expensive AI systems that sit unused without proper training.

• Evaluation must go beyond statistics (sensitivity, specificity) to consider actual clinical enhancement and workflow improvement.

  “You could have the best AI tool in the world…but if it is put into a workflow where the clinician is not going to be able to use it easily, then it doesn’t matter how good that tool is.” – Dr. Kotler (21:28)

Does AI Democratize Access or Worsen Inequity?

(23:45–26:59)

• Promise: AI can, in principle, deliver specialist-level expertise to underserved or rural hospitals.

• Reality So Far:

  • High cost and need for sustained training make adoption difficult for under-resourced systems.
  • Hospitals are financially pressured; government reimbursement for AI tools is minimal, slowing broader uptake.

  "I wish we could say that everything was just about the quality of care...but as hospitals are losing money year after year..., they also have to think about the amount of dollars that they're putting into the system." – Dr. Kotler (25:03)

• As AI becomes more advanced (foundation models), costs should fall and value should rise, ultimately making broader access more feasible.

Training Data Gaps & Model Limitations

(26:59–28:34)

• “Narrow” AIs are trained on small, homogenous datasets, limiting reliability—especially for rare diseases or populations the model hasn’t seen.

• “Foundation” models trained on massive, varied datasets can adapt better and generalize to new cases.

• Current limitation: Most clinical AI is still “narrow.”

  “In radiology, we give the images and… the AI learns on its own. But… today, narrow AI models… trained on a smaller data set. If you have a piece of data that looks… different… it won’t work as well.” – Dr. Kotler (27:20)

Closing Reflections

(28:34–28:40)

“I am very excited where we’re going in healthcare. It’s one of the only times where technology can have a massive impact.” – Dr. Kotler (28:34)

---

3. Social Influence on Pain & Effort (31:03–34:18)

• Study: Dartmouth researchers showed that fake “average ratings” (social cues) influenced participants’ perceptions of pain, mental effort, and expectations—overriding direct experience.
• Takeaway: Social feedback strongly biases how we expect and experience pain and difficulty, explaining phenomena like the placebo effect.
• Memorable Advice:
  “Just because someone else says something is hard—or even painful—it doesn’t mean your experience will be the same. Stay open to experiencing things differently.” – Dr. Yammine (33:28)

---

Notable Quotes

• On AI’s present limits:
  “We’re at what we call narrow AI. It’s a hot dog, not-hot-dog model. But instead of identifying hot dog, it identifies things like blood in the brain or a hole in the lung or cancer. And those are important, but they’re not how I work as a radiologist or how any other human works.”
  – Dr. Kotler (15:49)

• On capacity crisis:
  “Every year…there’s a tenfold difference in the amount of imaging versus people…in 2022, that gap crossed the threshold where we can’t manage it anymore.”
  – Dr. Kotler (13:11)

• On AI’s future path:
  “The endpoint is the improvement in healthcare…figuring out what new opportunities are there that we can identify with AI. Instead of identifying disease after it’s happened, how can we predict disease before it occurs?”
  – Dr. Kotler (11:37)

• On evaluation beyond technical accuracy:
  “You could have the best AI tool in the world…but if it is put into a workflow where the clinician is not going to be able to use it easily, then it doesn’t matter how good that tool is.”
  – Dr. Kotler (21:28)

• On democratizing access vs. economic barriers:
  “Unfortunately, the government is not paying for these tools…there’s very little payment for AI…we have to be able to improve outcomes without increasing the cost.”
  – Dr. Kotler (25:58)

---

Timestamps for Important Segments

• [01:59] — Koala genetics segment
• [07:33] — Start of AI in healthcare segment
• [08:33] — Explaining broad categories of AI use in medicine
• [10:53] — Shift from diagnostics to workflow AI
• [13:11] — Healthcare staffing and capacity crisis
• [14:53] — Geoffrey Hinton’s “radiologists will be obsolete” prediction analyzed
• [17:54] — What workflow means and why image interpretation isn’t the main bottleneck
• [19:04] — AI’s accountability problem and rare diseases challenge
• [21:10] — How AI is evaluated; why stats aren’t the whole story
• [23:45] — Does AI democratize healthcare access? Barriers to adoption
• [26:59] — Data gaps and model universality
• [28:34] — Final thoughts from Dr. Kotler
• [31:03] — Social influence on pain and effort study

---

Overall Takeaways

• AI in healthcare is both promising and hyped, but not a panacea—yet.
• Radiology, thanks to its digitization, led the way, but the reality is narrow, regulated, incremental progress.
• The greatest current value is in freeing up workflow bottlenecks, not in replacing judgment or diagnosis.
• AI’s biggest opportunities lie ahead, especially as foundation models mature and costs come down—but only if deployed thoughtfully and inclusively.
• Human expertise, clinical accountability, and patient trust remain central.
• Social context can influence even clinical experiences—so guard your expectations, even in healthcare!

---

For more on this topic, catch the full discussion between Dr. Samantha Yammine and Dr. Nina Kotler on Curiosity Weekly, April 29, 2026.

Transcript

[Dr. Nina Kotler]

This is a Monday.com ad. The same Monday.com helping people worldwide getting work done faster and better. The same Monday.com designed for every team and every industry. The same Monday.com with built in AI scaling your work from day one. The same Monday.com that your team will actually love using the samemonday.com with an easy and intuitive setup. Go to Monday.com and try it for free. Yes the same Monday.com hey honey, it's mom. Did you know if we switch to Verizon we can get four phones for $0 plus four lines for $25 a line? Call me back me again. That's just $100 a month for four lines on unlimited welcome plus four phones. No trade in needed. Call me. It's mom America's Best network Verizon. That's the one we're talking about.

[Advertisement Voice]

I'll send you text America's best Network based on RootMetric's best overall mobile network performance US 2nd half 20254 new lines on a limited welcome and autopay.

[Dr. Samantha Yamin]

See verizon.com for details.

[Advertisement Voice]

With no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking. With Capital One, if he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends it's pretty much all he talks about in a good way. What's in your wallet? Terms apply. See capitalone.com bank capital1NA member FDIC.

[Dr. Samantha Yamin]

Hey everyone, Quick message before we get into the episode. We love our listeners and would be thrilled to hear what you think of the show. It really helps us behind the scenes. So leave us a review on Apple Podcasts or Spotify and tell your friends to tune in. If you've got a science question or a topic that you want us to cover, just feel free to let us know.

[Dr. Nina Kotler]

Thank you.

[Dr. Samantha Yamin]

We cover artificial intelligence from a lot of different angles on this show, and can you blame us? In a few short years, the tech has already upended a ton of industries. From customer service, chatbots and E commerce to fraud reporting and banking to social media content creation. AI is everywhere. Sometimes for better, sometimes sometimes for worse. One thing that most people can agree on is AI has the potential to improve elements of our healthcare industry. Here to provide some clarity on what that looks like is Dr. Nina Kotler. Before I chat with Dr. Kotler, we'll learn about how Koala populations in Australia are upending some common theories on population genetics. And later, we'll get into a study that explores how other people's opinions shape our own experiences. My name is Dr. Samantha Yamin, and this is Curiosity Weekly. Let's dive in. There's a common understanding in population genetics. The fewer the number of animals in a closed group, the less genetic variation in future generations. It's basic biology. Fewer parents can lead to inbreeding and more genetic overlap between kids. That can lead to infertility and genetic damage down the family tree. So you can imagine the surprise of biologists when they recently discovered the opposite to be true for a group of koalas living in the Australian state of Victoria. A population of koalas in Victoria shrunk down in the last hundred years due to hunting, habitat loss and disease. Their small population size and genetic pool put them on the brink of extinction. Starting in the 1890s, a small group of koalas were moved to two Victorian islands. Their descendants helped repopulate the mainland. And by 2020, the total population across Australia was between 300 and 500,000 koalas. Though how this succeeded was unclear, Previous studies showed that they were less diverse as a result. But when this team re examined their genomes, they found signs of unexpected genetic recovery and diversity, surprising the researchers. So what gives? If there were only a few koalas to repopulate, where are their offspring getting all this genetic diversity from? Well, it turns out that it's a combination of things. The research team looked into the genomes of over 400 koalas from 27 different groups all over the country. They honed in on trying to measure and understand essentially their genetic headcount, as opposed to just population size. They wanted to know the number of individuals in a population that actually contribute genes to the next generation in ways that impact diversity. This is called effective population size. Think of it this way. In a boardroom of 30 executives, but only six doing all the talking and deciding everything, the board is essentially behaving like a six person group. That's the effective size. And there were gaps in the previous ways we've been measuring genetic diversity in koalas. They weren't looking for the rare alleles in the koala genome that paint a much more nuanced picture of genetic health. Alleles are variants of specific genes, by the way, like eye color, hair color, et cetera. Now, second, the researchers discovered that when populations grow rapidly, you get more shuffling of genes in each generation, diluting the frequency of harmful mutations. Over time, that continued mating diversifies the gene pool. It's an exciting discovery, not only for the cute little Aussie koalas, but for a lot of other vulnerable species that face potential extinction. It shows that even when numbers are low, there's still an opportunity to bounce back and thrive. But those gains are not guaranteed. Another crash could erase them, so ongoing monitoring and support are still needed.

[Dr. Nina Kotler]

Are you really buying a car online on Autotrader right now? Really? I can get super specific with dealer

[Dr. Samantha Yamin]

listings and see cars based on my budget.

[Dr. Nina Kotler]

You can really have it delivered or pick it up. I think kid is walking up the slide.

[Dr. Samantha Yamin]

Really? Autotrader?

[Dr. Nina Kotler]

Buy your car online? Really?

[Advertisement Voice]

With no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking with Capital One. If he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends, it's pretty much all he talks about in a good way. What's in your wallet? Terms apply. See capitalone.com bank capital1na member FDIC

[Dr. Nina Kotler]

Imagine waking up to breathtaking landscapes, vibrant culture and a welcoming community. New Zealand is calling. If you are a passionate early childhood primary or secondary school teacher, New Zealand says come teach us. With up to 10,000 New Zealand dollars in relocation support, now's the time to make your move. Find out more about moving to New Zealand to [e-mail] open to existing qualified primary, secondary and ECE teachers. Note that this grant is only dispersed after a teacher has arrived in New Zealand and meets the other accompanying criteria. We all belong outside. We're drawn to nature, whether it's the recorded sounds of the ocean we doze off to or the succulents that adorn our homes, nature makes all of our lives, well, better. Despite all this, we often go about our busy lives removed from it, but the outdoors is closer than we realize. With Alltrails, you can discover trails nearby and explore confidently with offline maps and on trail navigation. Download the free app today and make the most of your summer with Alltrails.

[Dr. Samantha Yamin]

As healthcare systems continue to be overburdened, it's not surprising people are optimistic about how AI might be able to help. In fact, 80% of physicians reported that they use AI in a professional context, according to a survey published in March 2026 by the American Medical Association. That's up more than double from 2023 but when people's lives are at stake, of course we have to be super careful about accuracy and maintaining trust between patients and providers. So it's a really careful walk along the line between hype and hope. To help us understand where things are headed. We're chatting with Dr. Nina Kotler, a radiologist and chief medical AI officer for Mosaic Clinical Technologies. She's also an associate fellow at the Stanford center for Artificial Intelligence in Medicine and Imaging. Welcome to the show, Nina.

[Dr. Nina Kotler]

Thanks, Sam. Great to be here.

[Dr. Samantha Yamin]

I'm wondering if you can start us off with the broad categories of AI use in healthcare and what kind of problems they're trying to address in new ways.

[Dr. Nina Kotler]

At a high level, AI in healthcare is using data, and in radiology, that data is medical images like CT scans and X rays and ultrasounds. Takes in also reports and patient information to help clinicians make better decisions. That's just very high level in radiology. I don't know how many people in the audience know specifically what a radiologist does, because I think there's a lot of confusion. Sometimes I ask people, hey, what do you think a radiologist does? And they tell me, although you're the one that takes the images, when I go to get my hand X rayed, that's not actually the case. That's the rad tech. A radiologist is the doctor that interprets the those images. And in general, what we tend to do, and the reason why I went into radiology is because we're called the clinicians. Clinicians. We're the doctor's doctor. And that means we provide a consultation to the other physicians to help them understand what's going on with their patients. To do that, we need information. And that information, generally, for us at least to start, is a lot of the information in the medical images. And as we start applying AI, we're applying AI to that data to start to understand more from those images in combination with the patient history and all of the other data that is available about the patient within all of our electronic medical records. Radiology is one of the earliest spaces, actually the earliest space that AI came out in healthcare, and that was back in 2016. And that's because radiology is so very digital, meaning all of our information is not able to in those physical paper images anymore. Right. They used to be printed out images. Now they're all digital, so we can send them to different places. And that enables us to use AI a lot more easily.

[Dr. Samantha Yamin]

And in that American Medical association survey from this year, 2026, there was a line saying, that the physicians were expecting the greatest benefits of AI in healthcare to be related to diagnostic ability and also work efficiency. And then there's like hospital admin and all the different healthcare worker workflows. Is that kind of all the different areas where we would probably see AI touching?

[Dr. Nina Kotler]

Yeah, I think we started off, it's evolved. We started with AI and healthcare in 2016, and back then it was mostly diagnostics. It was a very narrow system that would help tell you if one thing was present or absent in a whole imaging exam. And now we're moving to another phase where we're trying to move more toward workflow. Workflow is a little different. There's so many things that we do that are not diagnostics, and that part is actually way harder. So when we concentrate on those workflow items, we're actually improving the efficiency from which we can get things done. And right now, the biggest problem in healthcare, number one problem, is actually not the quality. The number one problem is having enough physicians to manage all of the people and the exams that are needed to be interpreted. Because if you can't get to that, it doesn't matter how good your quality is. So right now, workflow is the biggest thing that can enable additional capacity in the system. But the be all, end, all the benefit in the end is figuring out what new opportunities are there that we can identify with AI. So instead of identifying disease after it's happened, how can we predict disease before it occurs? How can we, once we do identify disease, how can we determine what the best treatment and exactly what that disease is and how it's going to react to the different treatments we can give? How can we provide this information to physicians and to patients so that they can actually see what their body is doing and as they make changes in their lifestyle, how that's actually affecting them, Those are future things that we need to move to. We just have to get through this capacity piece in order to manage all of the patient care that we need. But it's not the end point. The endpoint is the improvement in healthcare.

[Dr. Samantha Yamin]

Kind of going for the most urgent thing, the most immediate need, and the lowest hanging fruit is solving the capacity issue. Then we get into all the other more innovative stuff once we've caught up.

[Dr. Nina Kotler]

Yeah, I don't know if people realize just how far behind we are with our capacity. This is physician capacity. And I'll give you the numbers for radiology, since I know that, but it is not limited to radiology. We are probably about 15% understaffed in radiology. In terms of the imaging volume compared to the number of radiologists that there are, and I was in London a couple of weeks ago, they're 30% double what we are. And the reason behind that is every year in the US we are ordering about 4% more imaging exams every single year. Now each image exam is also getting more complex, like there could be, and I don't know if people realize this, there could be a thousand images in a single imaging exam that we're interpreting. So about 4% more a year. And the number of radiologists that is increasing, it's 0.4%. Now, those numbers are both really small, so they don't sound like they have a big impact, but they're a 10x difference. So if every year there's a 10x difference in the amount of imaging versus the amount of people you have to manage that imaging, like just imagine how big that gap is. And in 2022, that gap crossed the threshold where we can't manage it anymore. So every year since 2022, turnaround times have been increasing, which means how long you have to wait to get your images before you're seen, how long you sit in the er. All of these things are increasing. And this is not just in radiology, this is in every specialty.

[Dr. Samantha Yamin]

And I'm based in Canada where capacity issues are huge and wait times are really, really long. So I can only imagine what our stats are. What's interesting as we're speaking about capacity though is that I'm reminded of back in 2016, I remember Nobel Prize laureate and godfather of a, he's often called Geoffrey Hinton, said people should stop training radiologists now. And it is just completely obvious that within five years deep learning will do better than radiologists. That was a direct quote. So I'm curious, that doesn't seem to be the case today, but where has it fallen short and why didn't that pan out?

[Dr. Nina Kotler]

Yeah, super interesting actually. That prognosis from him in 2015 actually decreased the number of radiologists that have gone into radiology. So that's worse than the problem and we are at the opposite end. I've been radiology for 20 years, I have never seen this big of a deficit ever. And so yes, this is a massive problem. Why did he guess that and where did he go wrong? I think people don't realize the kind of AI that you all might be using in your day to day. Maybe you're using Gemini or ChatGPT or Claude or Grok, any of these tools. These tools are called foundation models, meaning they're very general. They don't just answer one question, they answer any question that you could have. And they could do it with all different kinds of mechanisms. They could look at images, you could put in a copied image and it could interpret that, you could speak to it. Which speaking now generally is writing. So it can do language and images. They call that multimodal. What are we using in radiology? There was actually a really funny skit that if anyone has seen the TV show Silicon Valley, there's a Silicon Valley show. It was an episode from years ago where one of the guys in Silicon Valley created an AI tool. And the episode is hysterical. They talk about this tool, how it can identify what's in the image. Now the first thing they do is they take a picture of a hot dog and they run it against the AI and it goes, hot dog. And they're like, oh my God, this is amazing. It's going to change the world. Now remember, this was years and years ago. Change the world. This is fantastic. Then they say, do another one, do another one. So they take a picture of a pizza and they're all like, okay, what's going to happen? And it says, not hot dog. And that's actually where we are in radiology AI right now. It's very easy to just assume that we're as far ahead as where everyone else is using it today. But there's regulation, there's systems that don't really connect together. It's so much more difficult to deploy that kind of thing in the healthcare system. So right now we're at what we call narrow AI. It's a hot dog, not hot dog model. But instead of identifying hot dog, it identifies things like blood in the brain or a hole in the lung or cancer. And those are all really important, but they're not how I work as a radiologist or how any other human works. When I get a result from an AI that says there's a hot dog or there's some blood in the brain, great. I'm looking at maybe 500 images on a head CT. I want to describe where the blood is, if it's new or not. Is it getting worse than it was before? What associated findings are there? And then I look for 500 other things on that study, not just the one. So it's just very different from the experience that you might be experiencing in using AI in your day to day life.

[Dr. Samantha Yamin]

Where do you see the biggest near win for AI? How would it make your, your day in that part of your workflow faster? Or more efficient?

[Dr. Nina Kotler]

Yes, really important. Radiologists or any physician spends the least amount of time picking up things in the image. Why? It's the fastest thing we do. It's part of our cipital lobe back here in the back of our brain, and that has evolved over millions of years. We are actually really good as humans at picking up things. So when you have someone else that's looking, it helps improve the sensitivity of what we have. We pick up more stuff. But does it help us do it faster? Not really. We spend way more of our time doing other things in the workflow rather than picking up the pathology. So when we talk about workflow, like, what does that actually mean? Well, it's doing the things that are low value for us as radiologists. Super high value for us to be looking at the images, because that's where the patient is. Super low value for us to be editing the report and looking at the report. Especially if you're going back and forth, because humans are not good at changing our focus.

[Dr. Samantha Yamin]

If I can quickly ask you almost the opposite question. Is there something that you don't think that AI will be able to help with in the near future? Of course, we can't predict long term. That maybe would surprise people.

[Dr. Nina Kotler]

So, yes, I can tell you where we're starting to use AI in a way that it acts like a second set of eyes that it can do. It's very good at that. What it doesn't do is take accountability for the patient. I mean, ultimately, we as physicians take accountability for every single patient that we see. AI, we tend to anthropomorphize it to say it's acting like a human. We can only imagine what a human does. It's copying some of the things a human does. So we think it's being like a human. It doesn't have the same level of accountability. That's one thing. The second piece is a lot of things in health care these days are uncommon. When you look overall at a whole population, how many people have blood in their brain? Well, most of what I see, even for the patients that come into the hospital, so they're sick and we expect they might have something, it's about 5% of the time. So a lot of things in healthcare are uncommon. The less common something gets, the more times the AI will provide a result that's incorrect. And it's just the math behind it. It's related to what we call disease prevalence, which is how common something is, and what we call a metric of the AI, which is positive predictive value when it tells you there's a positive finding, how often is it right? And actually that gets really low when things are uncommon. So it's very hard for that long tail of findings for the AI to provide a right result. You need a second person and a human to look at that, to get rid of of the times it's wrong, all of the false positives. So AI produces a lot of incorrect results. The physician with the AI together that make the better combination.

[Dr. Samantha Yamin]

I'm really interested in the evaluation side of AI, and I know you recently published about a new approach to evaluate AI models and their potential value in radiology. So I'm wondering if you can tell us about it and some takeaways on how to think critically about the positive impact of AI here.

[Dr. Nina Kotler]

Yeah, I think a lot of people just immediately think if you look at the AI accuracy, especially what the vendor might give or what you see in the fda, because anything that involves an image medical imaging has to go through the FDA before it can be marketed or sold. And with that, the FDA will provide statistics that help determine if something is safe. And we looked at those statistics a while ago, both what the FDA provided and what the vendor provided. And it tells you things about how sensitive it is to finding disease, how specific it is to not over calling disease and a few other things, but as a clinician, as the end user, not a single one of those statistics is what I feel as an end user. And the biggest question to me, because these tools are not working on their own, because they're working with a physician, the biggest question is, how is the physician going to feel about using these tools? You could have the best AI tool in the world, the most accurate tool in the world, but if it is put into a workflow where the clinician is not going to be able to use it easily, then it doesn't matter how good that tool is. And all we're seeing right now, especially from the vendor, is like, look how good my tool is. What we need to do is look how well it's going to be accepted and utilized. And I have an example because we, before we roll anything out, we spend a lot of time educating our physicians, giving them expectations about how AI works, how this AI works, what to think like, how to work with it optimally. And we do that. In the beginning, we were doing this literally physician by physician on site. And we went to this one hospital, we said, hospital, do you want to look at the education that we're giving to our clinicians so you could see what we're doing to make sure that people are using the AI appropriately and really understand it. And they're like, oh great, yeah, let me look. So after that session they came to us and they said, oh, we bought three other AI systems that no one's using. Can you just go teach them how to use that too? And that tells the story. It's really true. You can't just rely on the AI accuracy, especially accuracy metrics that don't feel useful to us as clinicians. You have to think about what does it feel like for the end user, how could you provide them information and even predict in advance whether or not they're going to be able to use it. So the kinds of things we look at, we don't just look at sensitivity or specificity. We look at things like how much more effective will the physician be if we add this AI system?

[Dr. Samantha Yamin]

AI is often framed as a way to democratize access. Bringing specialist level reads to rural or underserved hospitals help things where capacity might be most dire, maybe in under resourced areas where they have even more capacity areas. But does that play out when you think of the cost for some of the these technologies, the setup and expertise required, especially thinking about more remote areas where it might be harder to do these trainings for example.

[Dr. Nina Kotler]

Yeah. In general, as technology improves, in most industries, as technology improves, cost comes down. As costs come down, you could use it more and more places. And that that allows us to take, in this case, take care of more patients. There's some things that are a little bit different right now because we're so early on and there is a cost associated with these tools. There's no hospital that I know of and no radiology practice that is just like bringing in tons and tons of money that they have. All of this money that they could spend on new tools like that would be great, but that just doesn't exist today. In fact, I know a lot of radiology practices are going out of business because reimbursement is coming down and the cost of care is going up. So it's just a difficult environment to be in. So right now if you have to add on an additional payment, like how do you do that? There's some groups that are saying, well, we're just going to invest in that and believe that we could recoup that dollar somehow, that it's going to improve patient care enough that there'll be less costs in the future because patients won't have to come back, they'll get the right treatment. The first I Wish we could say that everything was just about the quality of care we're giving. But as hospitals are losing money year after year, they also have to think about the amount of dollars that they're putting into the system. So it's a balance. And unfortunately, the government is not paying for these tools. The government pays for a lot of our health care. There's very little payment for AI. So the question is, how do we make this right? Because ultimately we can't just pay endless amounts to expect improved outcomes. We have to be able to do improve outcomes without increasing the cost of care. And I think ultimately that means about making the cost of care just more effective. And that's where we're trying to move to. It's slower because it's really hard to get these, these technologies into care. And most of the technology that we have today is that hot dog, not hot dog, which really doesn't make a big difference. But as we start moving to the foundation models that everyone's using today, those are much more valuable and capable. And I think they'll enable us to prove that we could pay for these tools and they will bring about a return on investment. And I'm sorry that as a physician, it pains me to talk about return on investment when we're talking about healthcare, because what we care about is pain, patient care. But ultimately we need to balance both.

[Dr. Samantha Yamin]

Last thing I wanted to ask. AI can only be as good as the quality of data it's trained on. Are there any significant gaps in the training data at the moment, especially given how rare and uncommon you've mentioned a lot of diseases are?

[Dr. Nina Kotler]

Yes. So this is difference between these narrow AI systems. Hot dog, not hot dog. And the foundation models, like the ChatGPT that you're using today at home, the narrow AI models are trained to find one thing and they tend to be trained on less data. The benefit of a foundation model is you just give it a lot of data, give it a lot of data, and you're not actually circling where things are telling it. The way you're doing is you're training it by having it help self learn, learn some of these things on its own. In radiology, we give the images and we give the radiology report and then the AI learns on its own. But because we're giving way more data, these tools end up being more, what we call generalizable. They work on a larger patient population. But the state of the art today, which is narrow AI models, you're exactly right, they're trained on a smaller data set. So if you have a piece of data that looks a little bit different and it's out of distribution from the data it was trained on, it won't work as well. And we know that that is the case. I think that as we start moving over to foundation models, that's going to be less of a problem because they're trained on just so much more data.

[Dr. Samantha Yamin]

That's fascinating. Thank you, Nina, so much for being on our show and teaching us all about what we can expect in the hype, the warranted hype for AI in healthcare.

[Dr. Nina Kotler]

I am very excited where we're going into healthcare. It's one of the only times where technology can have a massive impact.

[Dr. Samantha Yamin]

That's Dr. Nina Kotler, a radiologist and chief medical AI officer for Mosaic Clinical Technologies. She's also an associate fellow and at the Stanford center for Artificial Intelligence in Medicine and Imaging.

[Advertisement Voice]

AI is transforming customer service. It's real and it works. And with fin, we've built the number one AI agent for customer service. We're seeing lots of cases where it's solving up to 90% of real queries for real businesses. This includes the real world complex stuff like issuing a refund or cancelling, canceling an order. And we also see it when FIN

[Dr. Nina Kotler]

goes up against competitors.

[Advertisement Voice]

It's top of all the performance benchmarks,

[Dr. Nina Kotler]

top of the G2 leaderboard.

[Advertisement Voice]

And if you're not happy, we'll refund you up to a million dollars, which I think says it all. Check it out for yourself at FIN AI, with no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking with Capital One. If he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends, it's pretty much all he talks about in a good way. What's in your wallet? Terms apply. See capitalone.com Bank Capital One NA Member FDIC hi, it's Mark Bittman from the podcast Food with Mark Bittman. It is getting warmer and it's time to go outside and start grilling. You can find quality meat, fresh organic produce, seasonal bakery treats. It's all there at Whole Foods Market. Ready to cook beef or chicken kebabs, corn, asparagus, great on the grill. And Whole Foods has Teton waters, ranch hot dogs and sausages made from grass fed beef. Shop for all of your summer favorites at Whole Foods Market. If you work in University maintenance. Grainger considers you an MVP because your playbook ensures your arena is always ready for tip off. And Grainger is your trusted partner, offering the products you need all in one place, from H Vac and plumbing supplies to lighting and more, and all delivered with plenty of time left on the clock so your team always gets the win. Call 1-800-GRAINGER visit grainger.com or just stop by Grainger for the ones who get it done.

[Dr. Samantha Yamin]

Be honest how easily are you influenced now? There may be a thing or two I've added to my shopping cart this past week after seeing them online, and I always check reviews before booking a hotel or choosing a restaurant the researchers at Dartmouth wanted to test just how much other people's opinions can sway us. They found that social cues can shift how we experience pain and how much mental effort we think something will take. Here's how they did it. 111 healthy adults completed three tasks. There was a task where heat was applied to their forearm and they'd have to rate how much it hurt, another task where they looked at videos of other people with painful grimaces. And the third task tested how much mental effort it took to rotate shapes in their head. Before each trial, participants saw a graph showing how 10 previous people had rated the upcoming task, but the data on the graph was fake. These were just random ratings not from other people and not actually related to the upcoming task. In this experiment, the graphs were the so called social cues. Participants saw these social cues, then gave their own ratings in all three tasks. The graph which served as the fake social cue could strongly shift both expectations and reported experiences. This persisted over multiple days of testing and 72 trials. There was this carryover effect where however they perceived one trial would directly bias the expectation of the very next trial. If the last one hurt, people expected the next one would too, regardless of what the social cue said. They also saw evidence for confirmation bias in the study. When an experience confirmed what the social cue had predicted, people readily adjusted how much pain or effort they anticipated feeling next time. But when reality contradicted the cue, the they largely ignored it and their next anticipation stayed anchored to what others had told them to feel rather than what they just actually felt. Some of the study participants were more influenced than others, but it was pretty consistent across domains experiencing the pain, witnessing someone else's pain, or having to do a task that requires mental effort. This research was published in the journal pnas. This confirms just how much social information can warp our perception in the moment and over time, others opinions can bias what we expect our expectations color what we actually feel, and what we feel feeds forward into what we expect next. The authors suggest this could help explain the placebo effect, the expected positive outcomes from a treatment understanding that could help set more practical treatment expectations in healthcare. But on a personal level, it's a pretty good reminder that just because someone else says something is hard or even painful, it doesn't mean your experience will be the same. Stay open to experiencing things differently for Warner Bros. Discovery Curiosity Weekly is produced by the team at Wheelhouse DNA. The senior producer and editorial correspondent is Teresa Carey, our producer is Chiara Noni, our audio engineer is Nick Karisimi, and head of Production for Wheelhouse DNA is Cassie Berman. And I'm Dr. Samantha Yuin. Thanks for listening.

[Advertisement Voice]

With no fees or minimums on checking accounts, it's no wonder the Capital One bank guy is so passionate about banking. With Capital One. If he were here, he wouldn't just tell you about no fees or minimums. He'd also talk about how most Capital One cafes are open seven days a week to assist with your banking needs. Yep, even on weekends, it's pretty much all he talks about in a good way. What's in your wallet? Terms apply see capitalone.com bank capital1na member FDIC

[Dr. Nina Kotler]

shipping billing admin, Payroll Marketing. You're managing all the things, so why waste time sending important documents the old fashioned way? Mail and ship when you want, how you want with stamps.com print postage on demand 24, 7 and schedule pickups from your office or home. Home save up to 90% with automated rate shopping. That's why over 1 million small businesses trust stamps.com go to stamps.com and use code podcast to try stamps.com risk free for 60 days.

[Advertisement Voice]

With almost half a million customers and over a trillion dollars of secure payments, Bill isn't new to intelligent finance. It's the proven way to simplify bill pay and maximize cash flow. Want to learn more? Visit bill.comproven for a special offer.

[Dr. Nina Kotler]

When you manage procurement for multiple facilities, every order matters. But when it's for a hospital system, they matter even more. Grainger gets it and knows there's no time for managing multiple suppliers and no room for shipping delays. That's why Grainger offers millions of products in fast, dependable delivery so you can keep your facility stocked, safe and running smoothly. Call 1-800-GRAINGER click granger.com or just stop by Granger for the ones who get it done.