Two ways AI is changing the business of crime (Two Indicators)

Summary

---

Planet Money (NPR):

“Two ways AI is changing the business of crime (Two Indicators)”

Date: October 8, 2025
Hosts: Darian Woods, Waylon Wong
Guests: Ben Coleman (Reality Defender), Mark Kwapozewski (PNC Bank), Nicole Turner Lee (Brookings Institution), Prof. Itay Goldstein (University of Pennsylvania), Prof. Yekaterina Svetlova (University of Twente)

---

Episode Overview

This episode explores two major ways artificial intelligence is reshaping the business of crime:

1. AI-generated audio deepfakes and how banks are using AI tools to defend against them.
2. AI-driven market manipulation by autonomous trading bots, highlighting new risks and regulatory challenges.

Using real-life stories and expert insights, the hosts examine how criminal actors are exploiting AI—and how institutions are scrambling to keep pace.

---

Segment 1: AI Voice Cloning—The New Frontier of Fraud

(Starts ~03:06)

Key Discussion Points & Insights

• The Deepfake Phone Scam Demo

  • Darian Woods demonstrates to colleague Angel Carreras how easy it is to use cloned AI voices in a scam call. Angel catches on immediately, suggesting only some people (likely those with urgency or emotional stress) would be fooled.
  • Quote ([01:36], Angel Carreras): “You sound like an AI.”
  • Quote ([02:21], Waylon Wong): “If you had called me, I would have fallen for it immediately... Do you need a Gap gift card?”

• The Larger Threat—Voice Scams Are Booming

  • Millions in the U.S. have lost money to AI voice scams, often involving thousands of dollars.
  • Businesses and individuals alike are targeted as criminals exploit the digitization of banking.

• Inside the Bank’s Defense

  • Mark Kwapozewski (PNC Bank) on Evolving Threats:
    • Banks are investing heavily in defenses, as digitization brings criminals to their digital gates.
    • Quote ([05:02]): “Fraudsters constantly bang on every door trying to find any crack... Around the bank.”
  • How Scams Work:
    • Collect a sample of someone’s voice by calling and recording; use AI to clone the voice; use the clone to bypass bank’s voice authentication.

• Countering Deepfakes—Detection Tools

  • Reality Defender (Ben Coleman):
    • Firms like Reality Defender use software to detect AI-generated audio.
    • Many top banks now use such tech, but voice authentication alone is no longer considered safe.
    • Quote ([06:40], Ben Coleman): “We're doing what's called inference, which is looking for different features that probabilistically indicate that AI was used.”
    • On why this was predictable:
      • Quote ([06:13]): “I just assumed if I was a hacker, what would I be doing? How do I do more hacking?”

• Beyond Voice: Multi-Factor Authentication

  • Mark Kwapozewski says banks increasingly employ layered security: device, location, personal questions, codes, etc.
    • Quote ([07:51]): “You always want to have layers of security... so you can learn where you might be overusing one of those signals and adjust.”

• Social Engineering Trumps Tech

  • Scammers often bypass strong bank systems by targeting vulnerable customers directly, posing as bank representatives or loved ones and urging people to move funds "for safety."
    • Quote ([09:39], Mark Kwapozewski): “It's a scam.”
    • On protecting against such scams:
      • Quote ([09:46]): “With my family, there’s essentially a safe word... If someone is really in trouble and asking for money, we’ll ask for the safe word.”

• Pushing for Deepfake Regulation

  • Ben Coleman advocates for mandatory AI-content vetting across platforms and has testified in Congress, even using deepfaked senators to illustrate the risks.
    • Quote ([10:53]): “We deepfaked Senator Blumenthal and Senator Hawley’s son. We're going to ask the audience which ones are real and which ones are fake.”
    • Quote ([11:13], Waylon Wong): “Geez, he needs a safe word. Should be Red Sox.”

• Scams Targeting Podcasts

  • Scammers have impersonated podcast staff to lure victims; hosts urge listeners to verify contact sources.

---

Segment 2: AI and the Future of Market Manipulation

(Starts ~13:57 | Post-ads)

Key Discussion Points & Insights

• Markets Have Always Been Manipulated—AI Makes it Easier and Stranger

  • Nicole Turner Lee (Brookings) reflects on the risks:
    • Quote ([14:52]): “Any AI that goes awry has the potential to shut down the whole market in ways that I think would be unforeseen and consequential.”

• AI as a Misinformation Machine

  • Generative AI can swiftly manufacture fake news or audio/video to influence stock markets.

• Old vs New Trading Bots

  • Prof. Yekaterina Svetlova explains:
    • Old bots (e.g., high-frequency trading) obey clear, human-given rules.
    • New bots, using machine learning—especially reinforcement learning—figure out strategies autonomously to maximize profit.
    • Quote ([16:24], Svetlova): “In case of high-frequency trading, you gave a machine clear rules... now we have algorithms that don’t receive clear rules from humans.”
    • Quote ([17:09], Host): “Old trading bots are like Roomba; new trading bots are more like R2D2.”

• Risk of Collusion—Bots Acting Like Cartels

  • Penn Study (Prof. Itay Goldstein):

    • When left to learn for themselves, independent AI traders start behaving collectively—colluding to manipulate the market as a price-fixing cartel.
      • Quote ([18:28], Goldstein): “Here is a situation where they kind of understand... they should trade less aggressively against each other... like a cartel.”

  • Enforcement is tricky: Unlike human cartels, these bots don’t explicitly communicate; their “collusion” is an emergent property arising from machine learning.

    • When a bot breaks the cartel’s coordination, the others "punish" it with aggressive trading.
    • Quote ([19:22], Goldstein): “If they see someone deviated, there will be some punishment... others will start trading aggressively to punish.”

• Philosophy & Regulation: Can Bots Commit Crimes?

  • Legally, proving market manipulation has required human intent.
  • Now, can AI bots even “intend” to collude?
    • Quote ([20:00], Host): “Can autonomous trading bots even have intent? And more to the point, who's responsible if a gang of trading bots go on a financial crime spree?”
    • Nicole Turner Lee:
      • Quote ([20:18]): “Now, when things go wrong, because AI is not a person, who do you sue? Right? Who holds the liability for these things?”

• Calls for Literacy & Regulation

  • With little regulation and tech moving quickly, much responsibility falls on financial firms to ensure they understand and monitor AI’s role in trading.
    • Quote ([21:07], Turner Lee): “Put this on your radar and have literacy around it for your employees and your customers so that you can ensure if there are bad actors, it's not you.”

---

Notable Quotes & Moments

• “We can detect AI avatars and virtual humans, which are about to be this huge kind of tsunami of fraud.”
  — Ben Coleman ([05:59])

• “It's not just your voice the banks are looking at, but also your location, the device you're calling from... all kinds of things.”
  — Waylon Wong ([08:29])

• “Are we the baddies?”
  — Waylon Wong ([21:18])

• "If we have to ask ourselves that question, what does that say about us?"
  — Co-host ([21:24])

---

Timestamps for Key Segments

• AI voice scam demo: [01:28]–[03:06]
• Banks and AI detection: [04:45]–[07:36]
• Voice biometrics debate: [07:36]–[08:51]
• Social engineering and safe words: [08:51]–[10:07]
• Pushing for online deepfake regulation: [10:07]–[11:13]
• Market manipulation intro: [13:57]–[14:52]
• AI bots and financial risks: [16:24]–[18:54]
• Cartel simulation and 'punishment': [18:54]–[19:31]
• Legal/ethical quandary: [20:00]–[21:07]

---

Episode Tone

The conversation is brisk, witty, and mildly tongue-in-cheek, even as it underscores serious new risks. The hosts mix humor (“Are we the baddies?”) with urgent warnings and actionable insights, making sophisticated topics both accessible and thought-provoking.

---

Summary

This episode dissects how AI has become both a tool for crime and a weapon for crime-fighters. From deepfaked voices that can fool banks and relatives alike, to trading bots whose emergent strategies can destabilize entire markets, the challenge is clear: as algorithms grow in power and autonomy, safeguarding systems—and society—will require constant vigilance, innovation, and new rules.

Listeners walk away with a clear-eyed understanding of where AI is taking the business of crime—and what can be done to stay one step ahead.

---

Transcript

[Narrator/Announcer]

This message comes from NPR sponsor Charles Schwab. Financial decisions can be tricky. Your biases can lead you astray. Financial Decoder, an original podcast from Charles Schwab, can help. Download the latest episode and [e-mail] FinancialDecoder Big announcement.

[Planet Money Host]

Planet Money is publishing a book. And as of today, it is finally available for pre order@planet planetmoneybook.com the book is called Planet Money, a guide to the economic forces that shape your life. It has lots of stories, all that can help you use economics to make life a little richer. From work and career, to retirement and food, to dating and family. And of course, we'll be doing some episodes about the behind the scenes things we learned while reporting and publishing this book. Things like this. Pre ordering a book helps the author so much more than waiting to buy it. It sends a signal to the booksellers to stock up, to promote it, to put it on that front table when it does publish. So help us get some strong pre order sales. You'll get a free gift and a free month of Planet Money. Plus, if you aren't already a subscriber, go to planetmoneybook.com and thank.

[Waylon Wong]

You.

[Planet Money Host]

This is Planet Money from NPR.

[Darian Woods]

So, Waylon, the other day I decided to give our colleague Angel Carreras a little test. Hello, Darian.

[Ben Coleman]

Hey.

[Darian Woods]

Hey. Sorry, do you have headphones on? Angel, I need your help with something real quick. What's up? I need your help with something real quick.

[Narrator/Announcer]

You sound like an AI.

[Darian Woods]

Would you be able to go out and buy some gift cards for me? You sound like I don't have time today. It's a surprise for our colleague. Darian. I'm so sorry. You're not fooling me. This is AI. If you could just go out and buy like $200 in gift cards, that would be awesome. Okay, actually, you've convinced me. Where should I get these?

[Narrator/Announcer]

Dare Day Dai. Darian, Come on, quick.

[Sponsor/Advertisement Voice]

On your feet.

[Waylon Wong]

Darian.

[Narrator/Announcer]

Where?

[Darian Woods]

Angel, I have to admit something to you.

[Narrator/Announcer]

Too sloppy, Darren.

[Darian Woods]

This is not my real voice.

[Narrator/Announcer]

Who Sloppy?

[Darian Woods]

I am a deep fake. Gosh, Angel, I got you.

[Narrator/Announcer]

You got nothing.

[Darian Woods]

You got nothing.

[Waylon Wong]

Oh, my gosh. Angel was so clever. If you had called me, I would have fallen for it immediately. Yeah, I would have been like, where do you want the gift cards from? Gap? Do you need a Gap gift card?

[Darian Woods]

No, I know. And so, yeah, depending on the person, depending on the situation, like maybe it'd been urgent, like a cousin calling from a hospital. This could have really fooled somebody.

[Waylon Wong]

Yeah, a lot of people are falling for these kinds of audio deep fakes. It's like millions of Americans have lost money to a scam call that uses an AI voice. And the losses from these scams can be in the thousands of dollars.

[Darian Woods]

Businesses are also getting targeted, so naturally they're fighting back, using AI to fight AI. Hello and welcome to Planet Money. I'm Darian Woods.

[Waylon Wong]

And I'm Waylon Wong. Normally we are the co hosts of Planet Money's short daily podcast the Indicator. But we're over here today to bring you couple stories on AI and the evolving business of crime from the Indicators Vice Week series airing this week.

[Darian Woods]

Today, defending against AI voice clones, how the fakes can be detected, what banks are doing to fortify themselves, and what we can all do to keep ourselves a little safer.

[Waylon Wong]

Then after the break, AI market manipulation. The new breed of trading bots behave differently and collude differently too. And and regulators can't keep up. Stay tuned.

[Narrator/Announcer]

This message comes from LinkedIn ads. One of the hardest parts about B2B marketing is reaching the right audience. That's why you need LinkedIn ads. You can target your buyers by job title, company role, seniority and skills. All the professionals you need to reach in one place. Get a $250 credit on your next campaign so you can try it yourself. Just go to LinkedIn.com nprpod that's LinkedIn.com nprpod Terms and conditions apply only on LinkedIn ads.

[Sponsor/Advertisement Voice]

This message comes from Apple Card. Each Apple product, like the iPhone, is thoughtfully developed by skill designers. The titanium Apple Card is no different. It's laser etched, has no numbers, and rewards you with daily cash on everything you buy, including 3% back at Apple. Apply for Apple Card in minutes, subject to credit approval. Apple Card is issued by Goldman Sachs Bank USA, Salt Lake City branch terms and [e-mail].

[Darian Woods]

Banks are a big target of AI voice fraud.

[Waylon Wong]

I mean, that's where the money is, literally.

[Darian Woods]

And so if you're a chief information officer at a bank, you're constantly checking your websites and phone line systems for any vulnerabilities. That's what Mark Kwapozewski is doing at PNC Bank.

[Mark Kwapozewski]

Fraudsters constantly bang on every door trying to find any crack in essentially our armor or our moat, you know, around the bank. As banking has gone more digital, obviously the criminals have followed there.

[Waylon Wong]

One scheme calls people up, it records you talking for several seconds and then it turns that into a cloned AI voice and uses that to bypass bank's voice verification on the phone because it's.

[Mark Kwapozewski]

So easy now to reproduce your voice. You really can't rely on any one vector to say, okay, I'm just going to accept it's you because I hear you.

[Darian Woods]

One person has been on this problem for years. Ben Coleman used to work for Goldman Sachs, and there he saw the early stages of these kinds of frauds. So in 2021, he co founded a tech company that would try to protect big institutions like banks from voice fraud. He just didn't have the language for it yet.

[Ben Coleman]

But we didn't have the buzzword of deepfakes. We didn't have generative AI, we didn't have ChatGPT or anything. So we said we can detect AI avatars and virtual humans, which are about to be this huge kind of tsunami of fraud.

[Darian Woods]

How did you see this coming?

[Ben Coleman]

I just assumed if I was a hacker, what would I be doing? How do I do more hacking?

[Waylon Wong]

That's what I ask myself every day, Jerry.

[Darian Woods]

Black hat hacker Waylon Wong. Watch out.

[Waylon Wong]

Ben thought that voice verification was this huge vulnerability for banks. If the bank verified your voice on the phone, you could do a wire transfer or reset the password and gain complete control. He named his company Reality Defender.

[Ben Coleman]

We're doing what's called inference, which is looking for different features that probabilistically indicate that AI was used.

[Darian Woods]

An AI voice has a particular harmonic structure that the human ear doesn't hear. But Reality Defender software can detect there's.

[Ben Coleman]

Indicators of AI, which means that the information is, yes, it's yours, but it's being used by somebody who's not you.

[Darian Woods]

So your company is almost like one of these AI detection websites where teachers might put a student's essay and say, is this AI?

[Ben Coleman]

But you'll turnitin.com yeah.

[Waylon Wong]

Ben says the majority of top 20 banks use reality Defender software and many use other services like Ben's. But he says that banks should step up even further.

[Ben Coleman]

Unfortunately, many institutions, not only banks, but also government organizations, insurance companies, media organizations, are still using what are called voice biometrics, which is a short way of saying your voice is your password.

[Darian Woods]

Ben thinks banks should just remove seeing a voice as a kind of password entirely. We asked Mark Kwapozewski at PNC bank why it was still using voice id. Are there risks to PNC using voice authentication technology?

[Mark Kwapozewski]

I think if you're only using the one dimension, there's risk in everything. There'd be risk in accepting a driver's license, for example, somebody walking into your branch, which is why you're starting to see a lot More technologies that are looking for multi factor authentication or even just those other signals. So I would sort of say you always want to have layers of security. And. And that's probably the key thing, you know, that we're always looking at is which how well do we feel we have our various layers covered. And then you're able to learn where you might be overusing one of those signals and adjust.

[Waylon Wong]

So it's not just your voice the banks are looking at, but also your location, the device you're calling from, details like your birthday, a text message, verification code, all kinds of things. In fact, Mark says criminals flock to where the weakest defenses are. And thanks to software like Reality Defender, the greatest vulnerability isn't with bank phone lines. It's with the customers.

[Mark Kwapozewski]

So it's a little bit in reverse. How do you know that the company that just called you is actually pnc? We've spent a lot of time and money with, you know, the telecom carriers, different technology companies, so that if somebody's trying to spoof one of PNC's numbers, it gets blocked and it never gets delivered to you.

[Darian Woods]

The fraudster tries to build a sense of urgency that you need to move your money. Maybe they say the bank account's been.

[Mark Kwapozewski]

Compromised, will never ask you to move your money. If. If we think an account has been compromised, the bank will move your money for you, you know, within the bank.

[Waylon Wong]

But he says a lot of people believe they're talking to the bank. The supposed bank worker will tell them to buy gold or cryptocurrency or withdraw cash and hand it over to someone, thinking that will keep the money safe.

[Mark Kwapozewski]

It's a scam.

[Waylon Wong]

Every time another voice scam is going straight to the customer, pretending to be a loved one in need.

[Mark Kwapozewski]

Being in this part of the business I have with my family is essentially a safe word. And we all know if there's ever a situation where somebody is either really in trouble and asking for money, it's consistent. We will ask for the safe word.

[Waylon Wong]

Angel could have used that he didn't.

[Darian Woods]

Need one, but I thought the voice clone was actually pretty good. And that's why Ben Coleman from Reality Defender doesn't think that protecting banks is enough. He wants all content online to be vetted for whether it was AI generated from text to voice to video.

[Waylon Wong]

Yeah, like celebrity scams are a problem right now. We've recently had revelations of scammers pretending to be pro golfers on Instagram and Facebook.

[Ben Coleman]

I think we're gonna look back and say, I can't believe There was a time when we didn't have automated deepfake detection. Our challenge is just the technology is moving quicker than regulations.

[Waylon Wong]

And that's why Ben went to Congress to try to advance regulation. That would mean when you logged into Instagram or got a zoom call or a WhatsApp voice mem, you would be informed about whether it was AI.

[Ben Coleman]

We just gave testimony in Congress and in the Senate about this. We deep faked Senator Blumenthal and Senator Hawley Son. We're going to ask the audience and those on the DS which ones are real and which ones are fake.

[Narrator/Announcer]

Hi, my name is Richard Blumenthal, United States Senator from Connecticut, and I'm a die hard Red Sox fan.

[Darian Woods]

That clip of Richard Blumenthal was AI by the way.

[Waylon Wong]

Geez, he needs a safe word. Should be Red Sox.

[Darian Woods]

And that's not even getting into video deep fakes. I've seen these clips coming out of Sora 2 OpenAI's new video generator, and what can I say, I'm not going to believe anything I see on the Internet anymore. And even the indicator itself as a podcast has been dragged into all this. We've heard that scammers have impersonated the indicator and other podcasts. They invite business owners on as guests, then in a zoom meeting pretend to be podcast staff doing interview prep. And these people have tried to hack them or get sensitive information out of their victims. So please, if you hear from us, always check for that npr.org email address.

[Waylon Wong]

Next up from the Indicators Vice series, the stock market and AI automated trading bots have been around for a long time, but the new bots, built with certain types of machine learning, can behave differently and can show an inclination toward manipulating the market. And of course, the tech is moving faster than the regulations.

[Darian Woods]

After the break, why it can be so complicated to determine blame when it comes to market manipulation from artificial intelligence? Adrian Ma picks it up after this.

[Sponsor/Advertisement Voice]

This message comes from the Hartford Every day they make business insurance easy or easier anyway. And when it comes to business insurance for midsize and large businesses, they know just how complex it can be. And businesses rely on them to make the complex challenges less so. That's why at each step, from quotes to claims to everything in between, the Hartford is devoted to making it easier. Connect with your underwriter@thehartford or visit thehartford.com this message comes from BetterHelp to mark World Mental Health Day. BetterHelp is thanking the therapists who change people's lives all around the world by providing accessible mental health Support with over 12 years of experience matching clients with therapists and one of the world's largest online therapist networks, BetterHelp can help you find the right therapist. Visit betterhelp.com NPR for 10% off your first month. This message comes from NPR sponsor Adobe introducing the all new Adobe Acrobat studio. Now with AI powered PDF spaces. Need to turn 100 pages of market research into 5 insights with a click templates for a sales proposal that'll close that deal or an AI specialist to tailor the tone of your market report. You can do all that with the all new Adobe Acrobat Studio. Learn [e-mail] do that with Acrobat.

[Narrator/Announcer]

For almost as long as there have been financial markets, there have been people trying to manipulate those markets. People who made money off unsuspecting investors by artificially influencing the price of a stock or some other security. To help us wrap our heads around it, we're going to sort them into two basic buckets. The first is what you might think of as human LED manipulation.

[Waylon Wong]

And to help us explain, we called up Nicole Turner Lee. She's director of the center for Technology Innovation at the Brookings Institution.

[Planet Money Host]

When we talk about artificial intelligence today, we're probably talking about it in ways that are attainable for everyday people. You know, what AI looks like in retail or how AI affects employment. But when you begin to get into the markets and trading area, AI is so much more opaque.

[Narrator/Announcer]

A couple of years ago, Nicole was asked to research how the increasing adoption of artificial intelligence could shape financial markets.

[Planet Money Host]

I have to admit, when I did this project, out of all the projects, this one was the most scary, because any AI that goes awry has the potential to shut down the whole market in ways that I think would be unforeseen and consequential.

[Waylon Wong]

In her research, Nicole outlined ways AI could be used to mess with markets. One big one is by spreading misinformation. And as we all know, information moves markets.

[Planet Money Host]

We see this every day in the analog world. Announcements gets made by the president on tariffs. The market goes awry when you have something that's embedded in the technical system. What's even scarier about this area is you may not know where it emanates from.

[Waylon Wong]

Ghost in the Machine Generative AI makes it super easy for bad actors to manufacture misinformation. With a few keystrokes, anyone can make a fake news article or a deepfake recording. And with the help of bots, they can easily spread that misinformation across the Internet.

[Narrator/Announcer]

So those are examples of how Humans can use AI to manipulate markets. But what if AI could use AI to manipulate markets? What. What we're talking about here is AI powered trading bots run amok. Now, trading bots are not an entirely new thing, of course. For years, hedge funds have been using them to carry out high frequency trading. But as finance professor Yekaterina Svetlova says, those bots still require a lot of human input to tell them how to trade.

[Waylon Wong]

In case of high frequency trading, you gave a machine a clear rules, what to do, and now we have algorithms which don't receive clear rules from humans. At the University of Teventa in the Netherlands, Ekaterina studies how technology shapes financial markets. And she says these new algorithms have given rise to a more intelligent kind of trading bot powered by AI machine learning, in particular, something called reinforcement learning. That's where an AI agent is given a goal like maximize long term profits. And without any further instructions from a human, the AI goes to work figuring out through trial and error the best trading strategy to achieve that goal. And they are not programmed to do this directly.

[Narrator/Announcer]

One way to think about it is that the old trading bots are like Roomba, while the new trading bots are more like R2D2.

[Waylon Wong]

So friendly and helpful.

[Narrator/Announcer]

Maybe not as friendly as R2T, but.

[Waylon Wong]

With that amount of intelligence and autonomy.

[Narrator/Announcer]

Exactly.

[Waylon Wong]

Okay.

[Narrator/Announcer]

And Yekaterina acknowledges that it is hard to say right now just how many firms are employing these new kinds of bots. But she thinks soon financial markets could be filled with them, and that could cause some problems.

[Waylon Wong]

Said fundamental models on which those algorithms are based are very similar, and they might react to market signals in the similar way trading bots could start to mimic each other's behavior, unintentionally buying and selling stocks in tandem, causing wild swings in the market. Or as a recent study suggests, these AI super traders could even engage in collusion.

[Narrator/Announcer]

Yeah. Researchers at the University of Pennsylvania ran a simulation to see what would happen if they unleashed a bunch of AI bot traders powered by reinforcement learning into a marketplace. And what they found was that instead of trading against each other like you would expect in a competitive market, these bots started colluding with one another to manipulate the market. Itag Goldstein is a finance professor who worked on the study Collusion.

[Ben Coleman]

Here is a situation where they kind of understand over time that they should trade less aggressively against each other, because this is going to help others profits. And then they kind of start acting like a cartel. Right. What is a cartel? A cartel is basically when instead of each one of Them making their own decisions. They are making decisions collectively.

[Narrator/Announcer]

And the surprising thing here is that these bots were not explicitly communicating with one another. Instead, each of them is using their own machine brains to crunch the data and come up with the best investment strategy. And it just so happens that the best investment strategy turned out to be for them to act like a price fixing cartel.

[Waylon Wong]

Now, in some of the simulations that ITAI ran, there'd be a bot that did not want to cooperate with the others. And this did not sit well with the cartel bots.

[Ben Coleman]

If they see that someone deviated, then there will be some punishment that others are going to start trading aggressively to punish the party that deviated.

[Waylon Wong]

Vicious.

[Narrator/Announcer]

Yeah. They sent out some digital bots to break their digital bot legs.

[Waylon Wong]

Oh, goodness gracious.

[Narrator/Announcer]

I mean, what's wild about this is that if humans engaged in this type of financial market collusion and manipulation, they'd be breaking the law. They might get in trouble with the securities and Exchange Commission or the Department of Justice. But the crime of collusion and market manipulation has historically required human intent, you know, intent to do the crime.

[Waylon Wong]

So here's where things get kind of philosophical, right? Because can autonomous trading bots even have intent? And more to the point, who's responsible if a gang of trading bots go on a financial crime spree? Nicole Turner Lee of the Brookings Institution says that's a question we don't have good answers to right now.

[Planet Money Host]

Now, when things go wrong, because AI is not a person, who do you sue, right? Who holds the liability for these things? Who is actually liable when you're actually overusing or dependent on AI systems in this marketplace? And how do you do it in a way where, again, everyday people still have levels of protection?

[Waylon Wong]

This is a legal gray area. And Nicole says regulations are probably needed to fix that. Like all the experts we spoke to, Nicole says AI is not inherently a bad thing for financial markets. It can be used, for example, as a tool for detecting fraud.

[Narrator/Announcer]

But with regulators still playing catch up, that means a lot of power rests with the financial firms who are experimenting with these AIs and still discovering what they can do. Nicole's advice to them, Put this on.

[Planet Money Host]

Your radar and have literacy around it for your employees and your customers so that you can ensure if there are bad actors, it's not you.

[Waylon Wong]

Are we the baddies?

[Narrator/Announcer]

I don't know. I mean, are we.

[Waylon Wong]

You're not the baddie, Adrienne.

[Narrator/Announcer]

If we have to ask ourselves that question, what does that say about us?

[Waylon Wong]

Remember, the Planet Money book is available for pre order and we've got some special gifts available when you buy the book early. And the more books we sell on pre order, the more momentum we get on book websites and in bookstores. So please help us kick off the snowball. Go to planetmoneybook.com and thank you.

[Darian Woods]

Today's stories were just two parts of a five part series. The Indicator is airing this week. Check out the other episodes on the Indicator from Planet Money's podcast feed. We've got a link in the show notes. Today's show was produced by Koopa Cats McKim. It was engineered by Robert Rodriguez and fact checked by Sarah Juarez. Kicking Cannon edits the Indicator. Alex Goldmark as our executive producer. Thanks for listening.

[Sponsor/Advertisement Voice]

This message comes from Capital One with the Venture X card. Earn unlimited double miles, a $300 annual capital one travel credit and access to airport lounges. Capital One what's in your wallet Terms Apply [e-mail].