Loading summary
Amy Goodman
From London and New York. This is Democracy Now.
Dan Lamoth
In short, we will win this race by becoming an AI first war fighting force across all domains, from the back offices of the Pentagon to the tactical edge on the front lines.
Amy Goodman
As the US Rapidly expands its use of artificial intelligence, we'll look at how AI is changing the way wars are fought. We'll speak with Heidi Klopp, who co authored the new report Anatomy of an AI Kill Chain. We'll also speak to Timnit Gebru, who co founded the group black in AI. She was fired from Google in 2020 for warning about Biase built into AI models. But first, we look at the growing controversy over President Trump's secret plane switch in Turkey. Did the move put the lives of the White House press corps in danger? President on the midterm you to fly on Air Force One, but not too dangerous for the press.
Dan Lamoth
The plane that I flew on was at greater risk.
Amy Goodman
I think it was. Say that this is two. We'll speak to the Washington Post reporter who broke the story. All that and more coming up. Welcome to Democracy now, democracynow.org, the War and Peace Report. I'm Amy Goodman broadcasting today from London. In Yemen, fighters with the Houthi movement have escalated their offensive against government forces with fear. Fierce clashes in the province of Taiz. The fighting's left dozens of Yemeni government troops dead in recent weeks. That's reportedly prompted Saudi Arabia to consider support for a Yemeni government counter offensive to retake the Houthi held Red Sea coast. The renewed fighting in Yemen comes as an unclassified Pentagon assessment of civilian casualties found. The US killed 153 civilians in Yemen last year, one while wounding another 243. Meanwhile, military families are demanding congressional action over a growing mental health crisis aboard the USS Abraham Lincoln after at least six incidents in which sailors attempted to jump overboard amidst an extended deployment. The Lincoln has been at sea for over 208 consecutive days, a modern day naval record while supporting US and Israeli attacks on Iran. And families say sailors have been forced to endure excruciatingly long shifts and shortages of food and basic supplies like toothpaste and soap. Meanwhile, former US Officials say the CIA had low confidence in an Israeli claim that Iran was plotting to assassinate President Trump last month as he returned to the US from the NATO summit in Turkey. Despite that finding, the Secret Service executed a covert deception deception operation that saw Trump smuggled off of Air Force One and onto a smaller military aircraft aboard a catering truck. The press corps was left on what the Secret Service thought was the targeted plane. After headlines, we'll speak with Dan Lamoth, the Washington Post journalist who broke the story. Firefighters in Lebanon are accusing the Israeli military of starting wildfires in the south of Lebanon. The Israeli military dropped flares in a wooded area Tuesday, and when firefighters came to extinguish the flames, a drone struck nearby, forcing them to withdraw, according to video and testimony from emergency services in Lebanon, the Israeli militaries caused fires in olive groves and on agricultural land since the ceasefire between Israel and Hezbollah back in June. In northern Gaza, an Israeli airstrike killed one person and wounded five others. Gaza Civil Defense said the strike targeted a Tuk Tuk transport vehicle. Meanwhile, MSF Doctors Without Borders is claiming Israel is blocking crucial supplies from entering Gaza. These supplies keep hospital generators, ambulances, water pumps and water trucks running, MSF's head of mission in Palestine said, quote, what we're witnessing in Gaza is not a series of isolated shortages. It's a policy of attrition by design. For more than two years, we've observed Israel's policies restricting the entry of supplies. These policies do not merely delay aid, they dismantle the very systems people rely on to survive. Unquote. Meanwhile, in the occupied west bank, dozens of settlers besieged three Palestinian families in Kusra, cutting off water, power and essential supplies for a fourth day. A top humanitarian official at the United Nations Security Council Tuesday said conditions in the occupied west bank have reached a breaking point. This is a Palestinian whose house has been besieged by settlers.
Timnit Gebru
The settlers established an outpost close to the house, around 6 meters away. Since that day, we've been subjected to daily attacks by the settlers, night and day and harassment on the road. They tried to cut off water and electricity networks. Many times we fix it and they cut it off again two days later and attack the workers who come do the maintenance.
Amy Goodman
Colombia has authorized joint military operations with the United States against armed Colombian groups following the inauguration of the far right Trump ally President Abelardo de la esprilla. On Wednesday, U.S. defense Secretary Pete Hegseth welcomed Colombia to the U.S. counternarcotics Coalition, known as the Americas Counter cartel coalition, or A3C. Hegseth warned the International Criminal Court could investigate U.S. attacks on alleged drug smuggling boats in the Caribbean, which human rights groups have condemned as extrajudicial killings and murder, and called on partners to reject the icc.
Dan Lamoth
That's why I strongly encourage every ACCC member to leave the ICC and reject their attempts to rob your governments and your courts of your sovereignty. I know as a soldier I swore an oath to the Constitution, not some fake and illegitimate international court.
Amy Goodman
Meanwhile, the New York Times reports fishermen with Ecuador say they're being attacked by English speaking assailants using drones. According to the un, one fishing boat has been lost at sea since January with eight people still missing and presumed dead. The survivors say the assailants wore matching uniforms with American flag patches. Some of the other fishermen say they've been dragged out of their boats, questioned and handed over to El Salvador Navy before being released. The U.S. coast Guard and the Pentagon have denied any involvement. To see Democracy Now's coverage of this score, go to democracynow.org the Trump administration's terminating federal funding for the Arctic Report Card, the flagship report on how the climate crisis is transforming Earth's northern latitudes. Noaa, the national oceanic and Atmospheric Administration, had issued the report annually for the past 20 years, documenting how human activity is causing the Arctic to warm faster than any other region. In response, former NOAA administrator Rick Spenard blasted the Trump administration for, quote, unquote, imposing ignorance on the system. Dartmouth College professor and polar researcher Melody Brown Birkins told the Washington Post, quote, it's like not allowing your primary care doctor to how you're doing. Taking away the checkup doesn't stop the changes from happening, she said. Supreme Court Justice Samuel Alito gained up to $2.9 million from his fossil fuel interests between 2005 and 2024. That's according to a review of financial disclosures from the nonprofit advocacy group Court Accountability. This comes as the Supreme Court's about to hear a case with two oil companies, Suncor Energy and Exxon. These companies want the court to rule that federal law prevents state governments from suing them over climate damage caused by their products. Activists are calling Justice Alito to recuse himself, citing his extensive investments in energy companies. They're also demanding an investigation by the Senate Judiciary Committee, President Trump announced Wednesday White House press secretary Carolyn Levitt will leave her post at the end of the month. Levitt was just 25 years old when Trump named her press secretary in November 2024, making her the youngest press secretary in US history. Trump said she's leaving the role to spend more time with her family after giving birth to her second child. The Intercept and the Freedom of the Press foundation filed a lawsuit Wednesday against President Trump and his staff, seeking to halt plans by Trump's media company to monetize the president's social media posts. Under the scheme, Trump's Truth social platform would charge up to $100,000 per month for early access to the president's posts, which frequently drives stock market volatility. In announcing the lawsuit, Ben Usig, editor in chief of the Intercept, said, quote, trump is trying to enrich himself by privatizing government information that he has no right to sell. We won't let it stand, he said. This comes as the Trump Media and Technology Corporation, which owns Truth social, announced a $238 million loss during the second quarter of this year. Meanwhile, the New York Times reports the number of monthly visitors to Truth Social was down about 36% from a year ago. Federal agents arrested the Southern Poverty Law Center's former chief financial officer, Heidi Beirich on Wednesday. Federal prosecutors charged her with conspiracy to commit wire fraud, conspiracy to submit false statements to a federally insured bank, in conspiracy to commit concealment money laundering. Back in April, the Justice Department had charged the SPLC over its now defunct program in which paid informants to infiltrate white supremacist groups in order to monitor their activities. By Rick's lawyer said in a statement, quote, a free and fair society does not use the justice system to silence its political opponents. Heidi Birich has dedicated her life to fighting hate groups and extremist movements like the kkk, Neo Nazis and other white supremacists. Her decades long record of success dismantling hate groups and the resulting threats to her life speak volumes. For this she has been indicted, her lawyer said. In North Carolina, the daughter of a pastor who was jailed by ICE Immigration and Customs Enforcement says her father suffered stroke like symptoms that left him partially paralyzed just weeks after his arrest. Gabrie Johnson says she's only been briefly able to speak with her 55 year old father, Gabriel Johnson, since he was taken to a Texas hospital July 30. In a now viral video, she said she's worried her father's condition continues to worsen due to medical neglect.
Heidi Klopp
This is not love. This is not care. This is not America.
Timnit Gebru
It's torture.
Heidi Klopp
And they're trying to not only take people out of their homes and break up families, they're trying to kill them on the way there.
Timnit Gebru
Please.
Heidi Klopp
If anybody is within the state of Texas or works in immigration law and reform, I will do anything. Just please help bring my father back home to Cary, North Carolina.
Amy Goodman
In more immigration news, an ICE agent film pushing an elderly activist to the ground near Chicago last year has pleaded guilty to a single misdemeanor battery charge. Adam Sirocco was sentenced Wednesday to 12 months of court supervision for the assault in December. He'd recently completed a shift and was off duty when he assaulted 68 year old attorney Robert Held in a gas station parking lot. Held had been recording video of Scirocco filling his gas tank. Meanwhile, a widely circulated video shows an ICE agent in Falls Church, Virginia pointing a gun at a driver who yelled at officers as they detained people on a scene sidewalk nearby. Video filmed by the driver shows masked ICE agents repeatedly accusing her of trying to run them over with her car and threatened to arrest her when she contradicted their claims and said dash camera video would vindicate her. The agents walked away. And those are some of the headlines. This is democracy now, democracynow.org, the war and Peace Report. I am Amy Goodman in London with Nermeen Shaikh in New York. Hi Nermeen.
Nermeen Shaikh
Hi Amy, and welcome to our listeners and viewers around the country and the world. We begin today's show looking at how an alleged Iranian threat to assassinate President Trump led to a secret operation last month that possibly endangered the lives of journalists and White House staffers. The Washington Post reported on Monday that President Trump secretly switched planes before departing a NATO summit in Turkey. Ahead of his departure From Ankara on July 8, President Trump announced on Truth Social that he would not be flying on the newly refurbished Boeing 7478 jet gifted by Qatar, but instead on the older Air Force One for old times sake, he said. That announcement led to revelations that the Qatari plane lacks some of the safety features of the legacy Air Force One leaks that angered the White House and led to subpoenas of New York Times reporters.
Amy Goodman
But the Post revealed Monday the president actually departed on a third plane. President Trump was seen boarding the old Air Force One, but then secretly left through another door and was shuttled in an airport catering truck along with several aides to a third plane. The press was asked to lower their shades before the operation, presumably so they would not see the president's exit. Senior officials who were left on the plane along with the staff and reporters included Secretary of State Marco Rubio, Treasury Secretary Scott Besant. The White House never revealed the secret operation. On Tuesday, President Trump was asked by reporters about the plane switch and the risk posed to the reporters on the decoy flight.
Dan Lamoth
Up to Secret Service, I just follow
Amy Goodman
what they'd like to do. So I go by Secret Service and the military. Why was president on the midterm you to fly on Air Force One but
Heidi Klopp
not too dangerous for the press.
Dan Lamoth
The plane that I flew on was at greater risk. I think it was the plane.
Heidi Klopp
I think that they would be more likely to go for it.
Nermeen Shaikh
White House Correspondence Association President Jackie Heinrich of Fox News met privately with senior White House officials Tuesday to convey concerns from the press corps. In an internal memo to members afterwards, she said, quote, I asked the White House to work with us on a protocol that recognizes the Secret Service's responsibility to respond to genuine threats while protecting press safety, preserving independent coverage of the president and providing a mechanism to correct the record after the fact when necessary.
Amy Goodman
For more, we're joined by the reporter who broke the story, national security writer for the Washington Post, Dan Lamoth. But his latest piece is headlined CIA had Low Confidence in Iranian Threat Before Trump Switched Planes in Turkey. In it, Lamoth reports the intelligence about the assassination threat against President Trump had come to the CIA from the Israeli government, but was not seen by the CIA as highly credible. Dan, before you talk about the president believing he was threatened and moving to a third plane, first the Cutter jet, then the old Air Force One, and then this military jet, before you talk about him leaving it and presumably leaving the press in the endangered plane, you now have this news story that the US CIA didn't even think Israeli intelligence because that was the source of the information about the assassination threat to Trump was viable.
Dan Lamoth
That's right. We reported last night, my colleagues, Warren Strobel, John Hudson and I combine on a story that kind of laid out how they came to the decision to make these extraordinary moves. In July, the Israelis passed a tip, a concern that the plane and potentially the president was under threat. The CIA had low confidence in it. And I think that kind of leaves the Secret Service in a tough spot of assessing what do you do in this zero fail mission to keep the president safe, but at the same time manage the additional pieces. They went with the more extreme option of removing the president and then keeping it secret after.
Nermeen Shaikh
So, Dan Lamont, if you could put this in also historical context. In other words, in the past, the Secret Service has used decoy motorcades and planes for presidents. Why is this incident different? On previous occasions, were the press corps and other senior senior officials also taken off the plane?
Dan Lamoth
The the most direct example we've seen is is probably President Clinton landing in Pakistan in 2000. The post had another piece earlier this week from Scott Nova where, you know, it was acknowledged and reported that at least the chief of the White House Correspondents association at the time had been brought in quietly. They kind of laid out what they needed to do or what they thought they needed to do. And in that case, the president followed in Air Force One on a second plane. But I think the most significant difference here is that in that case, moments after landing, President Clinton popped out of the other plane and it became very apparent what had happened. So, you know, within minutes it becomes clear, everybody knows there's a decoy. It was reported at the time, basically what happened and why, you know, and in this case, you've got, you know, it was handled very differently. I mean, a month worth of secrecy, presumably that would have continued had it not been for some news reporting.
Amy Goodman
During a few of thoughts on. I mean, here, the White House subpoenaed New York Times reporters. They were the ones who, who exposed the lack of whatever defense, enough defense on the Cuttery plane that was gifted to Trump. So all the attention in these last weeks has been on that. They were ultimately forced to drop those subpoenas. But maybe the White House was most concerned that it was this that would come out, that he left the jet, left the reporters on the jet and moved on to a third plane. And yes, Marco Rubio was apparently on that plane, as was Scott Besant. He was with his personal aides like Walt Nauta, who is indicted along with him a few years ago. Those though those indictments were dropped. Your thoughts?
Dan Lamoth
Yeah, I mean, I, when this tip came to me, I was struck by the extraordinary nature of it. Initially kind of looked at it as like, this seems kind of surreal and if we're going to report this out, we better be damn sure before we publish. So it took time to run this down, multiple conversations, multiple source interviews. And I thought really helpful here. You know, that initial story, we got our visual forensics team involved, we got our investigations team involved. We combed through airport tracker data, you know, and really I thought one of the remarkable things in that initial story and something that made it hard to deny was you had video in the airport that basically followed a lot of this right through. If you're looking at that catering truck as just another random day, it didn't stick out. But when you look through it through the lens of the other reporting, it looked pretty extraordinary.
Nermeen Shaikh
And Dan, finally on another topic, you've been reporting on impacts of the Iran conflict on munitions, military personnel, and on US Facilities in the region. Could you talk about some of that reporting and what you found?
Dan Lamoth
Yeah, I mean, really, this has been an enduring concern throughout this conflict that really grows by the day as the conflict kind of meanders on. The United States has a large number of munitions. Broadly, the problem here is they do not have enough of very specific and very important munitions. So over time, things like Tomahawk missiles, Patriot interceptor missiles, things that have really played a key role in this particular conflict and have also been important in the Ukraine conflict and would be important in any kind of conflict with China or some other adversary are dwindling and they cannot be built quickly. And this was a known thing going back not only through the Trump administration, but into the Biden administration as well. Some steps were taken to fix this, however, one, They haven't been able to really resolve that issue and really, they've just tried to downplay it.
Amy Goodman
Dan Lamoth, we want to thank you for being with us. National security writer at the Washington Post will link to your exclusive that exposed the secretary flight is headline contradicting public statements Trump took secret flight from Turkey amidst Iranian threat. His latest piece with other Washington Post reporters. CIA had low confidence in Iranian threat before Trump switched planes in Turkey. Coming up, as the US Rapidly expands its use of artificial and artificial intelligence, we'll look at how AI Is changing the way wars are fought. We'll speak to Heidi Cloth. She co authored the new report Anatomy of an AI Kill Chain. And then we'll talk about race and AI. Stay with us. Come see a shot and. Eclipse by Francois Gutte. Yes, I am here in London, and that's exactly what Londoners and people in so many countries in Europe experienced yesterday, a solar eclipse. This is democracy now, democracynow.org, the war and Peace Report. I'm Amy Goodman in London with Nermeen Shaikh in New York.
Nermeen Shaikh
We turn now to how artificial intelligence is transforming warfare from targeting software to autonomous drones. Earlier this year, Defense Secretary Pete Hexseth spoke at elon Musk's company, SpaceX.
Dan Lamoth
In short, we will win this race by becoming an AI first war fighting force across all domains, from the back offices of the Pentagon to the the tactical edge on the front lines.
Nermeen Shaikh
And this is CENTCOM Commander Admiral Brad Cooper talking about the US Military's use
Dan Lamoth
of AI Our warfighters are leveraging a variety of advanced AI tools. These systems help us sift through vast amounts of data in seconds so our leaders can cut through the noise and make smarter decisions faster than the enemy can react. Humans will always make final decisions on what to shoot and what not to shoot and when to shoot. But advanced AI Tools can turn processes that used to take hours and sometimes even days into seconds.
Amy Goodman
We're joined now by Heidi Klopp, the chief AI Scientist at the AI Now Institute. It's just released a joint report with Air wars titled Anatomy of an AI Kill Chain. Heidi, thanks so much for being with us. We want you to explain this report, but also to warn you to a global lay audience when you use terms like generative AI and artificial general intelligence. If you would explain your terms, but tell us about this anatomy of an AI kill chain.
Heidi Klopp
Yes, we actually wanted to break down and demystify a lot of these terms that we're now seeing being used. Like you mentioned, generative AI, large language models, and also more generally the use of AI generally in warfare and what that means. And I think it's important to remember, and what we're trying to convey in this report really is that AI has been used in the military and defense since the 1960s. And what we're, when we're talking about a new arms race, it means the inclusion of something like CHAT GPT, which is a type of AI that's known as a large language model, into now the decision making processes for targeting.
Nermeen Shaikh
Right.
Heidi Klopp
And the thing is that we want to break down is that it's not just one AI killer robot, which is often kind of the concept that people have of AI. What it is is a series of different types of AI algorithms that are chained together, each with their own pitfalls, each with their own flaws, each have very low reliability and accuracy. And these systems build off of each other and feed into one another with to unfortunately end up in, resulting in civilian casualties, as was often seen with their use. So we break down each step of the kill chain, how each AI algorithm leads to faulty decisions and ultimately can lead to decision making in targeting civilian casualties because of how faulty these algorithms are. We don't just focus on the new types of AI that we are seeing advertised. You know, as discussed, things like ChatGPT, large language model. We also talk about older types of AI that are continued to be used and continue to be relied on like vision systems.
Nermeen Shaikh
And if you could explain, Heidi, the difference between decision support systems and autonomous weapons systems. And on the question of large language models, you've warned that there have been operations from Russia and China that put out propaganda to try to skew the outputs of large language models. What does that mean?
Heidi Klopp
Really? The difference between a decision support systems and autonomous weapons systems is that there's a human in the loop. When you're selecting a target essentially to strike an autonomous weapon system means that this is done automatically without a human in the loop. I consider this separation between them to be pretty superficial in practice because ultimately if you have a human who is just rubber stamping the AI decisions, we know that they do this due to something called automation bias in our field, which is that we know that humans are prone to just accepting recommendations of AI algorithms without corroborating that evidence. To me, in practice, that means that you have a human who under the time pressures of war and conflict, is just approving decisions by an AI. And so typically this separation is often made to say, no, the AI is safe, it's fine even if it makes mistakes because you have a human correcting that. But in practice, we see a very, very different photo or a different picture really of how that occurs.
Nermeen Shaikh
You could explain ID the way in which AI systems were used, both by Israel in Gaza as well as in the U. S. Israeli war on Iran and in particular the attack on the school in Minab in the first days of the war.
Heidi Klopp
Yeah, I mean, we've known that large language models have been used since really the IDF started using them in Gaza. A good example of that is an AP investigation which demonstrated that they were using it to translate intercepted communications and they were taking essentially Arabic and determining whether or not specific people should be put on a target list. And we found essentially that because again, large language models are highly inaccurate and unreliable, that they mistranslate Arabic. In this case, they took something like a payment and thought it referred to a payload and added people to a targeting list. In this specific example, we know that this was caught, but again, under the time pressure, there's going to be oftentimes situations where human operators aren't going to double check that. Especially essentially that oftentimes it's very difficult to understand why a specific AI made the decision that it did. And now we know that it's been confirmed by the U.S. department of War that they are using Claude through Palantir's maven to similarly make targeting decisions. And we have now, unfortunately, the Minab School tragedy, which resulted in 160 civilian casualties, and it's becoming then unclear whether or not AI is used, that we know that Cloud is being used to sort of make these targeting recommendations, but ultimately it hasn't really been clear. Was it the AI, was it not? Was it deliberate? Was it not? And how do we really trace that when we don't really. When we can't really verify or validate whether something was an AI recommendation or not. Furthermore, we have a very difficult time with largely large language models because of their scale and nature of operation to be able to understand why an AI made the decision decision that it did. Was it due to faulty data? Was it directed to do so? Was it due to hallucinations which if anyone has used ChatGPT, knows that these chatbots often kind of fabricate information. And I think that's where we are with that current situation. It's still unclear to us what was the cause of that. And I would say actually that's kind of the purpose of AI system themselves. They are often used to launder accountability.
Amy Goodman
Heidi Klaff, Anthropic, earlier this year announced it'd be ditching its core safety promise. You previously worked at companies like OpenAI where you tried to help them create their first safety frameworks to understand how to evaluate their AI systems. And now OpenAI's head of ethics left after less than a year after joining. That was Chloe Bacalar. One of several high profile exits at OpenAI in recent weeks as concerns mounted. If you can talk about what these ethics frameworks are and why people are leaving one after another and why it is, it's the only the company that determines this, not government regulators, how AI is used.
Heidi Klopp
Well, I can't necessarily speak on why those specific individuals left, but I can speak from my own experience as a safety engineer because prior to joining OpenAI, I actually worked in nuclear, defense and aviation, ensuring that the systems implemented in those, what we call safety critical situations don't cause any harm. And ultimately what these companies are, they're reinventing safety, they're co opting a lot of the terms that we've used traditionally in safety and security engineering to really make this about kind of a different types of safety. Instead of being concerned, are our systems reliable, are they accurate, do they perform as intended, are they fit for purpose so that no human is harmed? And sort of due to the decisions that they or recommendations that they make, we instead have these like safety and ethics frameworks about whether or not these systems are autonomous, whether they have intention, whether they're conscious. Right. And that's a very, very different question. And often they can give the illusion that they are and sort of personifying a lot of the langu, you know, or the actions of these models themselves. I mean, we've seen recently, you know, these, the cybersecurity capabilities being conveyed as kind of like, oh, this is autonomous. This is something we have expected from these things. They're doing this on their own will. When these companies actually deployed them in a very insecure environment, they intentionally were having these models, you know, go on to sort of carry out cyber attacks as part of sort of testing or benchmarking. And so this, this is the reason that I take great issue with that is that they actually again, try to assign accountability to the AI rather than themselves, really. I view that AI only does what we tell it to do, is only capable of what we build it to do. And these AI companies are again moving away from accountability by trying to assign sort of autonomy or personify these AI themselves in doing that. And I think when you're then deploying these kind of models in warfare, it's very, very easy to then sort of say, well, it wasn't who made the decision, it was AI. And that's why I take great issue with the way they're now talking about safety and security engineering.
Nermeen Shaikh
And indeed, as you say, I mean, now it's very routine to hear about AI agents, so to speak, going rogue. And yesterday there was a report that Taiwan was hit by an especially abnormal AI assisted cyber attack suspected to be from China. And reportedly this kind of end to end autonomous attack on a government target has never been seen before. And the most remarkable fact about the target, as the Financial Times wrote, is that the AI continuously ranked and reprioritized possible attack plans based on available evidence. So if you could talk about whether you think in all of these cases or the ones that we know about, at least east, it is the makers of this AI who are responsible and not the agents that are going rogue. And what it would mean if these agents, artificial intelligence agents, move beyond cyber attacks and into actually theaters of war.
Heidi Klopp
Well, the thing is, we are seeing them being deployed in warfare already. And the thing about AI is that it is a very powerful token technology. They are very capable things, but they're only as capable as we make them. And they only really do the things that we make them do. And oftentimes we might not be precise in the way that we specify their tasks.
Nermeen Shaikh
Right?
Heidi Klopp
Like the cybersecurity task. They were assigned to go and carry out cybersecurity attacks. They were not doing this on their own will. They were built that way, they were trained that way. And I think that's very important to keep in mind. And in warfare it's the same situation. They are being basically given a lot of data to understand how to target, are being given profiles, often faulty ones, to determine who's an adversarial and who isn't. And ultimately, the thing is, these are based on really loose parameters, right? These are not the way that we build them isn't always accurate, isn't always reliable. And we know that AI really doesn't really understand anything beyond what it's trained on. So as soon as it sees a situation, especially in warfare, that it does not recognize, we know this is the exact situation that the AI will fail, make a recommendation that's not true or fabricate outputs.
Amy Goodman
Right.
Heidi Klopp
And so I think it's really important to keep in mind, yes, they are capable. Yes, they can do things like cybersecurity attacks and they do speed up operations. They definitely do. That's kind of one of their core features. But then if you have something that speeds up operations, but their kind of baseline accuracy and reliability is 30 to 60%. That's not really different from indiscriminate targeting.
Amy Goodman
Right.
Heidi Klopp
It doesn't also mean this is some sort of killer robot that has its own intention. Anything has been built by design and if we're reckless in the way that we build them, that doesn't mean it's an AI is at fault. It's. I think it definitely should. That accountability should always be with the system designers and the people choosing to deploy them despite knowing that they have these really poor reliability and accuracy rates, especially in new situations, which is actually more likely to happen in warfare than it is with sort of cybersecurity attacks.
Amy Goodman
Heidi Klopp, we want to thank you for being with us, chief AI scientist at the AI Now Institute. We will link to your report that you released jointly with Air wars titled Anatomy of an AI Kill Chain. Coming up, Timnit Gebru, the founder of the distributed Artificial Intelligence research fired from Google in 2020 for warning about biases built into AI models. Stay with us. O they wanted a blue bird baby
Timnit Gebru
so cheerful, so sweet all that was
Nermeen Shaikh
to her maybe not these girls feet we got that dark dark matter you'd be surprised we got that corvid chatter well organized.
Amy Goodman
Oh when I was just a small
Timnit Gebru
fledgling I thought I might fly I
Nermeen Shaikh
stood at the farthest edge and opened
Timnit Gebru
my eyes shore
Nermeen Shaikh
I give it my
Amy Goodman
best look down at the this dark matter by the corner laughers. This is democracy now. Democracynow.org I'm Amy Goodman in London with Nermeen Sheikh in New York.
Nermeen Shaikh
We're continuing to look at how artificial intelligence is rapidly changing the world. We're joined now by a leader in the field of AI ethics, Tim
Dan Lamoth
she
Nermeen Shaikh
is the founder and executive director of the Distributed Artificial Intelligence Research Institute or dare. Prior to that she served as co lead of the Ethical AI Research Team at Google. She was fired in 2020 for writing a paper warning about the dangers of large language models and raising issues of discrimination in the workplace. Timneet also co founded Black in AI, a non profit that works to increase the presence of presence, inclusion, visibility and health of Black people in the field of AI. Her forthcoming book is titled Deep Unlearning the Rise of AI and the Radicalization of a Tech Idealist. She joins us now from Boston, Massachusetts. Timneet, could you begin by explaining what AI means to you? You've said you think of AI as a discipline with a number of sub specialties. Explain.
Timnit Gebru
Yes, and I'm glad that Heidi did some groundwork for us here in the earlier segment. But yes, for me, AI is a discipline with a collection of specialties that are all lumped into this term AI, and they can be very different. So Heidi mentioned things like large language models, but also computer vision systems that have been around since the Vietnam War. And all of these things are bundled into the term AI. And in fact, the things that are considered AI are not always considered AI. So, for example, the title of my forthcoming book is Deep Unlearning. And this is a play on the term deep learning, which is a technique which is currently basically synonymous with AI. But back in the day, deep learning was not considered AI, so much so that the researchers in that specialty were having their academic papers rejected by the prestigious AI conferences. And so actually, deep learning was sort of a rebranding from another term, artificial neural networks, to avoid that stigma. So not only do we have this marketing term that is a hodgepodge of disparate techniques or tools, in fact, it's not even sometimes it's techniques, sometimes it's tools, sometimes it's products. But also not all of these things are always called AI. Right? When one of these subspecialties sort of is really hyped up or has some sort of better performance on a specific benchmark, it gets elevated to AI and then it gets sort of downgraded not to AI. And there are other such examples like expert Systems of the 80s. That was what was synonymous with AI in the 80s. And now nobody calls expert systems AI. So what happens here is that it makes it so difficult to have conversations that are grounded and specific and have specific conversations about what are the harms, what are the benefits, what approaches are good, what approaches are bad? Because when I talk about some things that I'm really against, like, you know, chatgpt kind of things, then people are like, what about a particular system that is used for early diagnosis of cancer patients? You know, And I have to say, well, that's a completely different system. It doesn't even have to be built in the same way that these big models are being built.
Amy Goodman
Tim Nit Gebru, can you talk about co founding Black and AI. But start off by talking about why you were fired From Google in 2020, the issues that you were raising there and the position you had there.
Timnit Gebru
So yeah, I co founded Black in AI way before I even joined Google. My current institute is called the Distributed AI Research Institute, which I founded after I was fired from Google. But I started Black and AI in around 2016, 2017 when I attended, you know, I started seeing simultaneously the lack of black people in AI. And so I would go to academic conferences and you'd have about five, 6,000 people in those conferences and only a couple of one or two, you know, a handful of black people. And at the same time we had some of these systems, some of the kinds of systems that Heidi was talking about. For instance, There was a ProPublica article from 2016 talking about a company purporting to determine someone's likelihood of committing a crime again. And so this company was saying that they built a software that can tell whether a person released from prison was likely to commit a crime again. And the ProPublica article was talking about how these systems were more likely even to label black people as criminals, potential criminals, than white people. And it was very scary because judges were already using the outputs of these models in their decisions about bail, decisions about how long someone should be in prison for. So the dichotomy of seeing the lack of black people in the field and also the kinds of claims that were being made and the kinds of things these tools were being built for was very scary. And so that's kind of how I decided to found blackinai. So by the time I started working at Google in 2018, I was a very known quantity. I had already founded and led Black in AI. I was working on uncovering all sorts of issues in the field. My collaborator Joy Buamini and I had written a paper that was pretty, made the rounds and was highlighted all over the place and even changed policy showing for the first time that automated facial analysis tools like face recognition for instance, tools were, had much higher error rates for darker skinned women than lighter skinned men. And the darker and darker the skin, and especially for women, the higher and higher the error rate. So think about these tools being used on CCTV cameras to identify so called criminals, et cetera. And the people who are of darker skin would be more likely to be wrongfully identified in this case. And so I had already worked on this kind of, these kinds of, uncovering these kinds of issues. And so I was hired at Google in 2020 to co lead a team called the Ethical AI Research Team, which was a small research team with Meg Mitchell, who was also later fired. And there were many issues. I mean, it was one issue after another. This was in the middle of the Google Walk where 20,000 women walked out because we found out that Google had paid Andy Rubin $91 million after allegations of sexual misconduct. And so it was a combination of a whole bunch of issues. And it was at the height of Black Lives Matter, the Black Lives matter movement in 2020. And at this time, a company called OpenAI that was getting very famous, but not as famous as it is today, came out with a large language model called GPT3, which later became the backbone of ChatGPT. But ChatGPT wasn't released yet, and GPT3 was really hyped up in the mainstream media. And OpenAI was making all sorts of claims about how powerful GPT3 was. In fact, actually, they had said that its predecessor, GPT2, was too dangerous to release because. Because it's so powerful. And so the GPT3 was a large language model. And we can just define what large language models are. They are models that are trained on vast amounts of textual data on the Internet, and they're trained to calculate the most likely sequences of text based on the training data. So if you use large language models to generate text, you are kind of trying to generate the most likely sequences of text given your training data. So the fact that OpenAI got so much airtime for GPT3 meant that all of these companies wanted to build similar models and they wanted to build larger and larger models, which means that they were guzzling all of the data on the Internet and they were consuming using huge amounts of computational power even then. And so we were very worried about this race that was started. Every company want to have the largest model and we were asking, why do we need the largest of anything? What problem are you trying to solve? And we warned about, we wrote a paper, my collaborators and I, warning about the dangers of large language models. And we said, how big can language models be? Too big. So the first issue that we mentioned, the very first one, was the environmental and financial cost. And you can see how, oh, six, seven, six years later, now that is not only true, but even worse than we said in the paper. We talked about how the carbon footprint of these huge data, the necessary computational power necessitates huge carbon footprint. And even if you claim to have data centers with renewable energy, that energy is going away from heating people's homes, for example, and to towards training these models and the financial cost that shuts out anybody who doesn't have the wealth to participate in this kind of work. We also warned about perpetuating hegemonic views. The claim was that because these models are large, which means that they are using huge data sets, then, oh, they have all of human knowledge in these data sets. But that's, that's not true. The Internet represents hegemonic views. It does not represent views of everybody in the world. A lot of people are not even on the Internet. We even know articles like Wikipedia are heavily biased. It's overwhelmingly western and male. And we also warned about, and this is very related to what Heidi was talking about earlier, we talked about how because large language models tend to outperform put fluent and coherent text, this can be very deceiving. So one example we gave was from 2017. And so these large language models, you know, they could be used, they used, they were used as systems in a whole bunch of other things like machine translation Systems. And in 2017, a Facebook translate translated Palestinians good morning into attack them and you know, attack them. There's no grammatical error or anything like that. So it doesn't even give you a cue that this translation might be incorrect. And this person was arrested and later released. And they didn't even check to see what the untranslated version was when they arrested him. And we call this automation bias, the tendency to over trust the outputs of automated systems. And so we warned about also people interacting with these kinds of, types of text output by these kinds of systems, attributing a mind behind whatever text they're seeing. And so right now, these chatbots like Claude or ChatGPT are designed to make you believe that there's some sort of superhuman brain behind whatever is outputting these texts. And that's hugely dangerous. And even though we weren't speaking about chatbots back then, we were already talking about the tendency and of people to attribute a mind behind these texts. And so which means that, you know, they can be deceived into believing that there's something, that something more than a model outputting text. And the final thing we warned about was what is the cost of pursuing this singular direction in terms of research and resources? What is the cost of shutting out all other possible futures, all other ways of building machine learning systems, which is a subspecialty of artificial intelligence or any other kind of paradigm? Because it seemed like the whole field was only investing in this singular direction of building larger and larger models that are guzzling all of the data. I mean stealing so many people's works and based on exploited labor and killing the environment. And so of course, I got fired after that. I mean, there's details, but that was the icing on the cake. It was writing that paper, paper.
Nermeen Shaikh
So timid. You know, we only have a couple of minutes left. But just to point out that, you know, the scale of which these bots are being used, very recently, CHAT crossed a billion active users a month. Google Gemini has said now that it has done the same. But I want you very quickly to talk about the work that you do at dare, in particular with people working in the these data centers and the conditions under which they work around the world, mostly in the Global South.
Timnit Gebru
Yeah, we have a project called a data workers inquiry project, and this one is working with data workers. And these are the people that label the data that is used in these models. And which is why we think that they're super intelligent. Right. These people have to painstakingly supply the data and label it. And they work in and overwhelmingly exploitative conditions. They are paid maybe $1 an hour. They don't have any breaks. I mean, and so we have this project that you can look at where they perform research into their conditions. They organize. We help them create an organization called the Data Labelers association in Kenya. And so for me, it's really important to make sure that the voices of the people who are, are negatively impacted are elevated and they're the ones telling their stories. And it also shows us that we don't have to do things. This doesn't have to be the way. The path we're on right now was never a preordained path that we had to be on. There were many other possible paths that we could have taken.
Amy Goodman
Tim Nit, I wanted to ask. You grew up in Addis Ababa in Ethiopia. Your dad was an electric engineer, your mom an economist. What led you coming as a refugee to the United States to get so deeply involved with the leading mind on AI right now. We just have a minute.
Timnit Gebru
Yeah, I mean, actually, my book kind of talks about that journey because I want people to understand that tech does not have to be the way it is right now. But I always loved math and physics, and I also thought it was a refuge from the messy world of war, which is what made me leave Ethiopian politics. But I later learned that that's not true. Actually, the war in politics that I left is what drives the world of math and science and technology as well. And if we don't understand that, we'll continue to harm our own people and as engineers and scientists build terrible and harmful products instead of ones that actually support our community.
Amy Goodman
Tim Nitya Bru, want to thank you so much for being with us. Founder and executive director of the Distributed Artificial Intelligence Research that's DARE Institute. We look forward to interviewing you on your forthcoming book titled Deep the Rise of AI and the Radicalization of a Tech Idealist. She also co founded Black and AI. She previously served as co lead of the Ethical AI research team at Google. Fired in 2020 for writing a paper warning about the dangers of large language models and raising issues of discrimination in the workplace. That does it for our show. Special thanks to our crew here in London. Julian Jones, Pablo Delbrasio, Grace Garrett, Dennis Moynihan, Hannah Elias and the whole team in New York. Be next week in Middlebury, Vermont and then we're on to Madison, Wisconsin and Chicago. I'm Amy Goodman in London with Nermeen Shaikh in New York.
This episode of Democracy Now! delves into the expanding role of artificial intelligence (AI) in modern warfare and the profound ethical, social, and human consequences of these technological advances. The show features investigative reporting on U.S. Presidential security measures, the humanitarian crisis in the Middle East, and exposés on the environmental and societal costs of AI proliferation. Notable guests include Washington Post reporter Dan Lamoth, chief AI scientist Heidi Klopp, and AI ethics leader Timnit Gebru.
[01:24–13:00]
[14:15–23:50]
"I asked the White House to work with us on a protocol that recognizes the Secret Service's responsibility to respond to genuine threats while protecting press safety, preserving independent coverage of the president..."
– Jackie Heinrich, White House Correspondents Association President [16:30]
[26:17–39:50]
Panelists:
"They intentionally were having these models, you know, go on to sort of carry out cyber attacks as part of sort of testing or benchmarking... they try to assign accountability to the AI rather than themselves." – Heidi Klopp [34:27]
"If you have something that speeds up operations, but their kind of baseline accuracy and reliability is 30 to 60%. That's not really different from indiscriminate targeting." – Heidi Klopp [39:21]
[41:32–57:59]
"Tech does not have to be the way it is right now... The war in politics that I left is what drives the world of math and science and technology as well. And if we don't understand that, we'll continue to harm our own people and... build terrible and harmful products." – Timnit Gebru [57:14]
This episode highlights the urgent need for independent scrutiny and regulation in both military operations and the AI industry. Through deep dives into government secrecy, global humanitarian crises, and the dangers embedded in ever-growing AI technologies, Democracy Now! underscores how technological advances cannot be separated from ethical, social, and political contexts—and why those most vulnerable must be at the center of any discussion or development.
Listeners are encouraged to read the joint report "Anatomy of an AI Kill Chain" and look for Timnit Gebru's forthcoming book, "Deep Unlearning: The Rise of AI and the Radicalization of a Tech Idealist."