
Loading summary
Justin Sherman
Only Boost Mobile Boost Mobile will give you a free year of service. Free year when you buy a new 5G phone. New 5G phone enough, but I'm your hype man. When you purchase an eligible device, you get $25 off every month for 12 months with credits totaling one year of free service. Taxes extra for the device and service plan online only.
Boland Branch Advertiser
Imagine a world of extraordinary comfort where bowline branch bedding wraps you in the softest. Embrace the coziest experience made from the world's finest 100% organic cotton, all so you can sleep better. So start building your fall sanctuary with Bolen Branch's iconic signature sheets made with a buttery, breathable weave that gets softer with every wash. Enjoy 15% off your first set of sheets with free shipping and returns at B O L L and Branch.com with code buttery. See site for details and exclusions.
Gavin Wild
The line between evidence and expression, between depiction and detection, or capturing and manipulating an event onto film or tape has always been very blurry. It's always required some secondary or tertiary bits of context and information to make sense.
Justin Sherman
It's the Lawfare Podcast. I'm Justin Sherman, Contributing Editor at Lawfare and CEO of Global Cyber Strategies, with Gavin Wild, non resident Fellow at the Carnegie Endowment for International Peace and author of the recent paper Pyrite or Panic.
Gavin Wild
About deepfakes In a real way, we shouldn't conflate deepfakes ability to attract attention necessarily with their ability to displace the way that we formulate knowledge, both personally or as a group.
Justin Sherman
Today we're talking about deepfake worries, historical parallels with audiovisual media, and a less tech centric response. You've been doing a lot of interesting research for some time now on a range of technology and information and geopolitics and other topics. So undoubtedly many listeners they've heard you on the podcast before, they're familiar with your work. But why don't you just tell us a little bit more both about your background as well as the variety of different research topics you're working on right now.
Gavin Wild
So the bulk of my career has been spent as a Russia watcher in the US Intelligence community, particularly attempting to understand and explain to US and Western officials how Moscow conceptualizes the information space, how Russian leaders tend to perceive threats and opportunities in arenas like cyber conflict or propaganda or surveillance, and what drives their strategic culture in those areas. And since I pivoted to the think tank and academic world a few years ago, I've kind of drawn upon that experience to try to understand our own philosophies here in the United States, how and why we think the way we do about information and communication and technology and what that means for how we fight wars and craft our own foreign and security policies. So if there's a common thread that probably runs through most of my research, it's that sometimes our own process of securitizing or even overhyping issues like cyber warfare or disinformation or artificial intelligence entails its own risks and opportunity costs.
Justin Sherman
We're going to talk just in a minute about that very theme today. We're going to cover deep fakes or fake, but realistic audio, video or images that are produced by deep learning or AI technologies. That's not a NIST definition or something. Perhaps you have a different definition, Gavin. But just to say at a general level what they are, we've worried more about this, right, in recent years, policymakers, media, the public, for a variety of reasons. Right. Some of this is, to my knowledge, this is still the case. And based on lots of the data, an unfortunately overwhelming use of deepfakes today is to create non consensual, intimate imagery, predominantly of women. There is also a lot of concern in DC circles and elsewhere, kind of to your point, about worrying about things, securitizing things about politics, about elections, about national security, weaponization. So we're going to get into all of that today. And to do that, I want to start with. We're going to go broader than this one piece, but in part I want to start with an excellent paper that you recently wrote titled Pyrite or deepfakes, Knowledge and the Institutional Backstop. It's a great way to kick off our conversation here. I'm, as I joke, always terrible at titles. This is quite a good title here. So tell us about this title. What does it mean? What is the paper about and what motivated you to write it?
Gavin Wild
Yeah, so let me kind of address those in reverse order. I originally approached this paper as a follow up to a previous piece I did for the Texas National Security Review that looked at the risks of overhyping the threat of foreign propaganda online. And so this was intended to be a bit of a sequel. And similar to that issue, we've seen a deluge of very alarmist commentary from think tanks and academics and commentators in the past few years, a lot of which pivots on this theme that the advent of deep fakes potentially signals this looming collapse in trust in audiovisual media altogether, or a major erosion in our ability to collectively make sense or produce knowledge. And ultimately our ability to do those things. And so, for instance, we had some great papers by legal scholars Robert Chesney and Danielle Citrone about the the so called liar's dividend, which is this idea that as hard as it is to prove something is true, deepfakes are going to enable bad actors to flip the script and in essence ask us to prove that it's not fake. Or philosopher Regina Renney had a great paper talking about the erosion of trust in the evidentiary quality of media to serve as what she calls a backstop for human perception, which is often flawed by comparison. These papers were both fascinating and compelling to me. I wanted to undertake an effort to either confirm or refute or add to this body of work less from the standpoint of the machine learning technology itself, but from media studies and sociology and historical experience. The key questions I came at it with were what is the nature of our interaction with audiovisual media? How much do we rely, or perhaps even over rely on media to serve as a backstop for our search for knowledge? And more broadly, are these kinds of speculative futures about so called artificial intelligence obscuring or distracting from more salient present day harms? In terms of the title, I like to use a good analogy that can cut through a lot of complexity and jargon and and in this case I found that pyrite served that purpose fairly well. And so for those who are not mineral nerds, pyrite is just the formal name for the mineral that most of us know as fool's gold. So just like deep fakes, fool's gold is often pretty identical to the real thing. And you could be forgiven for assuming that the discovery and the relative abundance of the mineral pyrite compared to that of real gold might have been catastrophic for early prospectors and a bonanza for counterfeiters. But historically speaking, that wasn't really the case. The value of real gold remained pretty stable despite the discovery of pyrite, and your odds of striking gold didn't actually change over time. What happened was the existence of fool's gold and the broader awareness of that existence simply placed a greater premium and emphasis on the processes and methods of discovering and validating the real thing. And as I write in the piece, the worth of pure gold is ultimately a social construct. It's based not only on its relative scarcity in the ground, but on the customs and the disciplines involved in mining gold and assaying gold. And so the so called gold standard originated not really as a claim of perfection, but as a way to curb counterfeiting through standardized practices. In this same vein, I argue that knowledge is similar. It is and must continue to be kind of backstopped less by advances in digital media than by social and institutional processes like academic and civil society institutions, libraries and library science, localized journalism, publicly accessible digital resources and archiving, standards setting and credentialing organizations, and evidentiary rules, all of which are more social and institutional than necessarily technological.
Justin Sherman
You just did this with the Pyrite analogy. One thing I always enjoy about many of your monographs and papers and articles is what you were just saying. Sort of looking at sections of history, distilling parallels that can inform how we think about some issue today that's treated, as you noted, with deepfakes and AI as newer. I'll put that in quotes as we'll get into, you know, maybe some things aren't so new. So let's walk through that history a little bit. What can we learn about the advent of any new technology and how it's perceived, particularly when it comes to audio visual media?
Gavin Wild
So I think one of the major takeaways of the paper and the lessons of kind of audio visual media over the past two centuries is, is that we tend to focus on their potential political and epistemological impacts. That is to say, what they mean for how we formulate knowledge while ignoring their most likely use cases, which are usually to amuse and entertain ourselves. In other words, the subtle and often unintentional impacts on art and popular culture tend to make so many of the doomsday scenarios seem, in hindsight, kind of misplaced. So you have Thomas Edison or The Bell Telephone Co. Assuming that sound recordings and telephones would be primarily used for business dictation and commerce, while music production and idle chit chat by housewives weren't really at the front of their mind, but probably should have been. Or you have these academics in the 1600s thinking that they're going to educate the public about optical illusions, using light projection to debunk hucksters and magicians, only to find themselves kind of further fueling this fascination with the supernatural in the process. One of the other myths that gets kind of debunked when you look at this history is this idea of inevitable obsolescence or this notion that because we've invented a new thing, the old thing or the old medium is now completely done for. So, for example, if you're a painter in the 19th century, you're getting really worried about photography. If you're a book publisher in the early 1900s, you're freaked out about nationally syndicated newspapers. If you're working with typesetting or printing of any kind, the advent of the phonograph spells certain doom for your profession. Commentators were worried that regional dialects would get watered down if a person in Boston can simply pick up the phone and chat with someone in California. Or textbook publishers worried that classrooms would be dominated by motion pictures. Instead, record producers lived in fear of broadcasting because, after all, why would you listen to a vinyl record at home if you could just tune into the radio? Now, of course, all of these kind of speculative futures were either wildly overstated or some of them were completely outlandish to begin with. So the point is that our cultural and social practices tend to keep many forms of audiovisual media thriving, including those institutions that validate their authenticity and credibility long after their purely practical functions might age off.
Justin Sherman
We can go into several of those, and if we had time, I would, on Boston dialects and other interesting things. This is a good segue, though, back to the deepfakes point, which is, as you had noted up top, there are many ways in which we, and when I say we, you know, policymakers, the media, etc. Think about deepfakes as new. And of course, people in 1650 were not firing up their iPhone and asking ChatGPT how to make a fake video with another machine learning model. But fakery itself, as you explore in this paper and directly related to what you were just saying, is not new. And so what role did fakery play in audiovisual media during these past. These past centuries and time periods we're talking about here?
Gavin Wild
So the advent of photo and audio recordings is pretty closely attended by fakery. For instance, early photos couldn't really capture landscapes very well, so folks would have to go in and paint skylines and clouds on top of the initial prints. And a lot of the images that accompanied stories and early newspapers were pretty routinely doctored like this. Meanwhile, many early recordings were staged recreations of famous historical speeches and famous contemporary speeches where many listeners in the audience had no idea whether they were listening to this event happening in real time or whether the voice they were hearing was that of an actor or the actual prominent figure coming through the speaker themselves. And it was really only well into the 1900s that society broadly started to accept or, or expect that audiovisual media would serve as evidence. And so this illustrates an important point about audiovisual media more broadly, that the line between evidence and expression, between depiction and detection, or between capturing and manipulating an event onto film or tape has always been very blurry. It's always required some secondary or tertiary bits of context and information to make sense. And so this idea, however much we've evolved away from it, this idea that facts, the whole facts and nothing but the facts can somehow be expressed fully or self evident within a recording either in 1865 or 2025, has always been very flawed. And so for instance, more recently with the advent of Photoshop in like the late 1980s, you see this rapid democratization of the ability to make realistic looking fakes and a concurrent scrum by academics to do what were called at the time media forensics, or the ability to detect subtle traces of manipulation on a digital image or recording. But ultimately what they found was there wasn't as much demand for media forensics as we predicted. One of the most prominent examples in my lifetime was a famous picture of a guy in a cap standing on top of the World Trade center in Manhattan with a passenger jet approaching. Unbeknownst to him, just below that photo proliferated email inboxes throughout my community and my high school, sparking tons of conversations and speculation. Now of course the video was a fake. It was later found to be made by a Hungarian teenager that was looking to kind of joke around with his friends, not necessarily to spark a global hoax. And on the one hand a complicated digital tool would definitely be able to tell you that that photo had clearly been shopped. But on the other hand, there are plenty of contextual non forensic reasons to be highly skeptical, at least for anyone who cared to investigate the provenance of that photo. And in that regard, historians like Lewis Mumford and Cohen Vermeer note that context is the key, that social uncertainty and anxiety always tend to find an outlet in our fascination with illusion. So whether that context is the Enlightenment or the Industrial Revolution or the aftermath of 9 11, we can't really separate the cultural appetite for spectacle or escape or illusion from that audio visual fakery. But we also can't confuse this appetite with with some kind of collapse of institutional knowledge.
Justin Sherman
So we're not too far off from the present with the examples you just gave, such as around 9 11, but let's come further to the present. So around 2015, as you explain, there were great advances made in the capabilities of so called deepfake technology. This also arrived though at the same time, as we'll all recall, as there were lots of concerns and incidents related to social media to disinformation. Take your pick. 2016 election, Cambridge Analytica. You know, the conversations in D.C. and in the media about the virality of false information and propaganda, all of which are issues with which you, as you, your work and other stuff you noted are intimately familiar. So what cultural and political and online context, in a sense, were these 2015 era deepfake developments walking into? And how did this broader context of these other concerns about disinformation or social media impact both the actual role that deepfakes played in society as well as how the public perceived the deepfakes in society?
Gavin Wild
Right. So, I mean, by the time you have the first papers rolling off, you know, the academic presses about the potential harms from deepfakes in 2015, we already had a very fractured media landscape. We already had continuing erosion of trust in institutions. You have rising concerns about disinformation and, you know, fakery more broadly. Online, you've got a rise in authoritarian sentiment throughout, you know, certainly the globe. And you also have an elite class that's looking for answers as to why they lack the authority and the credibility that they used to have. And then, as you mentioned, certainly in the aftermath of 2016 elections, all of the incentive structures kind of existed to look at deep fakes through the prism of a quote unquote, post truth and politically polarized world. So I think, just like we'd place the advent of any technology into that cultural context of its time, it's important to look at the rise of deepfakes with the caveat, or at least the awareness that we were already well primed by this point, to consider them from the viewpoint of a very vulnerable societal context and to think first and foremost about how they might be weaponized politically and geopolitically. But one of the findings that I kind of point to in my paper is that that tends to distract us from, again, this historical trend where amusement and entertainment and cultural kind of frivolity tends to be where a lot of these new breakthroughs in audiovisual technology find themselves manifested before a lot of these more weighty subjects, of course.
Lawfare Podcast Host
Okay, folks, let's be real. Nobody starts a business for the joy of calculating tax withholdings. You know, people know me as the editor of Lawfare, but I also actually run a small business, my own substack. And I got to tell you that the payroll is a freaking nightmare. And that's where Gusto comes in to take the stress out of payroll, benefits, and hr. So you can focus on what you started your business in the first place. For Gusto is online payroll and benefits software built for small businesses. It's all in one remote, friendly, and incredibly easy to use. So you can pay, hire onboard, and support your team from anywhere. It has automatic payroll tax filing, simple direct deposits, health benefits, commuter benefits, worker comp, 401k, you name it. Gusto makes it simple and has options for nearly every budget. Save time with automated tools built right in. Offer letters, onboarding materials, direct deposit, and more. It's quick and simple to switch to Gusto. Just transfer your existing data to get up and running fast. Plus, don't pay a cent until you run your first payroll. Try Gusto today at gusto.com lawfair and get three months free when you run your first payroll. That's three months of free payroll at gusto.com lawfair one more time gusto G-U-S-T o.com lawfair if you're a maintenance supervisor at a manufacturing facility and your machinery isn't working right, Grainger knows you need to understand what's wrong as soon as possible. So when a conveyor motor falters, Grainger offers diagnostic tools like calibration kits and multimeters to help you identify and fix the problem. With Grainger, you can be confident you have everything you need to keep your facility running smoothly. Call 1-800-GRAINGER click granger.com or just stop by Granger for the ones who get it done.
Boland Branch Advertiser
Did you know? Adults 60 plus lose more than $60 billion each year to financial exploitation? Greenlight's new Family Shield plan empowers you to monitor your accounts for suspicious activity, protect yourself with up to $1 million identity theft coverage, and reassure loved ones that you're safe with location sharing and place alerts. Get peace of mind today@greenlight.com protect that's greenlight.com/protect hi, it's Matt here from P1.
Matt from P1
With Matt and Tommy, and this episode is sponsored by eBay. Ever tried to buy a car online and end up in a parking lot with a stranger, a paper title and some blind trust With Secure Purchase on ebay, you don't have to Secure purchase means sellers and titles are verified, financing covered, registration handled, delivery. Get your ride plates and paperwork shipped to you so you can skip the DMV and sketchy meetups. Buy your next car on eBay. EBay things people love Secure Purchase is powered by Caramel Dealer Services, LLC, an eBay subsidiary.
Justin Sherman
2024, in some ways, was a test case for deepfakes and for some of the dynamics you were just describing. And after almost a decade of folks theorizing or I like the word you used earlier as well, speculating about the threat of deepfakes in an elections context, 40 of which were taking place last year in democracies around the globe. How did that actually play out? Give us the facts of what happened, but also in your analysis, did the worries about election deep fakes and democracies and the threats to, you know, public discourse and so on play out in 2024 in the way that folks were predicting?
Gavin Wild
I would say broadly, not compared to the degree of concern and hype about deepfake assisted election interference or influence. 2024 was the dog that didn't bite. Despite a few isolated incidents, I held several discussions with platforms and researchers, most of which found that deepfakes weren't really used any more than any other types of content. The ones they found were pretty easily debunked or recognized as being synthetic, and where there was no real broader deception campaign that they might have been linked to. So, to quote one YouTube executive that I spoke with, the deep fakes we saw, the fakery was the point. So in other words, they were mostly used as a form of joke or political cartoon. But more broadly, there was no previously untapped demand for propaganda or disinformation type content that deep fakes were somehow poised to now supply in 2024. And by the way, this lines up with what researchers at Notre Dame University found about the majority of fake content online. They found that it was mostly memes and political cartoons, artistic expression that was more winking than deceptive in its intent. So the point was less to deceive your mind than it was to tickle your funny bone, so to speak. And that cuts to another key theme of the paper, which is relevance. So according to experts like Dan Sperber and Hugo Mercier and Sasha Altai, humans pretty much ignore most media content that isn't immediately and deeply relevant to them. But most of this fake content exists in arenas like commercial or political advertising, where we tend to engage at a very, very superficial level. And even when we do engage with this content, cognitive scientists warn against concluding that passionate commitment to certain ideas or in groups necessarily operates the same way as knowledge formulation. Meanwhile, political science cautions that people insincerely make or accept certain claims as a way to publicly signal their allegiance in a community, even while they probably harbor quiet doubts about the factual veracity of those claims. And so, in a real way, we shouldn't conflate deepfakes ability to attract attention necessarily with their ability to displace the way that we formulate knowledge, both personally or as a group.
Justin Sherman
I mean, you made several Interesting points. I do want to double click just for a minute on the piece you mentioned about your conversations with social media platforms. Is it your sense that sort of two aside, questions off of that. One, is it your sense that the platforms had any particular takeaway themselves about deepfakes and their preparations for them and so on in 2024? And then second, do you think, especially in the current environment, and I say that referring among other things to the de emphasis in the United States on regulation and content moderation, do you think those changes that platforms are making now are going to make it more likely or lower the barrier for manipulative deepfakes, or is it still going to be a lot of satirical kind of content?
Gavin Wild
I think that's the challenge. I certainly got the sense from most of the folks that I talked to that they were at an institutional level, kind of surprised at how much of it was winking, kind of leaning into the aesthetic, the fakery of the art form of a deep fake video, less trying to kind of cast some quote unquote recording as evidence of some kind of interference or foul play. I gathered some sense of surprise at how that the ratio of that kind of cartoonishness versus deliberate manipulation. I would also certainly not discount that they got better and probably applied a higher level of scrutiny around monitoring and countering the proliferation of synthetic media on their platforms. But a lot of that, I think, is dependent on an inexact science of detection, which all of us are still struggling with, that there's no good easy button to kind of identify it. And so all of the resources of content moderation, which as you know, are probably lesser and lesser in the intervening years, just given the political climate, I don't know how much of that they're willing to dedicate towards kind of identifying and pulling down inauthentic content, particularly if they've already kind of concluded that most of it is essentially harmless or playful in its intent, rather than trying to be manipulative. But I imagine that's going to prompt them to take a much more case by case approach.
Justin Sherman
No, I appreciate you indulging because that's really interesting and I'm going to mess up the year. So listeners, forgive me, but this calls to mind just to say you mentioned how it was a little overblown and this and that, and there were other ways that content was spread. I'm just recalling, I forget if it was 2020 or 2022 or 2018, one of those midterm or election years, but there was a study I'm remembering done out of Harvard that had looked at election disinformation and misinformation on social media at the time, and it was not related to deepfakes, but it had in some ways an analogous conclusion which was there. They had found that a lot of the dis and misinformation had spread through social media only as a secondary vector. And it was actually, oh, it's no, it' people talking at press releases, and it's the mainstream media saying certain things or repeating certain things that then get reposted online. And I always think that's kind of interesting. But I want to come back to something you've mentioned a number of times, which is there's a lot of attention to how believable a deepfake is. The realness, if you will, of a deepfake. But you write in this paper that there's a lot less attention to the processes that audiences undergo when they encounter a deepfake. And so why do you think that is? Why is there so much focus on believability rather than how people actually perceive them? And then what impact does this disproportionate focus have?
Gavin Wild
Yeah, I mean, a lot of these studies focus on, well, did this deep fake dupe you? Did you think it was realistic? Which is indeed a very interesting question. But, you know, we don't survey folks coming out of an action movie and kind of say, well, how realistic was the action or the gore? Did it convince you that it was real life? Like, no, because the context and the relevance are not the same. By discounting, you know, those two factors, the relevance and the context, the focus on how real a deepfake looks tends to sweep those under the rugs, but that's how actual persuasiveness hinges. To be persuaded of something is not just a matter of how realistic it looks in a certain audiovisual context, but everything surrounding that context and how relevant it is to a human being's immediate circumstances that plays a much larger role. So this is why you don't have scientists going around and crashing magic shows or. Or Olympic wrestling coaches kind of protesting outside of WWE headquarters, or music composers writing long treatments about how vaporwave music has perverted musical theory. If we did, the response would be, guys, you're taking this too seriously. You're trying to have an empirical conversation while we're trying to have an experience. Or we're trying to examine the aesthetical qualities of these. Of these shows. We're all wise to the act and we choose to be here anyway. And so in this regard, I think rather than thinking of deepfakes as deteriorating knowledge, it's probably far more useful to think of them as enhancing kayfabe or bs, none of which has ever really demanded so much attention and resources from an academic or policy perspective. And that aligns, by the way, with much of the recent research, as you mentioned, on myths and disinformation more broadly, that there are very few folks who are simply duped and fall down a rabbit hole of delusion. Most of those who encounter it or dabble in it willingly opted into that arena, much like professional wrestling. And this is not to say that deepfakes or disinformation are not problematic issues, but rather that the cause and effect chain is not as short or direct as I think we've sometimes been given to suppose.
Justin Sherman
Is there anything to be said about the speed and the scale of information dissemination online and the pace of AI? Again is an umbrella term AI R&D. Is there something to be said about that making deepfake activity qualitatively or quantitatively different from some of the historical examples you mentioned of falsification and fake media?
Gavin Wild
I think there are definitely useful and beneficial applications for continuing to try to find ways to detect or virtually watermark or ask platforms to kind of voluntarily help us distinguish between synthetic and authentic media that's posted on their apps or platforms. I think all of those are great things. But you know, again, to borrow the analogy, I think it's to the extent that we try to develop a detector for pyrite. If we do that while kind of letting ignoring all of the institutions and the talent and the credentialing that goes into mining and assaying gold, the real thing, we're kind of missing the forest for the trees. And so I think, as I say in the paper, if over reliance on audio visual media as evidence has brought us to this place of alarm about deepfakes doubling down on that bet that more digital reliance is the answer, I think is probably misguided. That's where I would recommend and doing the paper lending equal if not greater focus to reinforcing the institutional scaffolding that if we're concerned about knowledge generation, well, the social and institutional processes, the gatekeeping even if you will, for what constitutes knowledge, we need to reinforce those and in my view, policy wise, we've in many areas run in the opposite direction where again archiving and library science and copyright, these are the things that I think help us to ascertain the real from the inauthentic or the authentic from the manipulated. And so that's the recommendation is I wouldn't recommend against trying to get better at detecting these digitally, but if that's the preponderance of our focus, I think we're probably missing a key element of the solution space.
Justin Sherman
Well, this is a perfect segue to filling in that solution space for us. So you write, as you noted in the paper, you write about a misplaced emphasis that goes on wishful worries versus actual agonies to step back one, how is the threat from deepfakes mischaracterized in your view from a legal and policy perspective? And then two, you just mentioned solutions. Are there ways we're responding well or poorly right now? And what would that different approach to deepfakes look like?
Gavin Wild
Yeah, so I mean you mentioned several of these actual agonies at the outset that despite now almost a decade of theorizing about this widespread societal epistemological impact of deepfakes occupying so much oxygen in both our research and policy discussions. The non consensual imagery of women and children and other vulnerable members of our population, the voice cloning of not only celebrities but also scamming, using cloned voices to scam financial institutions. These are at present still pretty much regulated with a patchwork of state statues, common law principles, but we don't have many much federal or national level attention on codifying the rules of the road for this kind of activity that is actually impacting people directly today. It's not in the realm of the speculative, much like a lot of the political manipulation still seems to remain. So you right now you have 45 states with laws against generated or modified CSAM material. You have a patchwork of state statues on the right of publicity that protects unauthorized use of a person's voice or their likeness. You have a very patchwork approach to copyright infringement and AI generated textual slop kind of proliferating in the online space for both book publishers and even music producers. Again, these are ongoing and prolific harms that are taking place that are much less sexy issues for research papers and policy focus, but probably much more salient. I think that's where I would focus. Again, if we are worried about the epistemic harms, I would focus much more on the institutional backstops, but more broadly from a legal and policy perspective, these are the actual concerns that probably need the most attention but don't seem to be getting it, particularly at the federal level.
Justin Sherman
That's all the time we have. Gavin, thanks very much for joining us.
Gavin Wild
Thanks so much. Honored to be here.
Justin Sherman
The Lawfare podcast is produced in cooperation with the Brookings Institution. You can get ad free versions of this and other Lawfare podcasts by becoming a Lawfare Material supporter through our website, lawfairmedia.org support. You'll also get access to special events and other content available only to our supporters. Please rate and review us wherever you get your podcasts. Look out for our other podcasts including Rational Security, Allies, the Aftermath and Escalation. Our latest Lawfare Presents podcast series about the war in Ukraine. Check out our written work@lawfaremedia.org the podcast is edited by Jen Patia and our audio engineer. This episode was Kara Schillen of Goat Rodeo. Our theme song is from Alibi Music. As always, thank you for listening only Boost Mobile Boost Mobile will give you a free year of service. Free year when you buy a new 5G phone new 5G phone enough, but I'm your hype man. When you purchase an eligible device Device you get $25 off every month for 12 months with credits totaling one year of free service. Taxes extra for the device and service plan online only.
Podcast: The Lawfare Podcast
Guests: Justin Sherman (Host), Gavin Wilde (Carnegie Endowment for International Peace)
Date: September 26, 2025
This episode of The Lawfare Podcast features a deep-dive conversation between host Justin Sherman and Gavin Wilde, a nonresident fellow at the Carnegie Endowment for International Peace and author of the recent paper "Pyrite or Panic: Deepfakes, Knowledge, and the Institutional Backstop." The discussion explores how fears around deepfakes compare to historical anxieties over new technologies, the reality versus perception of deepfake threats—especially in the context of elections and disinformation—and what a more effective, less tech-obsessed response might look like. Wilde argues for shifting the focus toward reinforcing social and institutional backstops for knowledge, rather than becoming overly fixated on technological solutions.
Wilde emphasizes that anxieties about new media technologies (audio, visual) are not unique to the deepfake era; historical examples show similar fears were largely overblown.
"The line between evidence and expression, between depiction and detection... has always been very blurry."
— Gavin Wilde [00:52]
The "Pyrite" (fool's gold) analogy: Deepfakes are like pyrite—physically similar to gold but not the same. Historically, the discovery of pyrite increased the value placed on reliable validation methods for gold rather than destabilizing the gold market itself. Similarly, knowledge is "backstopped" by institutional and social processes more than by technology alone.
— Gavin Wilde [04:48]
Early photo and audio media were routinely manipulated, and only over time did society come to treat recordings as authentic evidence.
Host and guest discuss how magic shows and staged recordings were accepted forms of entertainment, not considered existential threats to truth.
"Fakery itself is not new... the line between capturing and manipulating an event has always been blurry."
— Gavin Wilde [13:14]
Major doomsday predictions about new media (photography killing painting, radio supplanting records, movies destroying textbooks) generally failed to materialize.
The 2015–2024 surge in deepfake technology coincided with societal anxieties about disinformation, institutional mistrust, and political polarization.
"By the time you have the first papers... about the potential harms from deepfakes in 2015, we already had a very fractured media landscape... we were already well primed... to think first and foremost about how they might be weaponized."
— Gavin Wilde [18:15]
Wilde argues that deepfakes have, in practice, been used more for satire and artistic expression than for effective mass disinformation.
"The deep fakes we saw... the fakery was the point." — Quoting a YouTube executive [24:21]
2024, a year of mass elections worldwide, was anticipated as a test case for deepfake influence—but the reality was anticlimactic.
Much academic and policy focus is on the speculative "collapse of knowledge" due to deepfakes, but this may distract from actual, ongoing harm such as nonconsensual intimate imagery and voice cloning scams.
"Despite now almost a decade of theorizing about... societal epistemological impact of deepfakes... the nonconsensual imagery of women and children... voice cloning... these are at present still pretty much regulated with a patchwork of state statutes, common law principles, but we don't have much federal or national level attention."
— Gavin Wilde [37:07]
The legal and policy landscape is fragmented—with strong laws against child sexual abuse material (CSAM) in 45 states but little unified federal action on broader deepfake harms.
There’s disproportionate focus on whether deepfakes are technically convincing, not on the audience’s context and willingness to be “duped.”
"We don't survey folks coming out of an action movie... Did it convince you that it was real life? No, because the context... are not the same."
— Gavin Wilde [31:16]
Wilde likens engagement with deepfakes to professional wrestling (kayfabe)—most people knowingly participate, with the entertainment value outweighing concerns about authenticity.
The most effective way to safeguard knowledge is through reinforcing societal and institutional “mining and assaying”—library science, archiving, credentialing, public journalism—rather than relying solely on technological detection or watermarks.
"If overreliance on audiovisual media as evidence brought us to this place of alarm... doubling down on that bet... is probably misguided."
— Gavin Wilde [34:17]
On the social construct of knowledge and authenticity
"...the worth of pure gold is ultimately a social construct... based not only on its relative scarcity in the ground, but on the customs and the disciplines involved in mining gold and assaying gold."
— Gavin Wilde [04:48]
On human psychology and relevance
"Humans pretty much ignore most media content that isn't immediately and deeply relevant to them."
— Gavin Wilde [24:21]
On the real threats of deepfakes
"The actual harms... [are] nonconsensual imagery, voice cloning scams... [these] need the most attention but don't seem to be getting it, particularly at the federal level."
— Gavin Wilde [37:07]
On the audience’s role in meaning
"We're all wise to the act and we choose to be here anyway... actual persuasiveness hinges [on] context and how relevant it is to a human being's immediate circumstances."
— Gavin Wilde [31:16]
Summary prepared for listeners seeking actionable insights and context on deepfakes, media trust, and the path forward.