The 404 Media Podcast: "The AI Exodus Begins" – Episode Summary
Release Date: July 16, 2025
Host: Joseph
Co-Hosts: Sam Cole, Emmanuel Mayberg, Jason Kebler
Podcast: The 404 Media Podcast
Episode Title: The AI Exodus Begins
1. Introduction and Housekeeping
The episode kicks off with Joseph welcoming listeners and briefly mentioning an upcoming event in Los Angeles scheduled for July 30th. Sam Cole elaborates on the event details, encouraging subscribers to attend by purchasing tickets or utilizing a special code for free entry reserved for supporters. Jason Kebler adds that the event will feature a live podcast and Q&A session at RIP Space, a hacker DIY space, followed by a party.
Notable Quote:
Joseph [00:38]: "Welcome to the 404 Media podcast where we bring you unparalleled access to hidden worlds, both online and IRL."
2. Investigating Civitai and the Prevalence of AI-Generated Adult Content
Emmanuel Mayberg leads a deep dive into Civitai, an AI platform backed by 16z, scrutinizing its role in hosting and generating adult content. Historically, Civitai permitted adult content and AI models resembling real individuals, provided they avoided non-consensual depictions. Emmanuel's investigations reveal significant shortcomings in enforcing these policies, both on-platform and off-platform.
Notable Quotes:
Emmanuel Mayberg [03:07]: "When you look at the top models, the top images, the latest models, the latest images, it's just a never-ending stream of adult content."
Emmanuel Mayberg [05:43]: "Contrary to those figures showing 60% of content on Civitai as not safe for work... the company says, 'less than 20% of the posted content is what we would consider PG-13 and above.'"
Emmanuel references a study conducted by a University of Zurich researcher, which analyzed over 40 million images on Civitai. The findings starkly contrast Civitai's public statements, indicating that 56% of all images were tagged as not safe for work (NSFW), a figure that likely underrepresents the true prevalence due to improper tagging by users.
Emmanuel Mayberg [10:35]: "From that time until now, the number of overall images and models on the site has absolutely exploded, as has the proportion of adult content. It's like, at this point, it looks like 80, 90% of everything that is on the site is adult content."
3. Policy Changes and Their Ramifications
In response to mounting pressure from payment processors, Civitai implemented significant policy changes in May 2024, banning models that generate the likeness of real people and certain types of extreme pornographic content. These changes led to the removal of over 50,000 models, revealing the extensive use of Civitai for creating bespoke AI-generated likenesses of celebrities and individuals.
Notable Quote:
Emmanuel Mayberg [14:22]: "A lot of people move their models there. For a while, Tensor Art had a tool that even helped people import their Civitai models automatically."
This policy shift didn't quell the demand but rather catalyzed an exodus of content creators to other platforms like Hugging Face. Emmanuel highlights that 5,000 non-consensual AI models of real people found a new home on Hugging Face, despite the platform's purported commitment to ethical AI practices.
4. The Role of Payment Processors in the AI and Adult Content Ecosystem
Sam Cole provides an insightful analysis of how payment processors wield significant influence over platforms hosting adult content and AI models. Companies like Stripe, Visa, and Mastercard categorize adult content as high-risk, often leading to the severance of financial relationships with platforms hosting such material. This categorization forces platforms to adhere strictly to content guidelines or face financial repercussions.
Notable Quote:
Sam Cole [20:32]: "These payment processors don't want to take the time to sort out the difference in a lot of cases and just ban it all."
The impact of these decisions is profound, pushing platforms to either align with stringent content policies or risk losing essential financial services necessary for their operations.
5. Save Our Signs: Preserving the True History of National Parks
Transitioning from the digital realm, Sam Cole introduces a pressing issue concerning the preservation of historical narratives within National Parks. In March, the Trump administration issued an executive order titled "Restoring Truth and Sanity to American History," aimed at reconfiguring how history is portrayed in public monuments and memorials managed by the Department of the Interior.
Notable Quotes:
Sam Cole [31:43]: "It says... 'to ensure public monuments, memorials, statues, markers or similar properties... do not contain descriptions, depictions or other content that inappropriately disparage Americans past or living...'"
Sam Cole [34:30]: "It's like... rules out quite a bit of American history if you can't really tell the truth about what was going on."
This order threatens to sanitize historical narratives by focusing solely on the grandeur of American landscapes and achievements, potentially erasing discussions around racism, indigenous histories, and other critical societal issues intertwined with these sites.
In response, Save Our Signs—a collaborative effort launched by data preservationists from the Safeguarding and Research and Culture Project and the Data Rescue Project—has initiated a crowdsourcing campaign. Through their web portal Zero Signs, they encourage visitors to National Parks to photograph and archive existing placards, signs, and monuments to safeguard them against potential removal or alteration.
Notable Quotes:
Sam Cole [37:46]: "If you're at a park... take a picture of placards and signs and monuments... to preserve them, to archive them, essentially..."
Sam Cole [44:03]: "It's a nice kind of entry point into data preservation and archiving... you're helping preserve a piece of history when it's under threat."
This grassroots effort not only empowers the public to participate in historical preservation but also serves as a countermeasure against potential governmental overreach in rewriting history.
6. Conclusion and Subscriber Information
The episode concludes with a brief mention of additional subscriber-only content, teasing a forthcoming discussion led by Jason Kebler. Listeners are encouraged to subscribe to 404 Media for exclusive access to bonus episodes and ad-free content, supporting the journalist-founded media company's mission to deliver investigative reporting and unique insights.
Notable Quote:
Joseph [44:51]: "As a reminder, 404 Media is journalist founded and supported by subscribers... you'll also get to listen to the subscribers only section where we talk about a bonus story each week."
Key Takeaways
-
Civitai's Shift Toward Adult Content: Despite public claims, data indicates that a significant majority of content on Civitai is adult-oriented, leading to policy changes under pressure from payment processors.
-
Migration of Content to Other Platforms: The removal of real-person models from Civitai has driven content creators to platforms like Hugging Face, raising concerns about the hosting of non-consensual AI-generated content.
-
Influence of Payment Processors: Financial institutions play a pivotal role in enforcing content policies, often categorizing adult content as high-risk and compelling platforms to alter their offerings.
-
Preservation of National Park Histories: In response to executive orders aimed at sanitizing historical narratives, initiatives like Save Our Signs are leveraging crowdsourcing to archive and preserve the true histories embedded within National Parks.
This episode underscores the intricate interplay between technology, content regulation, and historical preservation, highlighting the challenges and grassroots efforts to maintain integrity and diversity in both digital and physical public spaces.
