Loading summary
A
If this episode makes you think, please let us know in the comments and support us by subscribing and leaving a review. Thank you. Today we are exploring brands quietly using AI generated influencers to promote products on social media, an investigation uncovered by Sarah Marsh, the consumer affairs correspondent for the Guardian. What the investigation found was that a worrying 70% of people are are unable to correctly identify all the real and fake videos they're shown online, meaning consumers are frequently misled by what they see. Now, this isn't just about a bit of clever marketing, is it? This is about something deeper that touches on trust and transparency and it has some really compelling implications for us in education. First up, let's talk about what this Guardian investigation actually uncovered. It seems that companies are increasingly turning to AI generated content that purports to show genuine customer experiences. The problem? There's often no clear indication that the people in these videos or images aren't real. In fact, some content creators are even signing non disclosure agreements, making it harder to talk about this behind the scenes work. It creates a sort of plausible deniability, as one former celebrity manager put it. The report specifically highlighted a photo app called OneSome. For example, they had videos on Instagram showing a bride crying, talking about how pleased she was to have used the app at her wedding. The whole thing felt incredibly authentic, very emotional. But analysis by cyber security companies Reality Defenders and Get Real Labs, which specialize in deep fake detection, suggested these were likely AI generated influencers. When the Guardian reached out once, didn't respond. Then there was the make it app, which helps people design and plan housing projects. They had a video where a woman, again appearing to be AI generated, raved about. An interior designer maker did respond to the Guardian, saying these AI generated influencers were an experiment to test marketing concepts, not a core strategy. And a fashion brand called ashl, based in Dubai posted photos of a woman wearing their clothes that appeared to show an extra finger, a telltale sign of AI generation. They later removed those images, stating it was because the designs were no longer in their collection, not because of the AI aspect. This really gets me thinking about the kind of world our students are navigating. If 70% of people struggle to tell what's real and what's AI generated content, how are we equipping young people to be critical consumers of information? Particularly when it comes to AI in advertising, it underscores the absolute necessity of AI literacy, not as a technical skill, but as a collaborative reasoning ability. It's about thinking with AI, not just using tools and critically evaluating its outputs. We need to teach students how to ask what does the AI know or not know here? What biases might be embedded? What's the real intent? Now you might be wondering why brands are going down this road. Clarissa Mansbridge, a former celebrity manager who creates these hyper realistic AI influencers for brands, shed some light on it. She said brands are attracted by the lower costs. Imagine not having to pay 20 or $70,000 for a traditional photo shoot or deal with human influencers who might generate bad press or have strong personal opinions. She estimates that anywhere from 40 to 60% of content from some big brands is actually AI made, but those NDAs keep it quiet. It sounds like a classic case of outsourcing the doing, doesn't it? Brands are outsourcing the creation of seemingly authentic user generated content, but they're not outsourcing the core strategic thinking of what resonates with an audience. Mansbridge argued that the authenticity of user generated content was always about resonance, not about who made it. If the content reflects a real consumer truth about the product, it connects. AI, she suggests, just gives brands a smarter, more scalable way to get there. But this is where the line gets blurry and it's a huge lesson for education. If we focus too much on just the product boss of learning and not the process or the performance box of understanding, we open ourselves up to this kind of plausible deniability. We need to design learning that cannot be faked because it demands depth, care and imagination. The real value is not in what the machine produces, but in how the student responds and how they critically engage, how they bring their unique context and judgment. This is exactly why we talk about assessment need in a cognitive stretch, asking if AI can complete a task without the student's unique perspective. If this discussion about AI in education is spark in your imagination, make sure you follow and subscribe to the podcast for more insights and conversations. So what are the regulators saying about all this which the consumer group along with their editor Lisa Barber are calling for clearer rules? Barber noted their own investigation found 70% of people couldn't tell real from fake videos, which is a significant issue for consumer trust. But here in the uk, the Advertising Standards Authority, or arca, says bar there's nothing in their rules explicitly prohibiting brands from posting AI generated content without disclosing it. Their spokesperson explained that the use of AI itself isn't the issue they assess, it's whether the ad is misleading. The EU's new artificial intelligence act coming in August will let require deep fakes and manipulated content to be labeled but that legislation won't apply here in the uk. This puts the onus squarely on us, doesn't it? We can't wait for regulation to catch up. We have to empower students with the skills to navigate this world. This isn't just about telling them to be careful online. It's about cultivating a sophisticated understanding of how AI works, its limitations and its potential for manipulation. It means teaching the principles of AI deep fake detection as a critical thinking skill, not just a technical one. We need to be having conversations in classrooms about AI transparency rules, not just for brands, but for our own use of AI in learning. Because ultimately, machines can compute, they cannot wonder, they cannot care. And it's those human qualities, judgment, wisdom, ethics that we need to protect and cultivate in our students more than ever. The core issue here isn't the technology, it's the AI influencers ethics that underpin its use and the imperative for transparency in a world saturated with AI generated content. The future of learning demands we teach students not to outsmart machines, but to outthink them, equipping them with the critical faculties to discern, question and ultimately create with integrity in an AI powered world. That's all for today. Thanks for listening.
Episode: Navigating AI-generated content
Date: July 3, 2026
Host: Dan Fitzpatrick, The AI Educator
Dan Fitzpatrick tackles the growing presence of AI-generated influencers and content in social media advertising, with a focus on their implications for education, trust, and consumer awareness. Drawing on a recent investigation by The Guardian, he explores how AI-generated personas are being used to market products, the challenges for regulation, and above all, what educators must do to prepare students for a world where discerning reality from fabrication becomes exceptionally complex.
Main Findings:
Notable Quote:
Issues Raised:
Notable Moment:
Expert Insight:
Current Regulatory Gap:
Onus on Educators:
Beyond Technology:
Final Provocation:
On consumer confusion:
“If 70% of people struggle to tell what's real and what's AI generated content, how are we equipping young people to be critical consumers of information?”
(Dan, 01:44)
On assessment:
“If we focus too much on just the product box of learning and not the process or the performance box of understanding, we open ourselves up to this kind of plausible deniability.”
(Dan, 05:05)
On ethical imperatives:
“The core issue here isn't the technology, it's the ethics that underpin its use and the imperative for transparency in a world saturated with AI generated content.”
(Dan, 09:13)
Dan Fitzpatrick urges educators to move beyond surface-level digital skills and empower students to critically interpret, question, and ethically engage with AI-generated content. In a world where AI easily fabricates convincing realities, the responsibility of fostering discernment, judgment, and creativity in students has never been more urgent.