Nerd Alert: How AI Will Change Marketing Structures

Summary

Podcast Summary: The Marketing Architects – Episode: "Nerd Alert: How AI Will Change Marketing Structures"

Introduction

In the episode titled "Nerd Alert: How AI Will Change Marketing Structures," hosts Alina Jasper and Rob Demars delve into the transformative role of Artificial Intelligence (AI) in reshaping marketing teams and workflows. Released on May 8, 2025, this episode explores cutting-edge research that examines AI not just as a tool, but as a collaborative teammate capable of enhancing team performance and altering the dynamics of marketing operations.

Exploring the Study: "Cybernetic Teammate"

The centerpiece of this discussion revolves around the study "The Cybernetic Teammate: A Field Experiment on Generative AI Reshaping Teamwork and Expertise." Conducted by a team of esteemed researchers, including Fabrioso Del Acqua and Karim Lakhani, the study was a comprehensive field experiment carried out at Procter & Gamble (P&G). It involved 776 professionals engaged in real product innovation tasks, aiming to evaluate the impact of incorporating AI, specifically ChatGPT (GPT-4), into team structures.

Study Setup and Methodology

Alina introduces the study's framework:

"The researchers randomly assigned people to four groups. The first group was alone with no AI. They were the control group. Then they had a team of two people, no AI included. Then they had someone alone with AI, which was ChatGPT, GPT4. And then they had teams of two people with AI and each group was given the same challenge." [02:03]

The challenges included ideating new products, packaging innovations, or retail strategies within their respective business units at P&G. The research aimed to measure three key outcomes:

1. Quality of Ideas: Assessing the creativity and feasibility of the proposed solutions.
2. Cross-Domain Expertise Sharing: Evaluating the ability to integrate knowledge from different disciplines.
3. Emotional Experience: Understanding the impact on participants' emotions and stress levels during the work process.

Key Findings

1. AI as an Equivalent Teammate

   One of the most striking findings was that individuals working alone with AI produced ideas of comparable quality to teams without AI:

   "In fact, their idea quality scores were nearly identical. So if you're thinking, can AI help me do more faster on my own, the answer is yes." [02:20]

   Rob affirms this by stating:

   "I think all you have to do is work with the tool to start to feel it yourself. You know, you've got this teammate that never gets tired... it's super fast." [01:44]

2. Breaking Down Silos and Encouraging Cross-Disciplinary Collaboration

   The study revealed that AI facilitated the blending of different expertise areas:

   "With AI, those differences vanished. Everyone submitted more balanced cross-disciplinary proposals, regardless of their background." [04:00]

   This indicates that AI helps individuals think beyond their specialized domains, fostering a more integrated approach to problem-solving.

3. Enhancing Emotional Well-being

   Perhaps the most unexpected discovery was AI's positive impact on participants' emotional states:

   "People using AI alone or in teams, they felt more positive emotions and less stress during work. They were more excited, less frustrated." [04:55]

   Alina reflects:

   "That's ultimately what you want, is it's doing tasks for you that it's helping you do things better, and it's taking care of things that you might not necessarily want to do yourself." [08:42]

4. AI Outperforming Human Teams

   Beyond matching human team performance, AI-human collaborations sometimes exceeded expectations:

   "Teams that used AI were three times more likely to create a top 10% idea compared to teams without AI." [06:10]

   Importantly, the diversity of ideas remained intact, showcasing a "blended intelligence" rather than AI overshadowing human creativity.

Implications for Marketing Leaders

The insights from this study suggest a paradigm shift in how marketing teams can be structured. AI is not merely a supplementary tool but a collaborative partner that enhances both productivity and job satisfaction. Rob encapsulates this transformation aptly:

"AI is like having a silent co-founder who never takes credit. It asks great questions, fills the gaps in your thinking and helps you see around corners." [07:11]

Real-World Applications and Personal Anecdotes

Rob shares a personal experience to illustrate AI's practical benefits:

"ChatGPT helped me fix the running toilet the other week using the vision capability... It walked me through because I don't know the first thing about fixing a toilet." [07:11]

This anecdote underscores AI's versatility and its potential to assist beyond professional settings, seamlessly integrating into daily workflows.

Conclusion

The episode concludes by emphasizing AI's role in not only replicating but enhancing human collaboration within marketing structures. The concept of "cybernetic teaming" introduced in the study highlights AI's potential to revolutionize how teams operate, innovate, and maintain emotional well-being.

Alina and Rob encourage listeners to embrace AI as a valuable collaborator that can expand their thinking and improve their work experience, ultimately driving more effective and creative marketing strategies.

Notable Quotes

• Rob Demars [01:44]: "It's like truly a great teammate."
• Alina Jasper [04:00]: "AI, it helped people think beyond their current expertise."
• Rob Demars [07:11]: "AI is like having a silent co-founder who never takes credit."

Final Thoughts

This episode of "The Marketing Architects" provides a comprehensive look into the evolving landscape of AI in marketing. By grounding the discussion in rigorous academic research and real-world applications, Alina Jasper and Rob Demars offer valuable insights for marketing professionals looking to harness AI's full potential.

Listeners are encouraged to connect with the Marketing Architects on LinkedIn and subscribe for more research-driven marketing insights.

Transcript

[Rob Demars]

Nerd alert. Learning is important, right?

[Alina Jasper]

Yes, exactly. What a bunch of nerds.

[Rob Demars]

Nerd alert.

[Alina Jasper]

Marketing Architects. Hello and welcome to the Marketing Architects, a research first podcast dedicated to answering your toughest marketing questions. I'm Alina Jasper on the marketing team here at Marketing Architects, and I'm joined by my co host, Rob demars, the chief product architect of misfits and machines.

[Rob Demars]

Hello.

[Alina Jasper]

Hello. We are back with your weekly Nerd Alert. Every week I'll take a deep dive into academic marketing research and translate its complex ideas into simple, understandable language for Rob, and of course, for all of you. Are you ready to nerd out, Rob?

[Rob Demars]

Oh, man. I was up studying all last night. No, actually I was watching the White Lotus. Yeah, let's. Let's do this.

[Alina Jasper]

All right, let's get into it. Well, this is a topic that you probably would spend all night studying. So I'm going to link the research we cover in the episode notes. And what I'm talking about is a study titled the Cybernetic Teammate, A Field Experiment on Generative AI Reshaping Teamwork and Expertise. It's by Fabrioso Del Acqua, Charles Arubi, Hila Levshiz, Rafela Sedun, Ethan and Lilac Mollok, Ihan Jeff Goldman, Hari Nair, Stu Tube, and Karim Lakhani by a lot. A lot of smart people with names that are really hard to pronounce. I apologize.

[Rob Demars]

And Bugs Bunny.

[Alina Jasper]

It's a. It's a massive field experiment run at Procter and Gamble, no less. And it might just change how we think about collaboration in marketing. But before I get into it, Rob, let me ask you this. This study will suggest that AI might be a better teammate than some humans, possibly all humans. So what do you think? Is it just another AI bold claim or is it sort of an uncomfortable truth we're facing?

[Rob Demars]

I think it's totally true. And I think all you have to do is work with the tool to start to feel it yourself. You know, you've got this teammate that never gets tired. It's eaten the entire world in terms of information. So it's really knowledgeable. It's super fast. They're multimodal now, so it even recognizes images, does amazing math, which I love because I'm horrible at math. So yeah, it's an amazing, amazing partner. And it's more conversational than back in the day with the Internet. You would do a search and you get one answer. Now you can ask follow up questions. So it's like truly a great teammate.

[Alina Jasper]

I agree with you and I Think you're right. Like you just have to start using it to feel that way. And this paper really proves that. It's probably the most like real world practical AI study that I've come across. And it might just change, like if you're a marketing leader listening to this or actually anyone on a team, how you think about the makeup of your team. It's a field experiment. It was run at Procter and gamble with 776 professionals working on real product innovation tasks. And the researchers wanted to know this. What if AI wasn't just a tool but actually a teammate? Could it improve performance? Could it help you think more like a cross functional team, Even make your work feel better? So let's talk about the setup. The researchers, they randomly assigned people to four groups. The first group was alone with no AI. They were the control group. Then they had a team of two people, no AI included. Then they had someone alone with AI, which was ChatGPT, GPT4. And then they had teams of two people with AI and each group was given the same challenge. Come up with ideas for a new product, packaging innovation or retail strategy inside their own business unit at P and G. Then they measured three things. First the quality of ideas, then how well people crossed over into new domains. So kind of expertise sharing and then the emotional experience of doing the work. And the first finding was that people working alone with AI performed just as well as teams without AI. In fact, their idea quality scores were nearly identical. So if you're thinking, can AI help me do more faster on my own, the answer is yes. Generative AI can replicate the performance of a cross functional team. So Rob, does that surprise you that one person with AI can match the output of a human team?

[Rob Demars]

I don't want to come across as some Pollyanna optimist, but I guess I will. I think one person with AI can outmatch a small company that's just a small team. Just when you think about the power and the breadth of what you have. And so yeah, no, I absolutely believe so.

[Alina Jasper]

So Rob's not surprised.

[Rob Demars]

I'm not surprised.

[Alina Jasper]

Okay, let's see if we can surprise you with some of these other findings. The second was that AI broke silos. So one of the coolest things they measured was how people stayed in their lanes. And without AI R&D folks, they tended to pitch technical solutions. Commercial folks pitched market oriented ideas. With AI, those differences, they vanished. Everyone submitted more balanced cross disciplinary proposals, regardless of their background. So in other words, AI, it helped people think beyond their current expertise. The third finding was AI makes work feel better. And I love this one. So here's this twist. People using AI alone or in teams, they felt more positive emotions and less stress during work. They were more excited, less frustrated. They generally felt more confident about their contributions, even though they underestimated how well they'd done. So AI didn't just improve performance, it changed how people actually felt doing the work. That one kind of surprised me, and maybe it shouldn't because I personally, like, if you took away chatgpt from me right now, I don't know if I could continue to work. Honestly, I don't know how I could do it. What do you think? Are we going to start seeing, like, AI adoption driven by culture, employee experience? Right now it seems like really centered towards productivity. Right. Like that's the pitch.

[Rob Demars]

Yeah.

[Alina Jasper]

But could that start to change?

[Rob Demars]

I think so. I was actually just talking about this with a friend of mine at the beginning of the Internet, everyone was talking about it's the Internet, right. But then all of a sudden it just became integrated with every aspect of our life and you start saying, what's the Internet that I'm working with? And I think AI is the same thing. It's right now, it's got this face to it. We tend to see it as ChatGPT or whatever or Gemini, but it's now just starting to ooze its way into every aspect of our lives and our tool sets, where it just starts to become an acceptable force in the universe versus this one singular face that we're either super excited about or super scared of.

[Alina Jasper]

Agreed. I want to talk about one final finding, quick, which is that AI doesn't just match human collaboration, it sometimes outperformed it. So teams that used AI, they were three times more likely to create a top 10% idea compared to teams without AI. And interestingly, the AI human collaboration didn't reduce variety. So even though people relied heavily on AI, their final submissions were still semantically more like humans than AI alone. So it's not just AI doing the thinking, it's a new kind of blended intelligence. And that's what they called cybernetic teaming. So if this research is right, AI, it's not just a tool to automate tasks, it's a collaborator that reshapes how we work, think and feel. It's not replacing teams, but it might transform what teams are capable of. Time for a rob AI in your workflow is like having a silent co founder who never takes credit. It asks great questions, fills the gaps in your thinking and Helps you see around corners. You still make the calls, but it makes your thinking bigger, faster, and smarter. And unlike your last co founder, it won't fight you over the logo. All right, Rob, what'd you think of that one?

[Rob Demars]

I continue to be amazed at how this technology integrates with my life. And I think the more we play with it, the more useful it becomes and the more we're willing to delegate. I think we have to sometimes even remember to delegate certain things. ChatGPT helped me fix the running toilet the other week using the vision capability. I literally brought my phone into the bathroom, opened up the lid of our toilet while it was. While the water was running, and showed it using the ChatGPT vision. And it walked me through because I don't know the first thing about fixing a toilet. And it's like, oh, you must have, like. It's either your seal or it's your floater. Your float. Whatever that floater thing. And I'm like, oh, okay, well, how do I adjust the floater? And it literally explained to me, like, well, see that thing right there? Just turn that to the right. It fixed my toilet. Right. So I know that's not a marketing example, but it's one where I just feel like you have to think through how could I potentially give this problem to ChatGPT and workshop, you know, and just reminding ourselves of that. Sorry, that's my little soapbox.

[Alina Jasper]

No, that's like. It's a great example of, like, it's just become a part of your, like, normal workflow now. Like, it's helping you.

[Rob Demars]

Yeah.

[Alina Jasper]

Save time and do things that you wouldn't have normally thought of.

[Rob Demars]

Absolutely.

[Alina Jasper]

Yeah. I just. I really liked this study. It was brought up on the artificial intelligence show, and I thought, yeah, that. That final takeaway about how it, like, people that were able to use AI, they actually felt better at work. That's ultimately what you want, is it's doing tasks for you that it's helping you do things better, and it's taking care of things that you might not necessarily want to do yourself. And so I thought that was, like, a very promising finding.

[Rob Demars]

Absolutely.

[Alina Jasper]

That's it for this episode of the Marketing Architects. We'd like to thank Taylor De Los Reyes for producing the show. You can connect with us on LinkedIn and if you like the podcast, please leave us a review. Now go forth and build great marketing.

[Rob Demars]

We lost Elena.

[Alina Jasper]

That was weird. It's still okay. It just started a new recording. Let me finish the Rob. Did we say the Rob GPT again? Quick What'd you think of that one? I'm distracted because of what happened to our recording.

[Rob Demars]

Okay, marketing architects.