
Loading summary
Host 1
Hey, everyone. On today's show, I'm going to blow your mind because I'm going to help you become one of the top 5% of AI learners and practitioners in the world. I'm going to do that through showing you how to stack AI tools together to create super productive workflows. Today we're going to break down how you can use Gemini deep research with NotebookLM and its sick new Interactive Voice feature. In using this workflow, I truly believe anybody can be an expert on a topic in minutes instead of days. And that's incredible. Let's get into today's show. Okay, so this is what I was doing a lot over the holiday break was thinking about, how do you put multiple AI tools together to do really interesting work? And I wanted to share today how I've been using a couple of Google's AI tools. So one of the tools that I really love is Google Gemini and its new Deep Research feature. I'm a very curious person. I want to get into the details of a topic and deep research has been an amazing way to do that. So if you go to Google Gemini, I had Google Gemini do a research project on AI agents, the use of AI agents, the marketing application of AI agents. You can kind of see my prompt there, which is, I want you to do a deep research project for me on artificial intelligence agents. I want to know what they're capable of automating well today, what they're not capable of automating well today. When should I use an agent versus a traditional web application? And how should I think about how AI agents should be used in marketing? So if you're watching this podcast which is all about marketing and artificial intelligence, then obviously, like, these are the kind of questions you're going to have. And these are the kind of questions I have. And so what I would have done before this is I would have gone and done a bunch of manual research and kind of culled it and copied it together. And Gemini is doing that for me. So what you'll see right now is that Gemini is working and it has researched over 32 websites on this topic. You can see all of them there, has everything attributed. And now it's in the midst of creating my report. And so it's going to take what I want to know. It went out and did all of the work. This is like a great example of AI. Like, I probably first of all only would have gone to like 10 or 15 of those 32 websites. I wouldn't have found all 32. We're also going to assume that Google's artificial intelligence is as good or better at actually like doing the search queries and finding the most relevant links and articles as I am. So the quality is going to be pretty good. And here goes. It generates a report for me, and that took about five minutes before. That would have taken me five hours probably. I mean, at least a couple hours for me to go through and do everything. And so what you'll see here is that it has put together a very detailed and very robust report with all these source topics. And what I love about it is that I can just go and open it in Google Doc and I can create a shareable document to kind of share with anybody, which is very cool. So now I have this document here and I could go read through this. I could do everything I wanted with this and that would be cool, but I don't think it's actually as helpful as we'd want. So I want to do something different. I want to go to a different one of Google's tools, which is Google's NotebookLM tool. So I go over to notebooklm.google.com and this is what it looks like when you just come in. It's blank, it's empty. And the goal of this tool is to let you to create a notebook of lots of materials that you're trying to learn about or work with. And so what's cool is let's say I want to go and upload or add sources to my notebook. The first thing I can do is do a Google Doc. So I want to do these AI agent capabilities, which is the research that Google Gemini just did for me. So all that deep research that we were just talking about, that's now in NotebookLM, like, that's pretty cool. I like that. But I've got some other sources that I want to add. I'm a big fan of what our friend of the pod, Dharmesh Shah on HubSpot. Co founder Dharmesh Shah is doing over agents AI. He also has a newsletter called Simple AI. And let's say I want to add some articles from simple AI. So he's got this great email newsletter that gets sent out. Go check it out at Simple AI to subscribe. And he posts all of his newsletters online. So I can just take the links to these newsletters and I can go and just add them in to my notebook LLM. I'm just going in and adding and doing that. And then I've got one more that I want to do here from Dharmesh's work. So we got a few relevant email newsletter articles that I have then posted there. If you didn't have the links, you could just post the raw text in to NotebookLM. We were like, okay, that seems pretty interesting. Again I said I'm a big fan of what he's doing on Agent AI. Dharmesh was on My first million and he talked a lot about AI on this show. So what I'm gonna take is I'm also gonna take Dharmesh's episode that he did on My First Million and I'm gonna add that as a source over here so that I have that my notebook. Cause it allows you to easily add YouTube videos as a source. And what's really cool about NotebookLM is like I can have all these sources or I can interact with just one of these sources. The other thing that is new is NotebookLM has come up with a brand new feature where you can interact with with the podcast. So it can take all of the sources and it can generate an audio overview. And so I am going to generate an audio overview. And while that's generating, I'm going to do a little bit of a prompt to get a summary. I would like a detailed summary from all sources that outlines the following the five best uses of AI agents today. The five worst uses of AI agents today. Five examples of how to use AI agents in your marketing strategy and an executive summary on a agents and their use in marketing. Okay, that's my prompt. I'm going to hit that prompt up. It's looking at the deep research I did. It's looking at Dharmesh's YouTube video, it's looking at those newsletter examples that I had. And here it goes. The five best uses of AI agents today. Automating complex workflows and what's really cool is it gives you sources and citations. One of the things I think Google has done a really good job of is is connecting like the AI recommendation result back with the source material. It's really good at data collection, analysis. Unsurprising what we're using AI for right now. Personalizing your marketing customer engagement. Totally agree. That's the number one use case we have seen in doing our work at HubSpot with AI. Great at content creation. Agents are great at content creation and great at acting as digital proxies. Agents can understand user preferences and handle basic tasks such as planning travel, evaluating software, managing schedules. Worst, you don't want agents to need common sense, real world knowledge. They don't have extensive memory. A lot of them don't have fully up to date information. They don't have, like the creativity and emotional nuance and emotional intelligence of humans. So it's pretty clear what's good and what's bad and what's awesome is that from a massive amount of deep research that Jim and I did and saved me a bunch of time, and then from additional resources that I had found that I thought were really good, I got what was a very manageable readout on what to do. And so what I like about NotebookLM is that you can keep going deeper. So it gives you some prompts, right? It can give you some prompts around. How do AI agents compare to traditional web applications and marketing? I'm actually curious about that one. So let's see what that says. So it's talking about how AI agents are better at automation, decision making, learning and adapting personalization, where traditional web applications are maybe better at decision making and handling complexity. They're saying that there's some overlap between the two. I think this is like an okay result, not the best result. So now what we have is after a couple minutes of work, it has generated a 23 minute AI overview where I can listen to a 23 minute kind of conversation. Let me give you a read of what.
Host 2
Welcome to this deep dive all about AI agents.
Dharmesh Shah
Oh, cool.
Host 2
We're going to be looking at a bunch of articles today and even a YouTube interview we found with Dharma Shah. You know Dharma Shah, right?
Host 1
CTO of HubSpot, calling out the sources.
Host 2
And founder of Agent.
Host 1
He has the context to know who Dharmesh is.
Host 2
He's calling AI agents the next big thing.
Host 1
So like, this is like having a personal podcast. And when NotebookLM first launched, this was the feature where we were just like, wow, this is incredible. Like I can get this amazing summary in a podcast and audio form so that I can consume on it, which is really, really cool. And then it was made cooler because you could go to Deep Research in Gemini and get real rich insights and then get into NotebookLM and get that in audio form. Now what I wanna show you today is their brand new interactive mode, which is still in beta, but it allows you to interact with the show. So I needed to give it permissions on my microphone and I can join the conversation with the two hosts. Let's see how this goes.
Host 2
Welcome to this. Hey there. Wanna share your thoughts on this?
Host 1
I was hoping that you could explain to me how I should be using AI agents in my marketing strategy based on what you two know.
Dharmesh Shah
Oh, that's a great Question. And something we can definitely dive into for you.
Host 2
Yeah, we were just about to get into the nitty gritty of what AI agents are.
Dharmesh Shah
Right. And how they're totally different from things like chatbots.
Host 2
And then we can definitely talk about how you might be able to actually use them in your marketing.
Dharmesh Shah
Yeah. It seems like Dharmesh, the guy we're talking about, is really excited about AI agents.
Host 2
Yeah, he's the founder of Agent AI.
Dharmesh Shah
Oh, wow. Okay.
Host 2
He's calling AI agents the next big thing in tech.
Dharmesh Shah
Big statement.
Host 2
And even compared his new company to like the LinkedIn for AI agents.
Dharmesh Shah
Well, that's a bold statement for sure. It definitely piques my interest.
Host 2
Yeah, me too. So before we get too far, let's just break down exactly what an AI agent is.
Dharmesh Shah
Okay.
Host 2
Because I think when a lot of people hear the words AI agent, they just think like chatbots.
Dharmesh Shah
Yeah, Right.
Host 2
But this seems like it's something totally different, right?
Dharmesh Shah
Yeah, you're right. It's way more than just a chatbot.
Host 2
Okay.
Dharmesh Shah
So think of it more like a digital teammate that can handle complex tasks. You know, things that require multiple steps.
Host 2
Gotcha.
Dharmesh Shah
So let's.
Host 2
Oh yeah, let's hear it.
Host 1
So when you're all talking about AI agents handling complex tasks, can you tell me more? Like, what are some examples of complex tasks AI agents could handle?
Dharmesh Shah
That's a great question, and it's helpful to get into some specifics.
Host 2
Yeah. Okay, so let's unpack this a bit.
Dharmesh Shah
So it's not just about simple one off tasks, like what a chatbot can do.
Host 2
Right.
Dharmesh Shah
Instead, think about things that require a sequence of steps, like planning a whole business trip. So an AI agent could handle booking flights, finding hotels, and making restaurant reservations.
Host 2
Wow.
Dharmesh Shah
Or in marketing, they could manage an entire social media campaign.
Host 2
Hmm. Like, what would that look like?
Dharmesh Shah
It could start with generating content, then scheduling posts, and even analyzing engagement.
Host 2
That's a lot more than just a. Oh, yeah.
Host 1
So I really am interested in that use case around an agent planning a trip that you just talked about. What specific tools or tool could I use to actually go and do that now?
Dharmesh Shah
Okay, that's a super practical question, and it's great. You want to try this out yourself?
Host 2
Yeah, let's get into that.
Dharmesh Shah
So while there isn't one single perfect tool that does everything end to end yet, there are some platforms that you could start experimenting with today.
Host 2
Okay.
Dharmesh Shah
For booking flights and hotels, some people are using tools that have integrated AI like Kayak or Expedia.
Host 2
Okay.
Dharmesh Shah
These tools can help you find the best Deals, and some even offer personalized suggestions based on your past trips.
Host 2
That makes sense.
Dharmesh Shah
Then for things like restaurant reservations, you could try using something like OpenTable or Racy, which also sometimes have AI features.
Host 2
Okay, so no like single AI agent to handle the entire process quite yet.
Dharmesh Shah
Not quite yet. But the idea is that these tools are already starting to become more intricate, connected, and as they get more sophisticated, they'll be able to work together more seamlessly.
Host 2
So it's like we're seeing the building blocks right now.
Dharmesh Shah
Exactly. It's like we're seeing the early versions of those multi agent networks that Dharmesh was talking about.
Host 2
Okay, that's a helpful analogy.
Dharmesh Shah
And while those specific trip planning tools are not fully AI agent based yet, they give you a good idea of how an AI agent could work.
Host 2
Yeah. It's cool to think that these types of tools are just going to keep evolving.
Dharmesh Shah
Right. And that's the exciting part of this whole field. It's all constantly changing.
Host 2
Okay, so now that we've talked a little about how trip planning could work, let's get back to the larger picture.
Dharmesh Shah
Yeah. And it is also important to note that these agents will improve as they work with you and learn your particulars.
Host 2
Oh yeah. Like learning your preferences over time to get better at their tasks.
Dharmesh Shah
Exactly. And so it's like you're delegating a whole project to a coworker, but it's a really efficient one.
Host 2
Exactly. Almost like they are a new member of your team.
Dharmesh Shah
And that's where this idea of hybrid teams that Dharmesh talks about comes in. He thinks that we're going to soon be working in these teams where you have humans and AI agents working together.
Host 2
Wow.
Dharmesh Shah
And each is going to play to their strengths. Now, thinking about marketing, this could mean having AI agents handle things like scheduling social media posts.
Host 2
Okay.
Dharmesh Shah
Or even personalizing email campaigns based on customer data.
Host 2
That makes sense.
Dharmesh Shah
And that frees up your human employees to focus more on strategy and the creative work.
Host 2
So they're kind of getting a taste of what these hybrid teams might look like.
Dharmesh Shah
Exactly. And maybe you could even try some.
Host 1
Yeah. So.
Host 2
Ah, yeah. Huh.
Host 1
I really like the conversation you're having about these hybrid teams and I'd love to understand what hybrid teams could look more like.
Dharmesh Shah
Okay. That's great feedback and we're glad you're finding this so interesting.
Host 2
Yeah. So let's dive deeper into this idea of hybrid teams.
Dharmesh Shah
Right. So you know how we were talking about AI agents taking over those repetitive tasks?
Host 2
Yeah. Like scheduling social media posts.
Dharmesh Shah
Exactly. Well, that Frees up human employees. Yep. Go on.
Host 1
Could you give me like, the five most repetitive tasks that AI agents could handle today?
Dharmesh Shah
Absolutely. That's a great question. And it's helpful to think about some of the specific tasks.
Host 2
Yeah, let's get into that.
Dharmesh Shah
So first up would be scheduling social media posts.
Host 2
Yeah, that definitely sounds repetitive.
Dharmesh Shah
AI agents can handle posting across different platforms.
Host 2
That's a great use case.
Dharmesh Shah
Second would be data entry and report generation.
Host 2
Yeah, that's super time consuming.
Dharmesh Shah
Agents can pull data and create basic.
Host 2
Reports on this guy's Hilarious guy's.
Dharmesh Shah
Just chime in. Third is sending out personalized email sequences.
Host 2
Ah, so they can nurture leads automatically.
Dharmesh Shah
Exactly. They can tailor the messages to different users.
Host 2
Okay.
Dharmesh Shah
Fourth, AI agents can also handle basic customer service inquiries.
Host 2
Yeah, like answering FAQs.
Dharmesh Shah
Right. This frees up human support staff for more complex issues.
Host 2
That makes sense.
Dharmesh Shah
And lastly, they could do AB testing of ad copy and images.
Host 2
Oh yeah, that's super repetitive for a human.
Dharmesh Shah
Exactly. They can try different variations and analyze the results.
Host 2
Wow, those are all really useful examples. Back to our listener.
Host 1
Could you tell me what tools I could go and use for those five examples that you just gave?
Dharmesh Shah
Okay, that's a very practical question and it's great you want to get your hands on some tools.
Host 2
Yeah. So let's dive into what you could use today.
Dharmesh Shah
So for scheduling social media posts, a lot of people are using tools like hootsuite or Buffer.
Host 2
Yeah, those are popular choices and pretty easy to use.
Dharmesh Shah
And then for data entry and reporting, you could check out tools like Tableau or Google Data Studio.
Host 2
Okay, so those are good for the analytics side of things.
Dharmesh Shah
Right. And when it comes to sending out personalized email sequences, Mailchimp and ActiveCampaign are great options.
Host 2
Yeah, those are some of the big players for email marketing and for handling.
Dharmesh Shah
Basic customer service inquiries platforms.
Host 1
Well, what about HubSpot for email marketing? I've heard they do a good job, obviously.
Dharmesh Shah
That's a great point. And it's worth exploring that option too.
Host 2
Yeah, we've talked about Dharmesh being the CTO of HubSpot.
Dharmesh Shah
And HubSpot does have its own market of automation tools.
Host 2
Yeah, it's a pretty popular platform.
Dharmesh Shah
So you could definitely use HubSpot for personalized email sequences, just like you could with Mailchimp or ActiveCampaign.
Host 2
And it can handle a lot of other marketing tasks too.
Host 1
So I think what's interesting here we just had a bunch of questions that we went back and forth with NotebookLM on. Is that how they've built this feature is that you are a listener and you're asking contextual questions in the moment. Like, you are jumping in, if you'll notice. Like, the very first thing I tried to do was to just use it as basically like a voice chat bot and just ask the question I wanted to know right off the top before it got into anything. And it was basically like, nope, nope, nope. We're gonna go ahead and play our script that we have, and when it comes to the point we're talking about that we can address your question. And if you're like me, it's like, I'm often watching a show on YouTube or I'm watching a podcast and I'm like, I just have a bunch of questions. I'm like, all right, that's cool, but like, I need the next level of detail, or what about this? And this experience is basically letting us do that. And I suspect at some point, not too far away, you'll be able to watch, like, your favorite podcast. And through AI and AI avatars, the hosts are going to be able to basically have an avatar and interact with you and go deeper on those individual questions, which would be pretty amazing. But right now, I think Google has built the best stack of products for research on the planet. Like, if you are trying to do great research, I think the combination of Google Gemini 1.5 with deep research and NotebookLM is unmatched for the ability to get a lot of information in one place. So Deep Research and then put that into NotebookLM and take any other sources and put that in NotebookLM, query that information, but also learn in the way that works best for you with this new Voice beta feature where you can actually interact with with the generated audio overview. And what's really cool is you can still go take and listen to the podcast, but just while you're working, if you're just listening in, you can just chime in with questions. And I think to me, where this shines is you can go from novice to a high level of expertise on a subject exceptionally fast. That's what we're talking about today. We're talking about how you go from knowing very, very little about something to to being a top 20% expert in knowledge in a topic in days or weeks, not months or years. And that is transformational in terms of your ability to find, access and process information. And these two tools have been awesome at it. I highly encourage you to go play with the new Notebook LM interactive audio feature. I find it to be one of the better voice AI features I've used so far, so I would go check that out. I think they've done a really good job and I would go and use Gemini Deep Research and a book alum together. If you were tackling any of your kind of getting the year kicked off projects where you're like, I'm just trying to learn to get up to speed. This is going to help you get started so much faster. Thanks everybody for tuning in today's episode. See you next time on Marketing it's the Grain.
Kip
Hey, it's Kip. If you listen to this podcast, you know how much I love keeping up with the latest and greatest in technology. But very few podcasts actually give you a dose of the future. The A16Z podcast is the exception. It's hosted by our friend and frequent guest Steph Smith. The chart topping show brings on movers with a track record of being both early and right, like Apple co founder Steve Wozniak, or the CISOs of OpenAI, Anthropic and DeepMind. Even the very first CTO of the CIA. From the science and the supply of GLP1s to drone delivery to the economics of deepfakes, go ahead and eavesdrop on the future. Check out the a16z podcast wherever you get your podcasts.
Title: How to do 10 hours of research in 20 minutes with AI (Gemini + NotebookLM)
Hosts: Kipp Bodnar (Host 1) & Kieran Flanagan (Host 2)
Guest: Dharmesh Shah, Co-founder of HubSpot and Agent AI
Release Date: January 14, 2025
Podcast Network: HubSpot Podcast Network
In this enlightening episode of Marketing Against The Grain, Kipp Bodnar and Kieran Flanagan delve into the transformative power of AI tools in marketing research and strategy. The hosts explore how integrating Google’s Gemini Deep Research with NotebookLM can revolutionize the way marketers conduct research, manage information, and implement AI-driven marketing strategies.
Google Gemini’s Deep Research
Kipp introduces the episode with an ambitious promise: transforming listeners into top-tier AI practitioners by stacking AI tools to create highly productive workflows. He demonstrates using Google Gemini's Deep Research feature to conduct comprehensive research on AI agents in marketing.
Kipp Bodnar [00:02]: "In using this workflow, I truly believe anybody can be an expert on a topic in minutes instead of days. And that's incredible."
By leveraging Gemini, Kipp showcases how the tool can research over 32 websites, compiling detailed and robust reports with proper attribution—all within approximately five minutes, a task that would traditionally take several hours.
Efficiency Gains
Kipp emphasizes the unprecedented efficiency gains provided by Gemini, highlighting how AI can surpass human capabilities in curating and synthesizing vast amounts of information rapidly.
Kipp Bodnar [00:02]: "It generates a report for me, and that took about five minutes before. That would have taken me five hours probably."
Adding Multiple Sources
Transitioning to NotebookLM, Kipp demonstrates how this tool serves as a dynamic repository for organizing research materials. He integrates Gemini’s deep research output with additional resources, including newsletters and YouTube interviews, enhancing the depth and breadth of his research notebook.
Utilizing NotebookLM’s Interactive Voice Feature
A standout feature discussed is NotebookLM’s newly introduced Interactive Voice capability. Kipp illustrates how users can generate audio overviews of their research, making information consumption more flexible and engaging.
Kipp Bodnar [09:40]: "What you'll see here is that it has put together a very detailed and very robust report with all these source topics... But I don't think it's actually as helpful as we'd want."
By generating a 23-minute audio overview, Kipp showcases how NotebookLM allows users to interact with and query their research in real-time, providing a seamless blend of reading and listening.
Conversation with Dharmesh Shah
The episode features an insightful conversation with Dharmesh Shah, Co-founder of HubSpot and Agent AI. Dharmesh provides expert perspectives on the evolution and application of AI agents in marketing.
Understanding AI Agents vs. Chatbots
Dharmesh clarifies the distinction between AI agents and traditional chatbots, emphasizing the former’s ability to handle complex, multi-step tasks beyond simple, one-off interactions.
Dharmesh Shah [11:25]: "Think of it more like a digital teammate that can handle complex tasks. You know, things that require multiple steps."
Capabilities of AI Agents
The discussion highlights several capabilities of AI agents, including:
Dharmesh Shah [12:06]: "In marketing, they could manage an entire social media campaign. It could start with generating content, then scheduling posts, and even analyzing engagement."
Delegating Tasks to AI Agents
Dharmesh introduces the concept of hybrid teams, where human marketers collaborate with AI agents. This synergy allows AI to handle repetitive and data-intensive tasks, freeing human team members to focus on strategic and creative endeavors.
Dharmesh Shah [14:03]: "Exactly. And that's where this idea of hybrid teams that Dharmesh talks about comes in. He thinks that we're going to soon be working in these teams where you have humans and AI agents working together."
Benefits in Marketing Strategies
This hybrid approach enhances efficiency and innovation in marketing strategies by leveraging the strengths of both humans and AI agents.
Kipp Bodnar [20:21]: "This is going to help you get started so much faster."
Dharmesh outlines specific tools and applications where AI agents can streamline marketing operations:
Scheduling Social Media Posts
Data Entry and Report Generation
Personalized Email Sequences
Customer Service Inquiries
AB Testing of Ad Copy and Images
Dharmesh Shah [15:17]: "AI agents can handle posting across different platforms... They can tailor the messages to different users."
Kipp wraps up the episode by reiterating the transformative potential of integrating Google Gemini Deep Research with NotebookLM. He highlights how these tools collectively empower marketers to rapidly ascend from novice to expert in various domains, significantly enhancing their research capabilities and strategic implementation.
Kipp Bodnar [20:21]: "These two tools have been awesome at it. I highly encourage you to go play with the new NotebookLM interactive audio feature."
Kieran and Kipp encourage listeners to explore these AI tools to kickstart their projects, emphasizing the speed and efficiency gains that can redefine marketing practices.
This episode of Marketing Against The Grain offers a comprehensive exploration of how modern AI tools like Gemini and NotebookLM are reshaping the marketing landscape. By automating complex tasks, enhancing research capabilities, and fostering hybrid human-AI teams, marketers can achieve unprecedented levels of efficiency and creativity. The insights shared by Dharmesh Shah provide a forward-looking perspective on the evolving role of AI agents in marketing, making this episode a must-listen for marketing professionals eager to stay ahead of the curve.
For more insights and episodes, subscribe to the Marketing Against The Grain podcast on your preferred platform.