
Building great AR glasses is the hardest problem in consumer technology.
Loading summary
Vanta Ad Speaker
Whether you're starting or scaling your company's security program, demonstrating top notch security practices and establishing trust is more important than ever. Vanta automates compliance for SoC2, ISO 27001 and more. With Vanta, you can streamline security reviews by automating questionnaires and demonstrating your security posture with a customer facing Trust Center. Over 7,000 global companies use Vanta to manage risk and prove security in real time. Get $1,000 off vanta when you go to vanta.comhardfork that's vanta.comhardfork for $1,000 off now.
Kevin Roos
Casey, I had a very weird thing happen to me last weekend, which is that Netflix released a documentary that I was in. So this was something that I taped like two years ago, had basically no memory of, but it was with Bill Gates and it's about AI.
Casey Newton
I remember when you told me that you were going to do this and it seemed like it was an exciting thing cause it was gonna be a documentary and they were gonna put it on Netflix.
Kevin Roos
Yeah. All of a sudden I started getting texts from people I know with screenshots of their Netflix where my face was the first thing that they saw when they logged into Netflix. Like the big hero image on top of the thing.
Casey Newton
Right, but. Except it wasn't really your face, was it?
Kevin Roos
No, it was my AI face. Because in the process of taping this thing two years ago, I made like a joke, what I thought was a joke to the producers, but they were sort of like asking me, do you want hair and makeup? And I said no, because you can just use AI to make me. And they kept that in and then they actually did make me hot using AI. So there's like a portion of the documentary where it just cuts to an AI version of me, but I am hot. And the lower third graphic says Hot Kevin Roos. And that is what my friends and family members were greeted with when they opened Netflix.
Casey Newton
You know what this reminds me of?
Kevin Roos
What's that?
Casey Newton
In my 20s, I had a group of friends and there was this other guy named Casey who kind of came into the friend group and they started calling him Hot Casey because he was super good looking. And I was kind of looking around like, guy, do we have to call this guy Hot Casey? And what one of my friends said to me was like, it could be worse. They could be calling him okay looking Casey.
Kevin Roos
That's true. I guess Netflix could have titled that character like Marginally Attractive Kevin.
Casey Newton
Barely Passable Kevin Roos.
Kevin Roos
Kevin. I'm Kevin Roos. A Tech columnist at the New York Times.
Casey Newton
I'm Casey Newton from Platformer, and this is Hard Fork. This week I go down to Meta Connect and tell Kevin about all the news. Then writer and Googler Steven Johnson stops by to talk about the company's hit notebook LM and how it's using AI to turn PDFs into podcasts. Finally has the Hat. It's time for Hat GPT.
Kevin Roos
All right, Casey.
Casey Newton
Yes.
Kevin Roos
You just got back to the studio from a trip to Menlo Park. Yes, to see some stuff that Meta was releasing.
Casey Newton
I'm coming in hot, Kevin. Yeah, I hot footed it right out of that keynote to get here to the studio to tell you about all the latest advancements in the dynamic world of artificial intelligence and augmented reality glasses.
Kevin Roos
Okay, so set the scene a little bit. What is it like down there? What's the vibe? Tell me what you saw.
Casey Newton
The scene at Meta's campus was truly chaos, and I think not in the way they anticipated. You know, we've been to many of these events. Typically when you arrive, you really only look in for two things, which is like where does the ride share drop you off and how do you get into the actual venue? And usually the way they do that is they have a person standing there and then they also have signs. Meta, for whatever reason, decided not to do this. And so people are just sort of wandering around like the duck in Are you my mother? And it took me quite a while to get into the venue and when I finally found what I was looking for after, by the way, talking to several Meta employees who, when I asked where Connect was, seemed to have no idea that it was happening. That day I got a text from a friend who said that there just been an accident in the parking lot because their shuttle had hit a car. So let's just say it got off to a little bit of rough start.
Kevin Roos
Yeah, yeah. And I. My invite to Meta Connect must have gotten lost in the mail.
Casey Newton
Lost in the metaverse.
Kevin Roos
Yeah, yeah. They actually sent it as a Facebook message, but no one has checked those since 2018. No. So I. You know, I am not their favorite journalist. I've been critical of the company. They don't invite me to stuff anymore. But you did get an invite and you hustled your way down there to see what they had to show off.
Casey Newton
I did.
Kevin Roos
And tell me what you saw.
Casey Newton
Well, first of all, should we talk about Zuckerberg?
Kevin Roos
Yes.
Casey Newton
Yeah. Well, so this is the second time in the past month that I've seen Zuckerberg speak, and both times he has worn a shirt emblazoned with a classical language slogan. So he was at the acquired podcast a few weeks back and wore this shirt that said in Greek, learning through suffering, which he had said was sort of a family motto. And as we know, this is a person who is obsessed with the Roman Empire. That is just kind of something that we've known about Zuckerberg for a while.
Kevin Roos
So, yes, he's very into Conquest.
Casey Newton
Loves Conquest. His favorite video game is Civilization. Like, this man loves to sort of scheme about winning. So Zuckerberg walks out on stage on Wednesday, and he's wearing a shirt that says, out Zuck, out Nihil. And what this shirt apparently means, Kevin, because I don't speak Latin. Do you speak Latin?
Kevin Roos
I speak pig Latin.
Casey Newton
Same here. But this is not a pig Latin shirt.
Kevin Roos
Didn't say Unckerberg Zay.
Casey Newton
I didn't know.
Steven Johnson
He said.
Kevin Roos
This is going off. We're off to a hot today.
Casey Newton
We are coming in hot. Okay. This can apparently be translated a few ways. It is based on a motto, which was out Caesar, out Nihil, which was typically translated as, like, either Caesar or nothing, or all or nothing. But the basic idea seems to be either one that he's sort of putting it on the line, sort of win at all costs, or sort of less generously. It's like me or nothing, which is, let's just say, a crazy thing to put on a T shirt.
Kevin Roos
Yeah, it's. Well, it makes me think that one of his other motives here is since he's gotten rid of his Julius Caesar haircut, he needs to sort of keep some connection to Caesar and his legacy.
Casey Newton
If I were him, I would just make a nice Caesar salad. But I guess that wasn't part of his journey. So he comes out in the shirt, and I thought that the slogan actually wound up being really apt in this regard. He spoke for around 40 minutes, and during that time, he brought out two, like, creator types, basically. Like, one was an MMA fighter, and one was a sort of more standard creator who, like, makes cool, fun videos. But that was it. He did not bring out anyone else from his team. You know, he did not toss to any of the other people who work at the company on any of this stuff. He himself walked through all of the announcements in a way that really, I feel like was trying to sell the message. I run this company, and I am the Willy Wonka of meta, and don't you forget it.
Kevin Roos
Yeah, it's suck or nothing. Yeah.
Casey Newton
Which I felt was, like, really aggressive and weird and defensive. Right. It's like it would be weird if Tim Cook did the entire Apple presentation, right?
Kevin Roos
Yeah.
Casey Newton
Yeah.
Kevin Roos
Okay. Aside from the sort of, you know, semiotics of Mark Zuckerberg appearing in this Caesar homage T shirt and not letting anyone else onto the stage with him, what else did he actually announce? What were the products and the sort of updates that they released? Sure.
Casey Newton
So I'll sort of do these in ascending order of importance if that works. Okay. So first of all, they have.
Kevin Roos
It's like they always say start with the most boring stuff when you're doing a podcast.
Casey Newton
Well, I feel like if we do the reverse, then the episode gets more boring the longer I go on. Do we want that?
Kevin Roos
I trust your vision.
Casey Newton
Okay. So I trust your vision, which is something that you shouldn't do if you're wearing a VR headset because you're being lied to. So the first thing they introduced is the Meta Quest 3s. This is an entry level headset and it sells for 300 bucks. And until this weekend, Meta's original Quest 3 was selling for $650. So this is sort of a big step down. They want to get more people into VR. We'll see if that works. They also put out a software update for their Ray Ban Meta smart glasses. And they're able to do things like you can set a reminder or you can scan a QR code. And later this year they say you're going to be able to do real time language translation. So you could be speaking to me in pig Latin and then I would be able to understand it because I would sort of be getting a real time translation through the speaker in the.
Kevin Roos
Arms of the glasses at they and say, interesting. Yay.
Casey Newton
Yes. So if you were able to understand that, you're probably living in the future because you have the new glasses update. So there were those things and then there was just like a bunch of AI stuff, including most interestingly. And I have to get your take on this. They're going to start putting fake AI slop into the feeds. Did you see this part?
Kevin Roos
No.
Casey Newton
Okay, so now they say it's just a test, but as you browse through the Facebook feed and the Instagram feed, in the coming months, you're going to see stuff that is based on your interests or has your likeness. So if you live in Chicago and you've posted content about basketball, you might see a picture of yourself in a Chicago Bulls jersey, and then you can swipe on it and you can see sort of additional like you plus Chicago Bulls related content and I'm dying to know what you think about that.
Kevin Roos
So, sorry, are these ads for like Chicago Bulls merchandise? These are, these are just organic posts appearing in the feed starring you, the user, in something related to something that you've posted about or clicked on recently.
Casey Newton
Exactly, exactly. So they're looking about what you're, you're posting about or the sort of things that you typically view. And they're saying, can we make synthetic stuff out of that and show it to you? And will that be more engaging to you than hearing from your actual family and friends?
Kevin Roos
Oh my God. I mean, this is the creepiest thing that I can imagine them doing. Like, people already believe erroneously that Facebook is listening to them through their phone and like tailoring targeted ads to them based on like conversations they've had in their house. With this, I mean, imagine you are talking about phishing with your friend and you know, all of a sudden, because you've clicked on some fishing stuff, you're just scrolling through your Instagram feed and you see a picture of yourself in a fishing outfit going fishing. Like you are going to throw your phone into the nearest body of water and you're never going to log on again.
Casey Newton
I mean, again. And so I talked this afternoon with Chris Cox, who's a sort of high ranking product executive at the company, and he said basically like Casey, like, do not overstate this, we're going to be very gentle about the way that we are rolling this out. And yet at the same time, Kevin, a year ago I wrote a post called the Synthetic Social Network Is Coming. And it was based on this idea that eventually they were going to realize they could probably show you something, something more engaging that they just made up than something from your actual family and friends. And while I'm sure there will always be a mix of those two things in anything that they make, we are arriving in this world where the app on your phone is just going to be showing you made up AI stuff.
Kevin Roos
Yeah, I think this is a really good point because it marks a really big departure for meta. You know, this company has historically been about connecting you to people that you know in the real world, whether it's your college classmates or, you know, people you work with, like real friends and real family has always been the kind of lifeblood of these services. And I think what we've seen over the past few years is that they are just not aiming for that at all. I mean, now, you know, I'm assuming some huge part of the usage of Instagram is just reels, right? It's just, you know, content from people you don't know, from influencers, from, you know, people outside your network who are posting stuff. It seems like they have basically given up on the task of building a social network around your real friends and family. Maybe your real friends and family don't post that much anymore. And so in instead, all they have left to show you is kind of disconnected social content from influencers and people who you don't know, but might make interesting things. And this kind of AI generated slop.
Casey Newton
Yeah. And, you know, I'm sure people are going to have different experiences based on when they started using these products, but for you and I, who started using Facebook in particular near the beginning, this world where we increasingly see nothing that friends and family are sharing because they're just mostly not doing that anymore, and we're seeing sort of AI generated images and videos, I just think Facebook is going to start to feel like an abandoned amusement park, you know, where it's like a little bit creepy. You know, you feel like they're about to put a spirit Halloween banner at the front of it. Like, it. There's just something that feels so strange about this moment. And while I take Chris Cox at his word that they are going to be careful about the way that they do us, they're telling us where they're going. And I have no reason to believe that they're not going to push very hard in that direction, because for the longest time, the biggest problem that social networks have is that they just kind of die by default. They're novel and fun for a while, and then people just kind of get tired of them and they move on. And, you know, Facebook did an incredible job of keeping people entertained there for a very long time. But if that is starting to wane, particularly in the United States, what better solution than to say, you know what, it doesn't matter that your friends and family aren't posting anymore, because we could just make up infinite content to show you, and Facebook and Instagram become apps that are just about whatever will keep you looking at them.
Kevin Roos
All right, what else did they show off?
Casey Newton
Yeah. So this gets to the last big thing that they showed off, and this really was the star of the show, and it's called Orion. Now, last week, Snap showed off their version of this, their latest spectacles. These are augmented reality glasses. And the basic idea is that inside a pair of glasses that you wear on your heads, there are these miniature projectors called waveguides that will project images in front of you that look like a computer Operating system. And you can then interact with that operating system using your voice or using hand gestures. So you might use it to watch a video or play a game or make a video call. So I saw the Snap version of it last week. This week, Meta came forward and said, here's what we've been working on. And as far as I can tell, Meta is much further along than Snap is.
Kevin Roos
Yeah, when I saw Snap's version, I almost couldn't believe how ugly it was. It looked like the sunglasses that they give you after you go to the eye doctor. It's like the blocky plastic sort of goggles.
Casey Newton
Yes.
Kevin Roos
That's what Snap's goggles look like from the outside. I haven't tried them on yet, so I don't know what they look like when you put them on. But did Meta's version of this? They're Orion glasses actually look better.
Casey Newton
They are chunky and funky like the Snap glasses are. I'll sort of leave it to the listener to decide which pair they think looks better. But it seems like the technical capability in these glasses is stronger, at least in talking to some of the people who have used them and reading some of the coverage today. I'm hoping to get my own demo soon. But, for example, the field of view, which is essentially the area in your vision that can display the operating system or any sort of digital elements that you might be interacting. The Snap glasses have a field of view that is 46 degrees. And this, to me, was the worst thing about these glasses, Kevin, because every time I move my head, the interface would disappear. It was like I was playing peekaboo with an operating system.
Kevin Roos
Right.
Casey Newton
The Meta field of view is 70 degrees. And so most of the objects that you would be interacting with just sort of stay in the frame for a long time.
Kevin Roos
Now, like what I'm envisioning something like the Apple Vision Pro, which does allow you to do things like pull up your desktop in your sort of headset or play a video or something like that. So how are these different from something like the Apple Vision Pro?
Casey Newton
So those technologies are similar in some ways. Right. They are trying to get to the same destination. But there is a belief within Meta that glasses are a much better and more natural ultimate form factor for the next generation of computing than a VR headset would be. And the reason is that a VR headset is giant. It's bulky, it's distracting. Right. You're sort of always aware that you're wearing it. And in my own personal experience, whenever I put one of those things on my head within a half an hour or so, I want to tear it off and not put it on again for a really long time. Glasses are different. You're wearing glasses right now. My guess is you have not even thought about the fact that you're wearing glasses for the past half hour.
Kevin Roos
Yeah, well, I am watching a YouTube video while I'm talking with you in my glasses. But these are very advanced.
Casey Newton
How dare you. How dare you. So Meta believes that the final destination here is glasses that are as good at everything that the Vision Pro does, but in a sort of pair of lenses that sit easily on your face, are not bulky, do not make you nauseous. So that's. That's where they're trying to get now.
Kevin Roos
Can people go out and buy these glasses that Meta is showing off, these Orion augmented reality goggles?
Casey Newton
No. So Meta has made about 1,000 units and says that they're going to be mostly using them internally, but they are going to make some units available to external partners, presumably app developers and other people who might want to try them out and see what they could do with them. But, you know, Kevin, if you want to know, why aren't they selling this directly to consumers? Alex Heath has had some great reporting in the Verge this week about how Meta did initially want to put these things on sale, but among other considerations, they could not get the cost per unit below about $10,000. Oh, my God, Kevin, I know what you're saying. You're saying, kasey, why are they so expensive? Well, these glasses are not truly standalone glasses, which I should say the snap glasses are. This prototype has what they call a neural wristband, which is a little loop that you put over your wrist that helps the glasses to interpret your hand gestures so that you can control the operating system. And there's an external puck that processes a lot of the computing because, like a hockey puck, it's sort of more tube like and, oh, the two puck. You know what, you're actually making a great point. And if I were them, I would not have called it a puck. If you try to play hockey with this thing, you're going to be sorry.
Kevin Roos
Also, it costs $10,000, so please don't hit it.
Casey Newton
Such a good point.
Kevin Roos
So, okay, so they're sort of offloading some of the. Because, you know, one thing that Apple has talked about is just how hard it is to shrink down something like the Apple Vision Pro smaller than it is because it requires a bunch of processors, it requires a big battery. So Apple actually made battery pack sort of External, so you have to carry that around and it requires cooling and all this other stuff. So is this puck part of how meta is trying to shrink down the actual glasses by just giving you more things that you have to carry along with the glasses?
Casey Newton
Yeah, so you're exactly right. And it's again, it's fascinating how a device that is being positioned as something that will be more convenient for you and will be this incredible assistant, and so much more effortless than wearing a giant headset that comes with a wristband that presumably you've got to charge and a puck that you've got to charge. Right? It's, you know, you have two peripherals for the pair of glasses on your face. So, you know, I've just been reflecting recently, Kevin, about how this story that we're discussing right now, the hunt to build great AR glasses, has been going on for more than a decade now in Silicon Valley. And this week we saw the state of the art. And the state of the art is it costs $10,000. You have to have a peripheral to control it, and you have to do the computing on a separate device. Okay. And that is after tens of billions of dollars that have been invested. And you just compare that to something like artificial intelligence, which we talk about so much on this show, and you look at the leaps that they have made in the past two or three years, and I believe it has left us in a situation where what we've just been discussing, the hunt to build these air glasses, is the hardest problem in consumer technology.
Kevin Roos
I mean, to be fair, the building and training of large AI language models has also required tens of billions of dollars of investment in all of these GPUs from Nvidia. So in some sense, like there was no sort of cheap and easy way to solve the problem of putting a high performance computer on your face.
Casey Newton
Right. And that gets into, well, you know, why is it that these things have developed at such different rates?
Kevin Roos
And why is it, Kasey, that these things have developed at such different rates?
Casey Newton
I'm so glad you asked. AI is a pure software problem. The hardware problem of AR is just much trickier because you're running up against the laws of physics and about unsolved problems in battery life and how do you dissipate heat and how do you shrink down microprocessors and optical stacks and everything else. And so it is just a super hard problem. And while every year it seems like we get 2 or 3% of the way toward the goal, at the same time, again, the state of the Art is something that you will not be able to buy in stores and like, Frank would just not be all that good if you could.
Kevin Roos
Yeah. So I understood when Apple launched the Apple Vision Pro why they were making products in this area. Right, because they knew they could trick.
Casey Newton
You into spending almost $4,000 on one.
Kevin Roos
Yes. Well, no, they're a hardware company. Right. That is where they make their money. They know that smartphones are not going to be around forever, the iPhone is not going to be the final evolution of, of personal computing, and they see these head mounted displays as kind of the successor to maybe something like the laptop. What's less clear to me is why Meta is investing tens of billions of dollars into developing this stuff. Right. There's obviously one story that we've talked about before, which is they're very sick of building things on Apple's platforms. They don't like having to work within the constraints that iOS developers have to work on. So they want to own the next hardware platform. But I guess I don't see it as being a natural evolution of their social media app product strategy. So can you give any sense of why they feel like this is so important for them that they're going to spend billions of dollars developing these glasses?
Casey Newton
Well, the ultimate reason is that they believe that if they don't, someone else will. And this has always been Zuckerberg's approach to building products. Right. He is deeply paranoid, you know, and not in a sort of conspiratorial, but just in a sort of very observant sense that when you look at the technology companies of the past 50 years, you know, the companies that were biggest 40 years ago, many of them are no longer around or are nowhere near as dominant as they once were. Right. So Zuckerberg knows there's always a wave that is about to hit you and potentially from behind. And the best way to avoid that happening is that you go out and you invent the future yourself. You know, you mentioned their feud with Apple and this is, it's deeply personal to him. He mentions it more and more in his public appearances. Is, and you know, you saw the shirt, it's Zuck or nothing. And a Zuck or nothing world does not have room for Apple in it. And it is a world where Mark Zuckerberg himself controls all of the most important computing platforms. So, you know, to find out how things are going, we'll just have to see what slogan appears on his next T shirt when we cut back a version of the note book with a much happier ending.
US Bank Ad Speaker
This podcast is supported by US Bank. At US bank, when they say they're in it with you, they mean it. Not just for the good stuff, the grand openings and celebrations, although those are pretty great. But for all the hard work it took to get there. Because together they're proving day in and day out that there is nothing as powerful as the power of us. Visit usbank.com to get started today. Equal Housing Lender Member FDIC it's another wild weeknight.
Vanta Ad Speaker
So you pick an easy New York Times cooking sheet pan recipe. But when you open the pantry, no onions, and as usual, somehow you're low on olive oil. With Instacart, there's another way where quality ingredients don't require a road trip, where the contents of your pantry don't define your meal, where you can click Shop ingredients on Instacart on New York Times cooking recipes for delivery in as fast as 30 minutes. Learn more at nytcooking.com Instacart that's nytcooking.com InstaCart.
Kevin Roos
Well, Kasey, we talk a lot about AI tools and products on this show, and I have one that I'm really excited to talk about today.
Casey Newton
Yeah, excited to talk about this, too.
Kevin Roos
This is a new product called Notebook lm. It is a tool from Google and you can think of it like a kind of personal research assistant. It's a piece of software that allows you to upload documents, PDFs, Word files, even audio files, websites, whatever you want into these things called Notebooks, and then use Gemini, Google's AI model, to basically chat with the documents, to sort of have a conversation, to ask questions, to create study guides or summaries. You can even use it it to create a podcast about the material that you've uploaded.
Casey Newton
Yeah, and you know, this was a product that was announced at Google I O. They called it Project Tailwind back then, and from the moment I saw them talking about it on stage, I thought, I have got to get my hands on this thing. And while it is true that you can use other tools to chat with documents, that is not unique to Notebook lm. They have really focused on making sure that you can cram as much material as possible into their system so that you can have conversations with not only one very long document, but many very long documents. And that has really been the difference for them. But as you note, they recently came out with something that is maybe even more impressive.
Kevin Roos
Yeah, the AI Audio Overviews feature is really what has been sort of lighting up the Internet over the past week or so, like, I'll just be honest, we see a lot of AI products. We get a lot of early access and demos of things and many times they show some potential, but if you actually start digging in, they are not all that useful or they hallucinate or they're just not reliable enough to be useful for people like you and me. Notebook LM is, I would say, one of my favorite AI products that I have used this year because it is not trying to do everything for everyone. It is a tool for research, for writing. It is really, really capable at what it does. And the audio feature in particular is just pretty stunning. So today we're going to bring in one of the key people who helped conceive of and build Notebook lm. Steven John. Stephen's path to working at Google is pretty unusual. His main career, the thing that he's most known for, is a writer. He has written for many years for the New York Times and New York Times Magazine and other places. He's the author of more than a dozen books, including his latest, the Infernal A True Story of Dynamite Terror and the Rise of the Modern Detective. And he's been one of my favorite writers about tech and the future. And a few years ago Google approached him and basically said, hey, want to help us make a tool for writers?
Casey Newton
Yeah. And you know, I got to know Steven a little bit as they were launching Notebook LM and we met and he told me all about his note taking process and how he wanted to use AI to sort of improve his writing. And we truly just became fast friends because we have the exact same view of this stuff, which is give me the most technology to make my job as easy as it possibly can be. And unlike me, he's now actually working inside this company trying to make something that does just that.
Kevin Roos
Yeah. And why haven't you written 14 books? Remind me.
Casey Newton
Well, you know, I've been busy lately, Kevin, but I'm going to get around to it one of these days.
Kevin Roos
Let's bring in Stephen. Stephen Johnson. Welcome to Hard Fork, guys.
Steven Johnson
It's great to be here.
Casey Newton
Hey, Stephen.
Kevin Roos
So, Stephen, I remember reading a piece you wrote for the New York Times Magazine back in April of 2022. It was about six months before ChatGPT came out and you had this big great piece about how AI was starting to get really good at language through these new things called large language models and your sort of predictions about how that would have all kinds of profound effects on society. But I remember that piece so vividly because it captured this Feeling that I was having at the time, which Casey now has started calling AI Vertigo. Basically this sort of head spinning sensation when things are just moving so quickly. But I'm curious, like what got you as a writer interested in AI to the point that you decided to sort of build AI products at Google?
Steven Johnson
You know, I just have spent all of my career as a writer always dabbling with tools to help me do the writing with all the latest software. Like Casey and I have this kind of shared obsession with note taking software.
Casey Newton
Oh, you're one of those.
Steven Johnson
I know. Don't even get me started about Scrivener and all the different things that we can talk about. But I always saw the computer and software as a kind of companion and a kind of brainstorming partner. And I was always pushing the technology to do that in my own work. And so the idea that I could just kind of say, hey, let's think out loud about this particular topic and it would understand on some level and respond with coherent sentences. Now obviously there are hallucinations and there are all the things that we know are problems, which I also wrote about in that piece. But it was clear that some new set of doors of possibility had just opened up for the first time. And I just got really interested in walking through those doors.
Casey Newton
So how does Google first approach you? And is the idea, hey, we want to make a tool for writers like you, or was it something else?
Steven Johnson
Yeah, it was a little bit like that. So Google had just spun up right around this time a new division called Google Labs. There was an old Google Labs, this is kind of a new iteration of it. And there was a guy running it named Clay Bevor who's since left and now Josh Woodward is running it. And Clay and Josh had this idea that Google Labs could be a space where you could do kind of product focused experimentation with new emerging technologies. And they also had this idea that there would be co creation would be built into the kind of ethos of Labs. And so if you were making a music product, you would have a musician in the room like as you were building it. So it wasn't just about we're going to go out and do some user research with musicians. We're actually going to have somebody through the life of the product there. And so they were just kind of cooking up these ideas. And they had both read my books over the years, they'd read that Times piece, they read my substack and and all that together caused them to think, wonder if Steven could be the first kind of guinea Pig for this.
Casey Newton
So, Stephen, you and I have had a chance to chat before, and I truly aspire to be the note taker that you are, because I have talked a big game on this podcast about how I'm trying to write down sort of every interesting, like, quote or idea that I come across and link those together. And I've made some strides there. But, like, you showed me your system at one point and it is the real deal. Like, you truly have been keeping track of every idea that you've come across for seemingly quite some time. What was the moment that you said? Oh, like this intersects with AI in a way that maybe this notebook LM can realize in a product.
Steven Johnson
I want you to remember, Kevin, that every time you think that Casey is such a super nerd with his note taking, like, there are even more deranged.
Kevin Roos
People in the world, you are the alpha nerd of the note taking community.
Steven Johnson
So, yeah, I can tell you exactly what it was. So I have been collecting quotations from books that I've read initially by typing them up in the late 90s. And then once ebooks came out, you could save quotes and things like that. It was an amazing program that I think you used called readwise, that lets you organize all your quotes from if you read on the Kindle or any other ebook. And so I have something like 8,000 quotes from books that date back to the late 90s that I've collected. And that is really the history of all the ideas that really shaped who I am. Right. Like my mental model of the world is shaped by the other ideas that I've read from other people. And so Notebook now lets you have up to 25 million words in a single notebook.
Kevin Roos
Put that in terms of pages. How many pages is that?
Steven Johnson
What would that be? That would be like 40 books. Yeah, right. Something in that order.
Casey Newton
And do your 8,000 quotes fit in one of these 25 million word documents?
Steven Johnson
Yeah, yeah. They're only about 3 million words, so I loaded them all in as, you know, a bunch of documents.
Casey Newton
So 30 years of collecting quotes fits easily into one of these things.
Kevin Roos
Yes.
Steven Johnson
And what I'm slowly adding to that notebook is all the stuff that I've written too. So it's kind of everything I've read that's important. And literally every word I've published is eventually going to be in that one notebook I just haven't gotten.
Casey Newton
Kevin can't do that because it would poison the data set. But I think it's good it works for you.
Steven Johnson
The safety flags that would be Going off, it'd be terrible. So when I was able to do that, which was really, I don't know, about a year ago, for the first time where I could get all that stuff in there, I call that notebook my everything notebook. And then I could sit down and just be like, I'm thinking about writing a piece about X. Or here's a paragraph from the piece that I've just written. What am I missing? What am I forgetting? Giving an overview of all the stuff that I've read that is related to this particular topic. And it would return particularly once we switch to Gemini. Gemini was the big paradigm shift. Here I get this incredibly nuanced response that is constantly reminding me of things that I forgot gotten. And now, as of like three months ago, we have inline citations in all the comments from the model and you can click on each citation and it takes you directly to the original quote.
Kevin Roos
Yes. I love this feature. I've been playing around with Notebook lm and it is truly one of the best features about it is that it'll show you something, you're talking to it about something you've read or something you've written, and it just has that little sort of, like, citation. You click on it, it takes you right to the source material. So you can see for yourself. Like, this actually, actually is an accurate representation of what was in the PDF I uploaded.
Steven Johnson
And, you know, like, what an incredibly interesting, like, learning mode that is, right? Like, up until now, if you wanted to have a conversation with the material in a book, like, you had to find the author, or you had to find a tutor or an expert who knew the material really well, and those people are in scarce supply. But now you can actually, like, load in the book and navigate it through conversation and dialogue with which is a form that people really obviously like to use.
Casey Newton
So that is amazing and I think will probably be the primary way that people access it. But because of the fact that you have taken these notes for 30 years, you're able to use this in this different way, which is essentially like, take me through my own intellectual history and let me talk to the entire, like, course of learning that I've had over three decades. Remind me of things, right? Or make new connections for me. And that feels like the kind of augmentation that I truly have always wanted AI to give us, right? Like, that is the good stuff, right?
Steven Johnson
I'm glad you said that. That means a lot coming from you. I think there was an early tension in creating Notebook LLM, which was the question of, like, how Normal, am I? You know, we have this amazing colleague, Roisa Martin, who's the product manager, who's been incredible, was on it from the beginning. And I think like, you know, she, she was kind of like, this has to work for people who don't collect 8,000 quotations over 30 years of their lives, right, if it doesn't work for them. But I think one of the things that we've learned is you actually, particularly in a digital age, you can import docs and slides. And so if you're a Google Drive user, the history of all the docs you have in there is actually a history of the last four or five years of things that you've been interested in and that you've been working on, whatever your job is. And so one of the things I often tell people with NotebookLM is just first thing to do is create a notebook. If you are a drive user, grab the last 20 docs in there and just don't even think about organizing them, just dump them all in, even if they're for different projects, and then just start having a conversation. And the sense of, oh, this AI actually knows what I'm doing and understands what I've been working on and can piece together kind of, you know, insights from that is pretty amazing. And by the way, I should say, say, when we do this, we're not training the model.
Kevin Roos
That was one of my questions is like, I think a lot of people would say, okay, well if I upload a copy of my book or some documents that are personal to me, is Google going to then be able to sort of see and train on that material?
Steven Johnson
So what we are doing is not training the model. That would take a long time to train a model on your data and it actually wouldn't, for complicated reasons work as well as the way that we're doing it. We're just taking the information you have and putting it in the model's context window, which is kind of like the short term memory of the model. It's the easiest way to understand, understand it. And the beauty of that is one, the model is much more accurate with information in its context. And so the hallucination rates drop down dramatically. You can do things like citations that you wouldn't be able to do otherwise. But it also means that the second you close your session, that information goes away. And so there's no way for we're not learning from it, we're not making the model smarter in the long run. And there's no way for that information to kind of leak out into other users. And that has been a fundamental principle of the product from the very beginning.
Kevin Roos
Yeah. I hope you take this next thing that I'm about to say the right way, because I do mean it as a compliment. But Notebook LM strikes me as an extremely un. Googly product. Right. It is probably not the kind of thing that's going to get a billion users, which is how Google has historically decided what to build. It didn't have like a big splashy launch with ads running on the Olympics. It's not sort of promoted on a bunch of other Google products. As far as I can tell. It has a Discord server and the design of the actual tool just feels different than a lot of what Google has built in AI. It sort of feels to me like it might be this kind of isolated, kind of semi autonomous region within Google that doesn't have that much contact with the rest of the company. Is that right?
Steven Johnson
Well, that's an interesting question. Some of that is right and some of that is a reflection of what Labs set out to do.
Kevin Roos
Right.
Steven Johnson
Which is to like, let's create. Create a space where we can be more comfortable with being experimental. And that enabled us to do some things like experiment with different types of interfaces that would not necessarily have the polish that you would expect from other Google official products. The Discord is a great example. That was one of Riser Martin's ideas. We just wanted to build a community around it. And I remember Ryza coming to me and saying, you know, I want to build a Discord for this product. And I said, what is a Discord? I had no. My kids were Discord users, so it rang a bell. But I'd never been on Discord before and now I'm in there all the time. And we have like 45,000 people who are members of this community now and we just discover so many things from them. Like, it's like Notebook is taking off with D and D players, like Dungeons and Dragons, like Dungeon Masters, because they have. It's a very like literary genre of game. Right. And you have these long campaigns with like rich lore.
Casey Newton
Yeah, yeah, yeah.
Steven Johnson
And same thing with like fantasy novelists and sci fi novelists where they have a backstory that's enormous and they can't keep track of it all. Like, if George R.R. martin would adopt our product, like we would. We would have.
Casey Newton
We would see the winds of winter.
Kevin Roos
Yes. Maybe we could actually get a new book. I spent some time in the. In the Notebook LM Discord. It's a very fun place oh, good.
Casey Newton
Yeah.
Kevin Roos
Because you get to sort of see how people are using it and sort of get ideas. I also love that there's one person in there who's just constantly posting about how they're using notebook LM to analyze a huge database of Sonic the Hedgehog fan fiction. You know what I'm talking about?
Steven Johnson
They've been there for a while. It's really interesting. They, they found a lot of use cases for Sonic related work, and they're.
Casey Newton
Going to be on the show next week. But you know what, Kevin, I want to disagree with you about whether this is googly or not, because I think this is like old school Google and this is the Google I like. Like, do you remember back in the day when the Googlers could just do anything they wanted in their 20% time, give them a day, a week to be like, hack around on something. Right. Do something interesting? To me, this is the sort of thing that would come out of 20% time where it's like, let's find some of the, you know, the biggest. Everyone at Google is a nerd, but let's find people who are nerdy about something really in particular that could be massively useful to maybe a narrow group of people. And maybe we find something in there that, who knows, does scale up to a billion people eventually.
Kevin Roos
Yeah.
Casey Newton
But maybe we should talk about the audio, Kevin.
Kevin Roos
Yes, we have to talk about the audio feature because this is what really has put this tool on the map for a lot of people. This is an amazing feature. The first time I saw it, I did have a moment of AI Vertigo, and I think I emailed you and was like, oh, my God, what is this thing? How is this feature so good? How does it work? What is it trained on? How did it learn how to do podcast banter? Just tell us about this feature.
Steven Johnson
Another great Labs case study. It was another team inside of Labs that had basically developed a tool that would take any source material you wanted and generate an audio conversation that sounded like two engaged, entertaining people having a conversation. You may be familiar with this genre about whatever material you gave it. And the kind of two use cases that we were talking about in the early days was kind of source material that no one would ever build a real podcast for. So arcane city council meetings that no one. There's no economics in turning that into a podcast or personalized learning where you're like, you're an auditory learner and you want to do a review of the week's assignment and you'd rather digest it in the form or you'd like to augment it with listening to a conversation, because people remember better with conversations, and they can do it on the go. And so they had this incredible demo. And the thing about it behind the scenes is that a lot of the breakthrough is actually actually the edit cycle. So behind the scenes, it's basically running through stuff that we all do professionally all the time, which is it generates an outline, it kind of revises that outline. It generates a detailed version of the script, and then it has a kind of critique phase, and then it modifies it based on the critique. And so it takes about four or five minutes to generate. And because it's going through all these different passes and, you know, you can call that, like, chain of thought reasoning, or, you know, you could do. But when I saw it, I was like, no, no, no, that's an edit cycle. Like, that's it. You did a draft and then you revised it, and then you got. It got better over time.
Casey Newton
Are you taking notes? You could do this for your book. It would help. Go ahead, Stephen.
Steven Johnson
So, and. And then at the end of it, there's a stage where it adds my favorite new word, which is disfluencies. So it takes a kind of sterile script and turns, adds all the banter and the pauses and the likes.
Kevin Roos
The likes. The words.
Steven Johnson
And that turns out to be crucial because you cannot listen to two robots talking to each other. No one. It would be just painful to listen to. It'd be like, I don't know.
Casey Newton
The Lex Freeman podcast is pretty popular, Stephen.
Steven Johnson
Oh, boy. So not even going to bring that up. Follow up on that. So that was crucial. And then on top of that all, there's some new voice technology, which adds really an incredible layer, which is like figuring out, without any coding in the script, figuring out that this is a point that they are trying to emphasize, and so they are speaking more slowly or they're trying to imply that they're hesitating a little bit, and so they're raising their intonation a little bit. All that stuff it does, and having two people talking to each other like that, it just. It is one of those moments. When I first heard it, I was like, this is incredible. And we were already.
Kevin Roos
We were already.
Steven Johnson
We'd rolled out these notebook guides that take your. All your documents and turn them into a briefing doc or an FAQ or a timeline, which is incredibly useful for, you know, kind of writers. And so this was just like, oh, we can now do it in another forum. Like, if maybe you want to take your sources and listen to a conversation about them. And so it just was a beautiful fit into inside of NotebookLM. And so we just have been scrambling all summer to get this out and it's been really cool to see the results.
Kevin Roos
It's really awesome. I made a podcast about my new vacuum cleaner that I got by feeding it the user's manual PDF and out pops this 8 minute explanation of all the features of my new vacuum. It's really cool.
Casey Newton
Okay, so I have a confession which is I am obsessed with this stuff and Stephen was very kind and gave me early access to this. But at the time I was getting ready for Meta Connect and some other things and I just did not have the time and attention to focus on it. But then, then when I found out when you were coming on the show, I thought, I am not going to listen to any of these until we're all in the room together.
Steven Johnson
Oh my gosh.
Casey Newton
And here's why. Because I've learned from YouTube that the most popular thing that you can do on YouTube is to hear something for the first time. So, you know, I don't know if you've seen this, Kevin, but it's like if you listen to Metallica for the first time on YouTube, you got a million views. Yeah, but I already listened to Metallica in high school, so I thought I'll do the next best thing and listen to the Notebook LM audio right here on Hardport.
Kevin Roos
So, all right, so let's listen to a few examples of this audio feature. I have been playing around with this for a couple days now, having a lot of fun with it. So a lot of times in our work as journalists, we have to sort of make sense of a bunch of different documents, whether they're legal filings or what have you. And so I was doing some research about Waymo and their self driving cars and there have been a few studies that have come out recently about the safety data of these cars of human drivers, sort of how, how safe are waymos compared to human drivers?
Casey Newton
It's been a really hot topic we've talked about on the show.
Kevin Roos
Totally very controversial, but it's a, it's a little hard to understand. The data's a little mangle and they're just, these papers are quite long. And so this morning I was going into the studio and I thought I'm just going to dump a whole bunch of these PDFs of these studies into a notebook LM and generate a podcast that I can listen to on the way to the office and maybe get A sort of high level overview of what these studies have shown. So I want to play for you the first sort of 30 or so seconds of my Waymo data podcast.
Casey Newton
All right.
Steven Johnson
Ever see one of those Waymo cars just cruising around with like, no one behind the wheel?
Yeah.
I always wonder, is that thing safe? I mean, no offense to robots or anything, but handing over the keys to a machine, it just. It just feels different.
Notebook LM Podcast Host
Yeah, it really does make you think about, like, trusting technology with our lives.
Vanta Ad Speaker
Exactly.
Notebook LM Podcast Host
Especially when it's something as important as, like, driving, you know?
Steven Johnson
Totally. So that's what we're diving into today, the safety of those driverless waymos. We've got a bunch of research lined up.
Kevin Roos
Oh, cool.
Steven Johnson
Including some really recent data to get past the headlines and figure out what's really going on.
Kevin Roos
So that's.
Casey Newton
That's amazing.
Kevin Roos
That's one clip.
Casey Newton
That's amazing.
Kevin Roos
It's really cool.
Casey Newton
Okay.
Kevin Roos
And it does actually continue on for like minutes after that and sort of break down the data in these papers quite well, from what I can tell. I also put in your latest platformer newsletter into this and had it generate a podcast about that. So here's a clip from the platformer newsletter AI podcast.
Casey Newton
Wow.
Notebook LM Podcast Host
Speaking of risks, Newton's decision to leave Substack, that was a risk. But it sounds like he's thinking long term.
Steven Johnson
He is. He really is. And I think that's key. Building a sustainable media business in this day and age, it's not easy. It takes more than just great content. You need smart business decisions too.
Notebook LM Podcast Host
It's a balancing act.
Kevin Roos
Right.
Notebook LM Podcast Host
You got to stay true to your vision, but also make sure you can, you know, keep the lights on. And Newton's been very open about platformers finances, about the challenges that come with going independent.
Steven Johnson
Transparency builds trust, and these days trust is invaluable. And let's be real, leaving a platform like Substack, even one with its problems, it's going to come with some financial growing pains for sure.
Notebook LM Podcast Host
It's like jumping off a cliff and hoping you can build your wings on the way down.
Casey Newton
I like these people. They're smart people, they know what they're talking about.
Kevin Roos
Yeah, they're big fans of you. The last clip I want to play, I was just sort of thinking, like, how esoteric can I get here? Like, what can I make a podcast about using Notebook lm? So I uploaded my most recent credit card statement to NotebookLM and had it try to make an AI podcast about some of the things that I've been spending My money on. And so this is the most recent credit card statement that I got in podcast form.
Casey Newton
I love it.
Notebook LM Podcast Host
Okay, let's see. I'm noticing a pattern here. Quite a few uber rides between August 8th and September 9th.
Steven Johnson
Yeah, and that's something to consider, right? Especially if you live in an area with, you know, readily available public transportation or bike friendly routes. Those frequent rideshares can really add up.
For sure they do.
I mean, for example, let's say an average Uber ride costs you $20 and you're taking four of those a week. Well, that's $320 a month. Think about it. That's money that could be going to other things, other financial goals.
Notebook LM Podcast Host
Yeah, absolutely. Small changes can make a big difference.
Kevin Roos
Yeah, it really told me to get my ass on the bus.
Casey Newton
It's like a financial advisor in your pocke.
Kevin Roos
Truly. So this blew my mind. What's your reaction to this?
Casey Newton
It really is extraordinary. And again, I knew we were gonna do this today. I wanted to wait until this moment to hear it. But in the meantime, I was seeing so many folks on social media saying, you have to listen to this. It is so eerily good. And my mind is already alive with a problem that I have, which is because we do a podcast. We often talk to the authors of books and often we decide we wanna talk to them a week before. And then I get a PDF in my inbox and now I have 7 days to read it and it's incredibly difficult. If I could listen to a podcast about it, I would love it. Now I realize how painful that's going to be to hear for every author.
Kevin Roos
Of you who exists.
Casey Newton
But you know, if it makes information more accessible, I want to try it.
Kevin Roos
Yeah, and probably people will make podcasts about a lot of the books that we talk about on this show, but no one's going to make a podcast about my credit card statement or you know, the policies at my kids daycare or something like that. So it's a really interesting way to transform these sort of more esoteric documents.
Casey Newton
I mean, once I heard about your profligate Uber spending, I do kind of want to do a podcast about your spending habits, but go on.
Steven Johnson
Well, I think actually that one was really interesting because one, its ability to figure out a way to rationalize a podcast is amazing. We would give it kind of internal notebook LM documents and they would be like, well, it's really exciting. We've gotten our hands on some internal documents from Google and you know, they just, they want to turn it into something That's a show. What you could hear there is an interesting thing. They are generally instructed to be enthusiastic and engaged. So one thing people are doing is putting their CVs and resumes in there. And they're like, john Smith, I mean, what an amazing career he's had. I mean, assistant vice president at the bank, that's impressive. But what happened there, apparently because your Uber riding is so excessive, was an interesting suggested mode, which is critique.
Kevin Roos
Yes.
Steven Johnson
Right. So you can imagine a future version which is like, I actually, I want some tough love here. Like here, here's the thing I'm working on, like, talk me through, like what the problems are. I want to hear that. And that could be something that.
Kevin Roos
And it's amazing because I didn't give it any prompt, really. I didn't criticize my spending on Uber.
Casey Newton
It was literally just make a podcast out of my credit cards.
Kevin Roos
One click the PDF, I pushed a button, I waited a couple minutes, I listened to this podcast and it had pulled out some details and spending patterns from my credit card statement as just an incredible.
Casey Newton
Are we seeing the seeds of our demise as podcasters, like in this segment?
Steven Johnson
Well, that was the second thing I was going to say, which is that they're instructed to. And my mind is kind of changing on this as users are experimenting with it more. But they're instructed to be fun and engaging. And I listened to dozens and dozens into hundreds of these as it was in development over the summer. And they were always fun and engaging. There's banter and all that stuff. I never once heard them be funny. I never once laughed. And I thought about, you know, since you've been saying so many nice things about me, I thought about Hard Fork, which I laugh at out loud all the time when I listen to you guys. And it occurred to me like, oh, the one thing, interestingly, that the models, they're so good at so many things, so almost superhuman in some of their abilities, but they can't yet be funny in this way. So, you know, who knows? Obviously being able to push it in directions and give it some guidance is something we're getting a lot of requests for.
Kevin Roos
So I would expect. Yeah, you could also imagine being able to sort of pick like, do you want this to be a two person sort of hosted podcast or do you want it to be just one person? Do you want someone to. One of the hosts to be like super annoying and like always interrupting? You could call that Casey Mode if you wanted to. That's a free idea.
Casey Newton
That reminds me, I think we should do Kevin's craft credit card statement, but as a true crime serial, you know.
Kevin Roos
So do you do any kind of moderation on what people are uploading into Notebook lm? Could someone upload, you know, a Mein Kampf and make an AI podcast about it?
Steven Johnson
So there's, there's basic safety, low level safety that Google has that will, will block really offensive things from happening. And basically what we've, the, the kind of, the latest version version of it. When there is politically charged content from either left or the right, the hosts are instructed to take a neutral kind of reporting tone and to basically say, we're not taking sides in this, we're just reporting what is in these sources. And we feel like that's kind of the best way to do it. And so there's kind of an extra instruction for them to make that clear if it, if it seems like it's, it's politically charged in some kind of way.
Kevin Roos
Yeah. I did actually try making an AI podcast about Mein Kampf. That wasn't a hypothetical and what happened. It did it, but it was like, it was very judgmental at the top. It was like, we're going to talk today about Mein Kampf. A book about how Hitler became such a monster, which I actually thought was good.
Casey Newton
Which is like actually how we teach history, by the way. Yes. You know, people do read Mein Kampf in history classes, but someone's up there telling them that it was bad.
Kevin Roos
Totally. So in Google's press release about this feature, there was a brief mention of some other features that might be on the horizon for Notebook lm, including the ability to generate overviews, podcasts in a language other than English. And the ability to actually take part in the conversation yourself, to sort of interrupt the host of this AI generated podcast, maybe ask a follow up question about something they just said. How far away do you think those things are?
Steven Johnson
We're actively working on both of them. I would expect some version of them to be in in the next few months. We actually just this week allowed you to input audio as a source too. So now you can go like this kind of classic format in the student use case. You go record your lecture, take handwritten notes just at the most important things, and then you go back to Notebook, upload the audio lecture and then basically say, take my little high level summary and expand it based on the full text of lecture. So I can really just write down the most important things and let the model fill in all the details based on the recording and then take that and turn that into A podcast so I can review it at the gym. Like that sort of workflow? Like, unthinkable.
Casey Newton
I would be so good at college if I went to college today. I mean, truly, I truly think that I could be at the top of my class.
Kevin Roos
And by being good at college, you mean you would just be using AI to do all your work?
Casey Newton
I would be using AI to augment my natural human abilities, Kevin. Something I suggest you try.
Steven Johnson
Yeah, well, that's. I mean, no, seriously, like, we really see this as a tool for understanding things, right? Like, you have word processors help you create a document, and Photoshop helps you adjust pixels in an image. This is a tool that helps you understand things. And if you are trying in good faith to understand the material as a student or as a knowledge worker, as a writer or whatever it is, this is a tool that should really help you do that better.
Kevin Roos
Yeah. What's next for you personally? Are you going to stick around at Google and build some more stuff? Are you yearning for the solitary life of a writer again?
Steven Johnson
I am not yearning. I am really enjoying this. And there's so much to build and to be in the middle the most important technological change of my life, working with really interesting people on this thing that I've always wanted. I would kind of be an idiot to stop now.
Kevin Roos
Yeah. Also, the snacks are way better at Google.
Steven Johnson
Unbelievable.
Kevin Roos
Cafeteria. All right, Steven Johnson, thanks so much for coming on.
Steven Johnson
Thanks, guys.
Kevin Roos
When we come back, it's time to pass the hat. We're playing a game. Hat. GPT.
Casey Newton
This podcast is supported by ServiceNow.
Vanta Ad Speaker
Here's the truth about AI. AI is only as powerful as the platform and built into ServiceNow puts AI to work for people across your business, removing friction and frustration for your employees. Supercharging productivity for your developers. Providing intelligent tools for your service agents to make customers happier. All built into a single platform you can use right now. That's why the world works with ServiceNow. Visit ServiceNow.com AI for people.
US Bank Ad Speaker
Imagine what's possible when learning doesn't get in the way of life. At Capella University. Our game changing flexpath learning format lets you set your own deadline so you can learn at a time and pace that works for you. It's an education you can tailor to your schedule. That means you don't have to put your life on hold to pursue your professional goals. Instead, enjoy learning your way and earn your degree without missing a beat. A different future is closer than you think with Capella University. Learn more at Capella. Edu.
Casey Newton
All right, Kevin. Well, I have been so focused on Meta Connect this week that I have not been keeping up with the tech headlines as well as I should have. And that made me feel like this would be the perfect time to play a game of hat.
Kevin Roos
Yes.
Casey Newton
Now hat, of course, is our game where we take headlines from the news, we riff on them a bit, and when one of us gets bored, we say to the other person, hey, stop generating.
Kevin Roos
Yes.
Casey Newton
So shall we begin?
Kevin Roos
Let's do it.
Casey Newton
Okay, Kevin, this is a big one. OpenAI CTO Mira Marati just announced that she's leaving the company. So as we stepped into the booth today, we saw this one come over the wires. Mira Marathi, of course, the Chief technology officer of OpenAI, announced that she was leaving after six and a half years. She posted a note online that said, after much reflection, I have made the difficult decision to leave OpenAI, adding, There's never an ideal time to step away from a place one cherishes. Yet this moment feels right now, Kevin. I always feel like incorporatees the phrase there's never an ideal time to step away translated into English means I know that I'm leaving at a terrible time. Do you feel that way?
Kevin Roos
I thought it meant I got fired.
Casey Newton
Well, I am very confident that Miram Roddy did not get fired.
Kevin Roos
Yeah, I don't think she got fired either. In part because she's not the only person who left this week. A few hours after Mira made her announcement, two other senior leaders at OpenAI also announced they were leaving. OpenAI's chief research officer, Bob McGrew and a vice of research, Barrett Zoff. Like Mira, they both sort of gave vague explanations for why they were leaving, like wanting to explore new opportunities and take a break. So whatever is happening, it seems like a very big deal.
Casey Newton
Look, it is. I mean, I have had people very close to the company inside OpenAI who says, you know, when, when Sam Altman is out there being the AI diplomat to the entire world, traveling the globe, raising money for his chip projects and everything else, Mira is the one who is overseeing the company's roadmap and really handling all the day to day operations. So on one hand, this does feel pretty shocking, but on the other hand, I don't think we can say that we are surprised. These are just the latest in a wave of people to leave. I would not be surprised if Mira started her own AI company. She says she's stepping away because, quote, I want to create the time and space to do my own exploration. And whatever that exploration turns out to be, I'm sure Andreessen Horowitz will offer her $100 million for it.
Kevin Roos
Yeah, I mean, it's just really remark how much this company has changed in the past year or two. There was a photo that sort of became semi iconic of the sort of leadership of OpenAI, I think, sitting on a couch together. And it was Sam Altman, Mira Murati, Greg Brockman and Ilya Sutskever. And that was sort of the highest ranking leadership of this company just a year ago. And now Ilya Sutskever has left the company, Mira Morati has left the company. Greg Brockman is out on an extended leave. So of that group of four, it is just Sam Altman who is there as of now. What do you think is happening here? What's the real story?
Casey Newton
Well, you know, I was, my boyfriend is reading a book about the history of Silicon Valley right now, and he just shared this passage with me about the rise of the semiconductor industry. And one of the first big semiconductor manufacturers was Fairchild. And it was a very similar situation to OpenAI. So many people left Fairchild and started their own silicon companies that they were known as the Fairchildren. And the companies that they created are the reason that we wound up calling this Silicon Valley. So if you view the rise of AI as kind of a tectonic shift in the technology landscape, we might be seeing the same thing here where OpenAI really was one of the biggest incubators for this technology. And one by one, all of those co founders said, you know what, I bet I could do it a little bit better, do it a little more my way, and make a little bit more money if I did it somewhere else.
Kevin Roos
So you think this is about her wanting to do her own thing? I have some questions here. Obviously we'll wait to hear more about if any more reporting comes out about why Miramir has left the company. But I also saw another story today about OpenAI that made me think that it might be related, which is that they are reportedly working to transition to a traditional for profit company. Right now, as we know, OpenAI is governed by the board of a nonprofit. So this transition would basically do away with that. The nonprofit would be a separate entity and would only hold a minority stake in the sort of conventional, conventional for profit company. So I just wonder if part of this is just this is not the kind of project that these people signed up for back when OpenAI was founded.
Casey Newton
Which it gives them all the more reason to leave and start their own thing. Right? Like if those stories do wind up being related, I feel very confident Miramarati will be working on AI once again very soon.
Kevin Roos
And as we know, OpenAI has said that it no longer punishes whistleblowers by withholding their equity after they leave the company.
Casey Newton
So, Miramarati, your invitation to Hartford is wide open.
Kevin Roos
We've got a spot for you next week.
Casey Newton
All right, stop generating.
Kevin Roos
This next story is a double backpedal. And there are two stories on this slip. One of them is about Elon Musk's ex backing down in Brazil after defying court orders in Brazil for three weeks.
Casey Newton
When you say Elon Musk's ex backing down in Brazil, are you referring to Grimes?
Kevin Roos
No.
Casey Newton
Okay.
Kevin Roos
X, the company formerly known as Twitter. After defying court orders in Brazil for three weeks, X has capitulated. In a court filing last Friday, X's lawyers said that the company had complied with orders from the Brazilian Supreme Court in hopes that the court would lift a block on its site. That is a sharp reversal. It spent weeks insisting that it would not back down, and then it backed down. Okay, that's story number one. Story number two, in the same vein, is about Telegram, another company that we've talked about on the show very recently. Telegram CEO Durav says, apt to provide more data to governments. The story comes from Bloomberg, basically, after insisting that it wouldn't do this, it wouldn't give out data to governments. In response to legal requests, Pavel Durov, the chief executive officer of Telegram, said that Telegram will now provide users IP addresses and phone numbers to relevant authorities. Casey, what do you think about these two stories?
Casey Newton
Well, you know, first of all, I think they're related. Second of all, the Telegram story has made me realize that Pavel Durov and I have something in common.
Kevin Roos
What's that?
Casey Newton
Well, we both came to profound realizations while sitting in a French prison. Did I ever tell you about the time I was in a French prison?
Kevin Roos
No.
Casey Newton
I stole a loaf of bread to feed my family.
Kevin Roos
I think I saw a play about that.
Casey Newton
It was a very good musical. But look, here's the deal. I think what we've really learned here is that after a long period of countries trying to rein in tech platforms through passing laws and passing regulations, we're now moving into what I like to call the prison phase, where supreme courts and law enforcement officers are going out there and they're saying, you are either going to listen to us and you're going to obey the sovereignty of our country, or we're going to throw your executives in jail, or we're just going to ban the whole platform. So this is a real ratcheting up. And for all of the big talk that Pavel Durov and Elon Musk have done over the past year about how they were going to fight for free speech, when push came to shove, they were not willing to spend the rest of their lives in jail.
Kevin Roos
All right, stop generating.
Casey Newton
Kevin, meet the upper autocado and a robotic burrito bowl maker at these Orange County Chipotle locations. Now, this story is very personal to me because I grew up in Orange county, and according to the Los Angeles Times, robots that fully flesh out avocados and build burrito bowls are now making food for customers at 2 Chipotle Mexican Grill restaurants in Southern California as automation and artificial intelligence continue to enter the fast food industry and raise fears about the supplanting of workers. And Kevin, I'm told the avocado can cut, core, and peel avocados in 26 seconds on average. How does that compare to your avocado technique?
Kevin Roos
Wow, I'm pretty fast with an avocado. But I will say I don't hate this because I recently learned that cutting avocados is the cause of many trips to the emergency room.
Casey Newton
Is that right?
Kevin Roos
Many. Is one of the leading reasons that people cut their hands in the kitchen. Because, you know, when people are cutting avocados, sometimes they hold. They'll split the avocado in half. They'll hold a half, and then they'll cut it while it's in their other hand. And many times my friend who had injured themselves this way was saying people will just cut through the skin of the avocado into their hand and have to go to the, er.
Casey Newton
Well, I mean, that's why there's that saying, make guacamole cut a little. Holy. And that's how you're supposed to remember to be careful. But what do you think about the automatic. The automatic robot nature of what's happening to Chipotle?
Kevin Roos
So obviously I would be worried if I was a Chipotle worker, but I think in some spiritual sense, like, Chipotle is already kind of, you know, this, like, slurry that people just sort of shovel into their mouths like their horses at a trough.
Casey Newton
It's a conveyor belt for beans and rice.
Kevin Roos
Yes.
Casey Newton
Yeah.
Kevin Roos
So I don't mind this. I will be interested to see if they can actually automate more parts of the chipotle process, because this is just one part of the assembly process. But I have to imagine that Chipotle and many other fast food chains are working on using robots for things like flipping Burgers.
Casey Newton
Here's my. Here's my prediction. If you've ever been to Chipotle, you know one thing, and that is that guac is extra, right? You know this. You want to get guacamole on anything, you're going to have to pay up. I think in the future at Chipotle, humans are going to be extra, right? You can either go to the avocado and you can get it cheaper. But, hey, you want that burrito made with the love of a human being? What's going to cost you about another two bucks?
Kevin Roos
I'm not sure the burritos are made with the love of a human being today.
Casey Newton
All right, stop generating.
Kevin Roos
Okay, next up. Oh, this one's a talker. This was all over my feeds yesterday. Marques Brownlee says I hear you after fans criticize his new wall. So this is from the Verge. Casey, you'll remember former Hard Fork guest Marques Brownlee, aka MKBHD, the famous YouTube tech reviewer. He launched a wallpaper app called Panels this week as part of his iPhone 16 review. The app was criticized for its price. A subscription to this app costs $50 a year or $12 a month. And people were very skeptical that any app for wallpaper for your iPhone could be worth that much money. And the app also asked to track user activity across other websites and location data. Marques sort of backtracked a little bit. For example, he said they were going to fix the excessive data disclosures. So, Casey, what did you make of this? This was a big deal. People were very mad.
Casey Newton
It made me really worried about the upcoming launch of the first official Hard Fork product, which is a bag of rusty nails. You know, like, looking at how this app was received, I thought, kevin, we're going to be in for it. But, you know, look, I really like Marques. I have a lot of respect for him. I think he's, like, built something really incred, incredible over there. But, you know, two. Two things come to mind. One is when you are a critic and when you are a tough critic, anybody you criticize is going to be out there waiting for you with long knives. And I think Marques arguably published the most critical reviews of his entire career this year. He trashed the Humane AI pin, the Rabbit R1AI gadget, and also an electric car. And he really sort of built up a reputation for himself as somebody who was really hard on other people's products. So when you release your product, if it is not absolutely polished and dialed, you're going to hear it. The other thing I've been thinking about is just this is actually an indictment of YouTube. Right. Because even though, you know, YouTube does share a certain amount of revenue with creators, even the most popular creators there, none of them ever just are content with the money they make there. They feel like in order to be able to live their lives, they have to get into these brand deals. My friend Nilai Patel over at the Verge has, at the end of the day, every YouTube creator has to turn themselves into a miniature advertising agency. Right. And so it's pushing people like Marquez.
Kevin Roos
And it's not like this in other media. Like Wolf Blitzer is not out there hawking ringtone.
Casey Newton
Right, right, right.
Kevin Roos
He doesn't have to because he makes enough money from his day job. And I've got to think that if YouTube was giving people like Marquez, who are among the most successful people on that platform, you know, enough ad revenue to support whatever their plans and ambitions are, they wouldn't have to go do all doing all of these side projects.
Steven Johnson
Yeah.
Casey Newton
And now look, you know, maybe some of them would do it anyway. And you know, certainly I'm sure some individuals creators are just sort of greedy and I don't want to totally let creators off the hook who go out and, you know, produce subpar products. And it does seem like this was a really subpar product. But you know, to me the more interesting story about this is like, what is the actual YouTube economy? And the truth is it's pretty bad. You talk to particularly anybody who's running more than a one person operation on YouTube, how it's going, and pretty much the best thing that they'll tell you is that it's going about break even. But there are a lot of people losing money out there on YouTube. And so when I see something like this, I just think, yeah, this is really kind of a YouTube story too.
Kevin Roos
It made me think about the other big sort of YouTube brand extension fiasco, which was the Mr. Beast burger empire.
Casey Newton
Yeah, you know, I still have indigestion thinking about the Beast burger. I ate that one time.
Kevin Roos
So MrBeast, for those of you who don't remember this, he launched a line of burger restaurants that were basically sort of ghost kitchens that would all sort of make these burgers and put Mr. Beast's branding on them and send them out. And you know, many of them got very bad reviews. There was very poor quality control on these burgers. And it ended up being a pretty big stain on Mr. Beast's reputation. You know, no one thought that he was cooking the burgers himself. But I think this really is the flip side of the parasocial relationship.
Casey Newton
Is that a burger joke?
Kevin Roos
Oh, I didn't mean it as one, but now that you mention it, I think the one thing that people really love about YouTube are these parasocial relationships that fans get to have with their creators where they, you know, they trust them more than you would trust someone on the evening news telling you something because they seem authentic. Maybe they're filming in their bedrooms or someone that's very personal. Maybe they're sharing more intimate details from their life. You end up sort of feeling like, you know, this person, you trust them. And so when someone on YouTube sort of leads you astray or recommends a product that maybe doesn't live up to your expectations, it really makes you sort of question them as a whole. And I think that's what Marques has stepped into here. And so I think he'll recover from this. He's obviously got a long body of work on YouTube and I think he will make this right. But I think it just shows how fragile these parasocial relationships can be.
Casey Newton
We've probably already talked about this too long, but I do want to say one more thing about this app, because as bad as it is, I do actually want to stand up for the idea of paying people for their art. Right. And one thing that I think this app got right was at least they said that they were going to share the proceeds of the app, 5050 with the artists. And if you are worried that AI is about to put every human artist out of work, an app that comes along and says, we're going to share that money with artists, I think it's at least worth asking yourself whether some of those artists deserve a living wage. Right. And that at the end of the day, 50 bucks isn't that much to pay to, you know, keep somebody's lights on their house.
Kevin Roos
Yeah, yeah. Are you a wallpaper guy? To use wallpapers?
Casey Newton
I. No, I change it like two or three times a year. But, like, you know, is it just.
Kevin Roos
A photo of my face now?
Casey Newton
Yeah, it is. And I said, I'm going to get him someday. All right, Stop generating.
Vanta Ad Speaker
AI is coming to your industry, if it isn't already here. But AI needs a lot of speed and comp computing power. So how do you compete without costs? Spiraling. Upgrade to Oracle Cloud Infrastructure, or oci. OCI is the blazing, fast and secure platform for your infrastructure, database, application development and AI workloads. Right now, Oracle is offering to cut your current cloud bill in half. If you move to oci for new US customers with minimum financial commitment. Offer ends December 31, 2024. See if your company qualifies@oracle.com Imagine what's.
US Bank Ad Speaker
Possible when learning doesn't get in the way of life at Capella University. Our game changing flexpath learning format lets you set your own deadline so you can learn at a time and pace that works for you. It's an education you can tailor to your schedule. That means you don't have to put your life on hold to pursue your professional goals. Instead, enjoy learning your way and earn your degree without missing a beat. A different future is closer than you think with Capella University. Learn more at capella. Edu.
Casey Newton
Hard Fork is produced by Rachel Cohn and Whitney Jones. We're edited by Jen Poyan. We're fact checked by Caitlin Love. Today's show was engineered by Daniel Ramirez. Original music by Alicia B'itup, Marian Lozano, Rowan Nemisto and Dan Powell. Our audience editor is Nel Galloping. Video production by Ryan Manning and Chris Schott. You can watch this whole episode on YouTube@YouTube.com hardfork Special thanks to Paula Schuman, Whew Wing Tam, Dalia Haddad and Jeffrey Miranda. You can email us@hardforkytimes.com maybe take the transcript of this podcast and put it into Notebook LM and see what kind of podcast it makes.
Kevin Roos
No, don't do that. What if it's better than us?
US Bank Ad Speaker
Imagine what's possible when learning doesn't get in the way of life At Capella University. Our Flex Path learning format lets you learn on your own schedule. A different future is closer than you think with Capella University. Learn more@capella.edu.
Hard Fork Podcast Episode Summary
Episode: Meta’s Race for Your Face + Google’s Hit A.I. Notebook + HatGPT
Release Date: September 27, 2024
Hosts: Kevin Roose & Casey Newton
Chaos and Observations at Meta Connect
Casey Newton shares his chaotic experience attending Meta Connect, highlighting organizational shortcomings:
"[At Meta's campus] people are just sort of wandering around like the duck in Are you my mother?"
(03:25)
Mark Zuckerberg’s Symbolism and Leadership Style
The hosts discuss Mark Zuckerberg’s choice of attire, emphasizing his affinity for classical motifs and conquest themes:
"Zuckerberg walks out on stage on Wednesday, and he's wearing a shirt that says, out Zuck, out Nihil."
(05:06)
They interpret the Latin slogan as a reflection of Zuckerberg’s relentless pursuit of dominance: "Either Julius Caesar or nothing."
(05:31)
Meta’s Product Announcements
Casey details Meta’s latest product releases aimed at expanding their VR and AR footprint:
AI-Generated Synthetic Content in Feeds
A controversial initiative where Meta introduces AI-generated posts tailored to user interests:
"You're going to see stuffs based on your interests or have your likeness... It could feel creepy to some users."
(09:25)
Augmented Reality with Orion Glasses
Meta unveils their Orion AR glasses, juxtaposed with Snap’s current offerings:
"The Meta field of view is 70 degrees, compared to Snap’s 46 degrees, providing a more stable interface."
(15:20)
Challenges Highlighted:
Comparison with Apple Vision Pro:
The discussion underscores Meta’s belief in AR glasses over bulkier VR headsets for seamless integration into daily life:
"Glassess are different. You're wearing glasses right now. My guess is you have not even thought about the fact that you're wearing glasses for the past half hour."
(16:27)
Introduction to NotebookLM
Kevin Roose introduces NotebookLM as Google’s advanced AI tool designed for personal research and writing assistance:
"It's a tool for research, for writing. It is really, really capable at what it does."
(24:51)
Interview with Steven Johnson
Steven Johnson, a seasoned writer and Google collaborator, discusses the inception and functionalities of NotebookLM:
"We are just taking the information you have and putting it in the model's context window... There’s no way for that information to leak out into other users."
(36:39)
Community and Use Cases:
NotebookLM fosters a vibrant community on Discord with 45,000 members exploring diverse applications, from gaming narratives to academic research.
Privacy and Data Security:
Steven emphasizes that NotebookLM does not train on user data, ensuring privacy:
"The second you close your session, that information goes away. We're not learning from it."
(36:39)
Future Developments:
Upcoming features include multi-language support and interactive podcast conversations where users can engage dynamically with AI hosts.
"This is a tool that helps you understand things. If you are trying in good faith to understand the material, this is a tool that should help you do that better."
(56:17)
AI-Generated Podcasts from Everyday Documents
Kevin and Casey experiment with NotebookLM’s ability to create podcasts from various documents, showcasing its versatility:
"This is amazing because it actually has that citation feature where you can click and verify sources."
(34:16)
Implications of AI-Generated Content:
The hosts discuss the potential and ethical considerations of transforming personal and sensitive documents into AI-generated audio formats.
"It's like a financial advisor in your pocket."
(49:40)
Limitations and Future Enhancements:
While impressive, NotebookLM’s AI still struggles with elements like humor, and future updates aim to enhance interactivity and multi-language support.
"We're instructed to take a neutral stance on politically charged content, ensuring balanced reporting."
(54:39)
OpenAI Leadership Exodus
Casey and Kevin delve into recent departures of OpenAI’s senior leaders, discussing potential implications for the company and AI industry landscape:
"If you view the rise of AI as a tectonic shift, we might be seeing something similar to the Fairchildren phenomenon in Silicon Valley."
(61:20)
Elon Musk’s Ex Backing Down in Brazil & Telegram’s Data Compliance
The hosts explore regulatory pressures on tech platforms, highlighting how companies like X (formerly Twitter) and Telegram are capitulating to court orders and governmental data requests.
"We're moving into what I like to call the prison phase, where authorities are coercing platforms to comply or face severe consequences."
(65:33)
Automation in Fast Food: Chipotle’s Robotic Burrito Makers
A lighter segment covers the introduction of robots at Chipotle locations, automating tasks like avocado preparation to enhance efficiency:
"I don't mind this. I will be interested to see if they can actually automate more parts of the Chipotle process."
(68:03)
Marques Brownlee’s Panels App Controversy
The discussion shifts to YouTube influencer Marques Brownlee’s expensive wallpaper app launch, critiquing its pricing and data privacy issues as a reflection of the YouTube creator economy's pressures.
"The YouTube economy is pretty bad. Many creators struggle to break even and resort to high-priced side projects."
(71:06)
Ethical Considerations and AI’s Role in Content Creation
Casey advocates for fair compensation for artists and creators amidst the rise of AI-generated content:
"An app that shares proceeds with artists is at least worth supporting as it provides a living wage."
(73:37)
Final Remarks on AI’s Evolution
The hosts reflect on the rapid advancements in AI and AR technologies, acknowledging both the transformative potential and the challenges ahead in ensuring these tools serve users ethically and effectively.
"What we're seeing is the hunt to build AR glasses, one of the hardest problems in consumer technology, finally blooming with groundbreaking yet costly innovations."
(19:59)
Notable Quotes:
"Zuckerberg walks out on stage... trying to sell the message. I run this company, and I am the Willy Wonka of Meta, and don't you forget it."
(07:05)
"Now we're arriving in this world where the app on your phone is just going to be showing you made up AI stuff."
(11:14)
"AI is a tool for understanding things... it should help you do that better."
(56:17)
"We're not training the model... there's no way for that information to leak out into other users."
(36:39)
This episode of Hard Fork offers a comprehensive look into Meta’s ambitious ventures in VR and AR, Google's innovative AI tool NotebookLM, and the evolving dynamics of AI-generated content. Through engaging discussions and insightful interviews, hosts Kevin Roose and Casey Newton navigate the complexities and future implications of these technological advancements.