Our Favorite Interviews from 2025
Loading summary
A
Well, it's New Year's Eve and it's time for the year end episode of Intelligent Machines. Join Jeff, Paris and me for some of the best interviews from 2025. Next podcasts you love from people you trust. This is Twit. This is Intelligent Machines with Jeff Jarvis of Paris Martineau, episode 851 for New Year's Eve 2025. Happy New Year. New Year. Well, hey, everybody. This has been a really interesting year for Intelligent Machines. It's time for our first year ender because the show, in a way, is brand new. We started the year at this as this week in Google, but very early on it became clear to me that really, while Google is still very interesting, it's particularly in the area of artificial intelligence and there are so many other companies that are doing so many interesting things. I got together with our wonderful hosts, Paris Martineau and Jeff Jarvis, and I said, what if we refocused on AI and called it Intelligent Machines? They were all in. The other thing we decided to do that's a little bit different is to begin each episode with a keynote interview with somebody who's doing something very interesting or writing very interestingly about AI. And that's what this best of is going to be. The best interviews, or at least as many as we could fit into a few hours from 2025. Truthfully, there were many more than we could put in, but after some thought, I think I've picked some of the most interesting ones. Anyway, a big thanks to Paris Martineau, who is such a wonderful treasure on this show, to Jeff Jarvis, who's the show's heart and soul. They represent the three most, the two of them, three legs of this enterprise. And without them, the stool would just fall right over. So I'm very grateful to have them. Actually, there's a fourth leg just for extra, you know, stability. And that's you, our audience. I am. I'm very grateful that you either stayed with us through the transition, as most of you did, or came to us because of your interest in AI. We're really glad to have you. So I'm sorry, I'm going. I'm blathering. You know, it's a little bit of a teary time of year as we wrap up 2025. Without further ado, here are some of the most interesting people in AI from 2025. In some ways the spiritual father of this show because he wrote the book the Age of Intelligent Machines that gave birth to the name Ray Kurzweil. His newest is the Singularity is Nearer. He's written many books. He's been a leading developer in AI for 63 years, which is, as far as I could tell, longer than any living person. Also an amazing inventor. He invented the first flatbed scanner, the first optical character recognition system, the first print to speech reading machine for the blind. Of course, that famous Kurzweil synthesizer for Stevie Wonder. I mean, I can go on and on. You actually got a Grammy Award for that. Recipient of the National Medal of Technology, inducted in the National Veterans hall of fame. 21 honorary doctorates. He's written five bestselling books. And as I said, the newest, which came out last year, is the Singularity is Nearer when we merge with AI Ray, it's such a pleasure to have you on the show. Thank you for giving us some time.
B
My pleasure.
A
Love your hand painted suspenders, they're fantastic. So there's so many questions we have for you. You're probably most famous for your prediction that we would reach AGI in 2029, four years from now, and we would reach the singularity in about 20 more years from now. In fact, I remember talking to you in 1999 when those that I think you said those very years. Nobody at the time thought you were right. You obviously have been pretty accurate. I saw somebody said your success rate in predictions is 86% now. Yeah. Are we still on target?
B
I made 147 predictions in 1999 about the year 2009. 86% were correct within one year.
C
So.
A
Wow.
B
But I have a method for doing this. If I actually bring up the computation chart.
A
Yeah, I have it on my screen right now.
C
Yeah.
A
Benito, can you pull up that? There we go. This is, by the way, a logarithmic chart.
B
It's a logarithmic chart. So straight line means exponential growth. It starts with the first working computer in 1939, the Zuse 2, which did 0.000007 calculations per second per constant dollar. Up on the upper right hand corner is a Nvidia Latest chip which does half a trillion calculations per dollar. So it's a 75 quadrillion fold increase since 1939 for the same cost. And that's only the hardware. The actual cost of doing a computation is the hardware times the software increase. The software increase depends on what you're doing. But it can also be millions of one to one. So overall we've gained something like a million quadrillion fold increase since 1939. That's why we didn't have large language models in 1939 or even four years ago. We began to have them four years ago. They didn't actually work very well. Even comparing today's large language models to the ones we had one year ago is dramatic difference. So we're making exponential gains in the cost of making a computation.
A
So, all right, so I guess that's, in a way, is that Moore's Law?
B
Well, Moore's Law is a piece of it that deals with integrated circuits. But this happened from 1939 when we used relays to create computers. Then we used good point tubes, then we used discrete transistors.
D
Then.
B
Then we used integrated circuits. Moore's Law has only to do with integrated circuits. This is a much more broad way of tracking computation.
A
But AI hasn't gotten better solely because computation's gotten better, or has it?
B
But that's a necessary capability. If we didn't have the computation, we wouldn't have large language models that only emerged like four years ago because of the exponential gains in computation.
A
You actually point out, though, that people.
B
Can you hear me okay?
E
Yeah, yeah.
A
You sound great. Now. You actually point out that even as recently as a few years ago, even experts in the field have been surprised, you write, by how many of the recent breakthrough. By many of the recent breakthroughs in AI, there is something else going on than just computational capability. Yes, yes.
B
It's both software and hardware. The software is also giving us computation gains, but we're also creating more sophisticated software. Large language models now can actually call other capabilities and bring them in. I mean, right now, computation is getting to the point where it can match the best human capabilities. There's different definitions of what AGI means. My definition is actually pretty comprehensive. Basically, it will be able to do what an expert in every field can do all at the same time. And we're not quite there yet, but we will be there by 2029.
A
It'll be more general, in other words. Yeah.
B
And to be able to do what an expert can do in every field, in any field.
D
Yeah.
F
Ray, do you have a definition of intelligence? You know, generic, even before you get into this artificial.
B
Well, I dealt with a few definitions in my books. Intelligence is a way of using limited resources to solve a problem. And the faster you can solve it and the more sophisticated the. That you can problems that you can solve, you have more intelligence.
A
You have a bet you did somewhere more than 20 years ago. I think with Mitch Kapor, it was part of the long nows, long bets, a $20,000 bet that a machine would pass your modified Turing test when Soon, Right. In the next few years.
B
Well, it said it. By 2029.
A
29, okay.
C
But.
B
The Turing Test is not very well defined. Turing actually had like a page of descriptions of it, so it's really unclear. Some people have said that the current language models can already pass it. I felt we would actually have like a five year period where people would say we're passing it. People wouldn't necessarily believe that, but by the end of five years, everybody would believe it. So we've actually passed that first point. So by 2029, I believe everyone will believe that we passed the Turing Test. But more significantly, it's AGI, which is actually the same prediction that large language models combined with everything else that we're doing, will be able to match the best human capability, but also much faster. Like a friend of mine compared two books. It took her four days to do it. She decided to compare that to a large language model, larger language model, did it in 40 seconds, and she felt it did a better job. That's today. So it's already comparing very well to human intelligence.
A
Are you going to have a. So your test has human judges connected to test subjects, both computer and human. One of the things you point out is that an AI actually will have to pretend it's dumber than it is, because if it really knew everything, it would be so obvious that it's a computer, that it wouldn't.
B
Well, absolutely. If it solves problems that take us 4 days and 40 seconds and it can compare to that for every possible human skill, we would know it's a computer. So it has to dumb itself down. But there's certain things that it can't quite do yet that actually humans can do. Has to be very good at being. Having a personality that's consistent. We're getting there. 2029 is actually one of the more conservative predictions about this.
A
It's your prediction, or do you want to adjust it? Do you think we'll get there sooner?
B
Well, there's no reason for me to adjust it. I mean, I said 2029 in 1999.
G
Right.
B
Stanford actually was concerned about my prediction. They organized a worldwide conference to examine it. Several hundred AI experts came. This was, I think, in 2000. And they felt that, yes, computers would be able to pass the Turing Test, but not within 30 years. The consensus was 100 years. I was the only person that said 30 years.
A
I think you're closer than 100 for sure. One of the things you point out in the book, which is, I think, really true, is I think you Refer to a AI expert who said, you know, if a computer, and this was a few years ago, I think 2014, 2015, could look at an image and know what's going on in image. That's really hard to do. And if it could do that, that'd be impressive. One month later, Google releases Google Lens and does it. But you point out humans have an interesting flaw because as soon as the computer does it, we go, oh yeah, well that wasn't so hard. Of course it can beat the best chess players in the world. That's a computation.
B
We saw that with chess. Chess was considered. If you could actually play chess, you're creating fantastic creative abilities which no computer could do. As soon as the computer could beat every human being, we said, oh well, chess is not that significant.
A
AlphaGo Zero is very interesting because it taught itself, unlike the chess playing computer. All it started with was the rules of Go and then it played itself a billion games over just a few days and became better even then. AlphaGo and beat the world champion. Beat AlphaGo 100 games to nothing. That's something called deep reinforcement learning. Right.
B
Well, that's what we're dealing with now. We actually can. When you play a game, it's very clear whether or not it's successful or not. If you win the game, you can actually track on that data. When you're creating language models, it's not clear what a successful identification is. But we've actually had people go through, we've trained many different possibilities and it actually learns from that. So that's like a successful game. And it actually can do a very good job with language.
A
Now Deep Seq in fact, kind of used that technique. Right.
B
Well, American companies also have the ability to do this with less computation.
A
Yeah. OpenAI immediately said, oh, we got that, we can do that. Now you talk in the book was written last year and you talk a lot about the disruptions and you talk, I think pretty optimistically, as you always have, about for instance, the job market and other disruptions you do. You know, you're a little concerned about Luddites, you're a little concerned about anti AI violence.
B
The problem now is it's happening so quickly.
A
Right.
B
I mean, generally in times past it took a while for the job picture to change and so people could get used to it. Now it's going to happen very, very quickly.
A
Are you concerned?
B
Well, I'm concerned about that. I think we'll get through it. We'll actually be better off, actually. If you bring up my US personal income chart, I Got it right here.
A
Let me pull it up.
B
This is due to computation comparing our per capita personal income. So this is the average income that a person makes in constant dollars. It's 10 times what it was 100 years ago.
A
This is at 20, $23. Yeah, yeah, that's interesting. Although there's a little dip there right at the top. I notice a little drop. I wonder what data from the last few years might show. Does that, does that. I mean, you also talk a lot about the real reason humans work is for meaning and for purpose. Obviously, we have to support ourselves.
B
Well, my view is a little bit different than other AI experts. Some people think, okay, we've got a certain amount of intelligence and then AI, although we carry it around, like everybody carries this around. I give lectures and every single person almost has a cell phone. That wasn't true 15 years ago. But it's not part of our body. So if AI says something, it's not part of who we are. But we're going to actually merge together. We're not going to carry around a separate part. We'll do that with virtual reality. We'll actually see things and it'll actually go inside our brain. That'll happen in the2030s. And we won't be able to tell the difference between things that our biological brain, which will keep as well as our AI assisted brain, we won't be able to tell the difference. And it'll be part of who we are. So it won't be us versus AI. We're going to be made much more intelligent by merging with AI.
A
You talk about it as you talk about epics. In the fifth epic, you say we will directly merge biological human cognition with the speed and power of our digital technology.
B
Right. And other people don't do that. They think it's us versus AI. I mean, you go through educational institutions from elementary school up through graduate school. People don't want to use AI because people won't get smarter that way. So let's keep AI separate. And that's not the right way to do things. The world will be and will be even more than it is today, imbued with AI. And we're going to be smarter, and that's the world we need to get used to.
A
We'll actually transcend our genetic capabilities by some sort of cybernetic man machine.
B
There's a whole way in which we'll do that. But I mean, you can see with virtual reality, you just look at the world and things you look at will be. It will tell you what's going on with them. You'll see the world with a much more comprehensive view of it.
A
But that's for you, that's what the singularity really is.
C
Right?
B
I mean, singularity is when we actually merge. We'll combine with AI and it'll make us a million times smarter.
A
Right.
B
And that's something that we can hardly comprehend. So we borrow this metaphor from physics where we talk about something that we can't understand, like a singularity. In physics, things go into it. You can't actually see what's going on inside it. So we call that singularity. This is a singularity in history where we won't be able to really understand today what it would be like to be a million times smarter. So that's 2045.
A
So. So as I was saying, you wrote this last year. We have entered a very disruptive period, not just in our nation, but globally, perhaps maybe a little bit because of this, perhaps because of climate change and a lot of other disruptions. Are we going to make it to 2045? Have you changed your outlook a little bit because of the last few months?
B
We're going to get to 2045.
A
Good. Counting on it.
B
I mean, if you bring up my chart on electricity generation, solar energy, it's also true of wind energy is growing exponentially, and there's reasons for that. To completely replace all of our energy needs, we would only need one part in 10,000 of the sunlight that meets the Earth. So we only have to generate one part in 10,000, and we'll generate all of the energy that we need. And we're on our ways to doing that in about 10 years based on the exponential growth. People tend to look at things in linear ways, but this is actually growing exponentially and it will be. Energy will be much cheaper as a result.
A
You do, I mean, you do have a chapter called Peril. You talk about the specter of social dislocation and violence, which you think is unlikely, but you do point out, I think this is important, that we should work toward a world where the powers of AI are broadly distributed, so that its effects reflect the values of humanity as a whole. I mean, that's pretty clear that we don't want you work right now. By the way, we should mention your AI visionary at Google. But notwithstanding, we don't want Google to control it or Microsoft to control it, or OpenAI or China. It should be something all humankind benefits from.
B
Yes, well, first of all, I mean, everybody has access to AI, so that's good. And we do want competition in the air field. I think though, if you need, if you use a large language model, it should be from a larger company. So they're concerned about their reputation and their liability.
A
Good point.
B
Deep Seq is not deal with a small company. There's not much behind them and they're not really that concerned about reputation or liability.
A
I do think though, it's very important and I'm very happy about this, that this hasn't become a proprietary technology, that the technologies for transformers and LLMs are well known, well distributed and a lot of other. A lot. Many other companies are working on it at the same time.
B
And a lot of companies really create publications with their techniques.
A
Yeah. It's not being kept secret.
B
Right.
A
Which is good, I think. Yes. You agree?
B
I agree with that. It's good to have. Sort of sensible regulation across a lot of different companies.
A
We just recently saw safe AI release. This is Eric Schmidt's effort releases paper on AI safety. Where do you stand on superintelligence and AI safety?
B
Well, I mean threats of AI are real and serious, but it's not an alien invasion. AI is not coming to us from Mars. We're creating it.
A
That might be worse.
B
Techniques are widely known. It's actually helpful. Everybody has access to it. And some things that are negative, it's good for them to be widely known. When we had nuclear war was actually. There's been two times that nuclear war actually broke out and two cities in Japan were annihilated with nuclear war. And if you ask people then what's the likelihood that this will happen again? 99% would say that, oh, it's going to happen many times. But actually for the last 80 years this has not happened. It was a cautionary have capability of nuclear weapons are maybe not the best people in the world, but somehow we've avoided doing that. So I'm more optimistic that we can avoid the dangers from AI. But we must train AI to mirror human reasoning. We must advance our ethical ideals as reflected by AI. I was actually one of the principal participants in the Asilomar guidelines. This happened a number of years ago and we created some ethical ideals that are being pursued. And so I'm optimistic about it, but we do have to be diligent about it.
A
Is this a role that government should take?
B
It's a good question. I don't really have an answer to that. It depends on what the governments do. I mean, I think it's actually useful to have large companies that already have a lot of both reputation and ethical guidelines. To guide them.
A
I'm sure because you work at Google, you wouldn't be working there if you didn't feel like they were a good steward. Is OpenAI a good steward?
B
I think so. And a lot of people use them, and I think that's been helpful to have a lot of companies doing this.
A
Guys, I don't want to monopolize. Mr. Kurzweil, if you have a question, Jeff, or Paris, please.
F
Paris, you go.
H
I'm curious.
I
I mean, you've touched on this a bit, but given that your position on this is that in just a few short years, we're going to experience AGI, and specifically the widespread access to technologies that are better at doing practically everything that a human being could. What would, I guess, stop that from causing kind of widespread economic disruption of large segments of the economy kind of collapsing as companies replace workers?
B
Because we're merging with AI. I mean, everybody seems to take the position this human intelligence and then this AI, we carry it around with us, but it's not really part of us, but we're actually going to merge with it. So you and me and everybody else is going to be a lot smarter than we were before. And you won't be able to tell, in fact, you won't be able to tell from yourself what's AI and what's part of you, because it's part of yourself.
A
Does that require a human AI, Human brain interface like neuralink? Is that how it's going to happen?
B
It's not going to require surgery. Neuralink is useful for people that can't communicate and so on. It can be very useful for that. But for the rest of us that can communicate. Virtual reality is one way to do it. The other way is to actually tell what you're doing. You only have to actually detect what's going on in part of the. Of your brain where the key thoughts are generated.
A
So I could wear a helmet, do you imagine, or some sort of AI hat.
B
You won't have to wear anything.
A
Oh, okay. Although I'm willing to. I'm just saying I'm willing to. If you. If he's worn worse, I've done worse, so. But. But you anticipate there's. That in 20 years, people will grow up in part in kind of a team work with AI. Will kids go to school or will they. I mean, what. What does this look like? How does that. How does it happen? When do you get your AI implant? Or do you not worry about that?
B
That's a very good question. I'm really not sure about that?
A
Doesn't matter, really, if it happens, I guess. Yeah.
B
But if you do it, let's say, through virtual reality, I mean, you can get it at any time, right? You can put it on, take it off, just like virtual reality is today, and it can actually generate a broader view of each person. And we're doing that already. I mean, just carrying this around already makes us more intelligent.
A
No, I agree. In fact, I use AI all the time. And I now, as Paris and Jeff painfully know, I wear a little recorder. This is kind of like Gordon Bell's, like, memory thing, but it's not pictures. It's recording all the audio, which it then sends to AI for analysis. And right now, the analysis is somewhat trivial. It's interesting, but somewhat trivial. But I also feel like I'm building up a database of information that will, as AI improves in a few years, be really valuable.
B
Well, I took everything that my father wrote and created a chatbot with it, and you could ask him any question and it would actually find the correct answer. And it was like talking to my father.
A
That's wild.
B
So there's ways in which even though everything you're saying may not might seem trivial to you, you put it all together, it actually generates your personality.
A
Will it still be, you think, in 2029? Neural nets, LLMs, deep reinforcement, learning, the kinds of techniques we're using now, or do you anticipate new techniques to come along?
B
Well, we're adding new techniques. I mean, we have an LLM, but it can actually. Then code something and actually analyze it in real time and give you an answer and participate in the final answer it gives you. So we're combining different techniques together. Yeah, and the final thing will not be one thing. It'll be a whole grab bag of different techniques that work together.
A
Jeff, did you have. Yeah.
F
I'm curious, Ray, about your reaction to public reaction to AI. You've been a leader in this for your whole Life. And then two years ago, along comes ChatGPT, and people say, whoa, it can talk, it can listen, it can hear us in our language. And so the public attitude toward it all changed kind of overnight. And so I'm curious what your reaction.
B
Is, yes or no? I mean, the first ones were interesting, but they made a lot of mistakes, and they didn't know everything, and they didn't really have a human personality. Gradually, that changes and depends on which person you ask and which versions they're using. So it's not like it just came and it worked perfectly.
F
Oh, no, I absolutely agree But I think that the public perception was that it was a sudden arrival when it's been worked for years. What do you think about press coverage these days of AI as a whole?
B
I think it's beneficial. We're careful about the mistakes, but people are not alarmed by it. I think it will have a lot of impact on jobs. I think we will have. We will need to provide some stipend to everybody so they can participate in the economy. But I think when we actually have more intelligence, people will benefit from that.
A
I notice you use the word mistake and not hallucination. Some AI naysayers say that this hallucination problem is intractable, that this is going to be a harmful.
B
It's getting better. You compare hallucinations today to one year ago. Yeah, it's dramatically better. And I think we understand how to get rid of hallucinations.
A
Oh, you do? Okay. All right. How about safety? How about prompt injection? Things like that? Are you concerned about people breaking into AIs, jailbreaking AIs?
B
I mean, there's a lot of concerns that are difficult that we're dealing with. As the threats increase, AI's ability to thwart them also increases. So a lot of people generate what will happen will happen that are negative and completely ignore the fact that AI will help us to alleviate them. So I think we will be able to deal with it.
A
When are we going to hit the. When are we going to. I talked about the fifth epoch, which is when we merge. You mentioned the sixth epoch in your book, by the way. The new book is really a good read and fun to read. The singularity is nearer when we merge with AI. It's already a bestseller. You say in the sixth ethic is where our intelligence spreads throughout the universe, turning ordinary matter into computronium, which is matter organized at the ultimate density of computation. When's that going to happen?
B
Well, computronium, that's beyond 20 years from now.
C
Yeah, I would say so.
A
But it does. It does get exponential, doesn't it?
B
1 liter of computonium would be give you more capability than all human beings together.
A
Wow.
B
And we can actually change certain part of our matter into computernium and then it will make us again more intelligent. So I mean, if we're a million times more intelligent 20 years, it's not going to stop. Then it'll keep going and we can create.
A
It becomes exponential because we operate at faster and faster rate.
B
Yeah, just as so I'm not that concerned about going to other planets right now because we have plenty of things here on Earth to make ourselves more intelligent. But eventually we'll run out of that. So that's decades from now. At that point we'll want to go to other places in the world, but.
A
That will, that will be a job for next generation.
B
The fifth epic. Well, that brings up the fact that we can extend our own lives.
A
Yeah. I was going to ask you about longevity escape philosophy.
B
I've told you through a year and you're a year older. However, scientific progress is also creating new cures, new ways of processing disease. And if you're diligent, which I think the three of you are, you'll get back today about four months. So you age a year, but you get back four months. So you only actually age eight months every year. However, the scientific progress is growing exponentially. So by 2032, about seven years from now, you'll, if you're diligent, you'll get back not four months, but a full year. So you age a year, but you get back a full year. So you actually don't. You won't die of aging. This doesn't mean you won't die. You could get in an accident tomorrow. Although also making progress in accidents, self driving cars, for example, like the Waymo cars that are going through San Francisco and other cities have had zero accidents. Will dramatically reduce accidents as we get more intelligence. But, and so past seven years, you'll actually get back more than a year. So you'll actually go backwards in time.
A
Can't wait.
B
So we'll live longer. Ultimately we'd like that decision to be, be in ourselves. But actually people don't want to die unless they're in unbearable pain, physical, mental, spiritual pain. Otherwise people want to live. People say, oh, they don't want to live past 75 or 85 or 95 because they look at people who are quality life and many of them are not. You can't really communicate with them because they're too old. So we actually want to extend healthy life, not just being able to live longer.
A
I've often quoted you saying. I hope I'm not misquoting you. I want to live long enough to live forever.
B
Yes. That's the subtitle of one of my books.
A
Oh, I guess I'm not misquoting. I must remember it from there. How's that going? You used to take a lot of supplements. I know, right?
B
Well, when the Age of Special, when the. I wrote three books on health. When they came out, I was taking about 250 pills. I'm now down to about 80. They're actually more effective. I've had actually two problems that.
G
Were.
B
Dangerous and I've actually overcome them. My father died of heart disease when he was 58. His father died even younger age. I take Now Repatha. My LDL, which is my bad cholesterol is down to 10. Wow, good. Cholesterol is up to 64.
A
Holy cow.
B
And I've actually measured my heart and I have zero plaque. So I've really overcome that problem.
A
Is that with exercise too, or just supplements?
B
Well, the supplements is really what has created. I mean, I keep. There's other things which you want to do exercise for. I've also had diabetes. I now have an artificial pancreas. It works just like a real pancreas.
A
Isn't that amazing?
B
So I've actually overcome those two problems with scientific progress, which didn't exist when my father died 50 years ago.
A
Yeah.
B
So who knows what will happen tomorrow. But I think I'm in pretty good shape to be alive and well seven years from now.
A
I want to be here 20 years from now. I'm excited about the singularity, but I am 68, so it's going to be. I'm going to have to be, as you say, diligent. Do you ever. Have you ever published your supplement regimen?
B
It's actually in. In my books. I'm also writing an autobiography where I'll talk.
A
Oh, good. I want to see it. Good.
I
How long is it. How long does it take you to take 80 pills a day, if you don't mind me asking?
B
I take them while I'm drinking other things like coffee and.
A
Okay, here and there.
I
And I was gonna say me, I'm at like two and a half and that could take me a whole 10 minutes.
H
I can get distracted, so I'm impressed.
B
Well, it's okay. You've got 24 hours in a day. Maybe a third of them you're sleeping. But there's plenty of time to take some supplements.
F
Anything special about your diet?
B
I mean, I eat vegetables and fish. I avoid meat, so it's a good diet, but nothing too exotic about it.
A
Ray, we've had way more of your time than we deserve. And I thank you so much for spending time with us. And I really. If people are even slightly intrigued, I couldn't recommend this book more highly. It is a great read. There's a lot of information in here we didn't touch on. So many things. You talk about the new book, Singularity is nearer when we merge with AI I. Personally, I am Inspired by you. And I have always been excited to talk to you, and I think this is our fourth conversation. I look forward to when the autobiography comes out and we could talk again, I hope.
B
Yeah. Look forward to our future conversations. It's great.
E
Thank you, sir.
I
Thank you.
A
Great. Ray Kurzweil. We are so glad now to welcome our guests and actually some very prestigious guests. Emily M. Bender is. You may know the name, I'm sure rings a bell from the paper. We quote all the time. The danger of sarcastic parrots. Emily is also the co author of the AI how to Fight Big Tech's Hype and Create the Future We Want. She's senior fellow at the center for. Oh, no, I'm sorry, that's. I'm reading Alex's now. She's a professor of linguistics at the University of Washington, and. And I think the stuff you're doing with linguistics is fascinating, but I don't know if we'll get time to talk about that either. But welcome. It's great to have you, Emily.
J
Thank you.
A
Thank you.
J
Thank you for bringing us on the show.
A
Yay. Alex Hannah is, of course, the co author of the AI Con, the director of the Distributed AI Research Institute, and with Emily, she hosts the Mystery AI Hype Theater 3000 podcast. Do front of a screen and then make fun of AI Videos. What is that?
E
Oh, I wish we did it like that. I'm director of research. Not director, that. The prestigious.
A
I'm sorry, director of research.
E
No, but we don't. We don't do. I mean, you know, it wouldn't make for good podcasting because it would just be the back of our heads, and I really don't want anyone looking at the back of my head.
A
So I am going to admit that I am a fan of AI.
G
I.
I
Think it's important to note that perhaps 25 minutes earlier in this show, he's like, you know, people keep trying to paint me as a fan of AI and I think that's just perhaps a miscalculation.
A
I love AI. I love it. I use it all the time. I use it as a coding assistant. I use Claude code. I use Perplexity for search. I'm very impressed with the great strides these machines and these tools have made. I also understand that there are issues. I've read your Stochastic Parrots paper, for instance, Emily and I, and I completely agree with it. But is it a con? Is it a conversation?
E
Yeah. Yeah, you were.
D
I heard.
A
We heard.
J
Now my back. Okay.
H
Yes.
J
So I was saying we've got A whole book for you.
A
I see.
J
And I said it very quietly, apparently.
F
May I take the liberty of reading from your book for one second?
J
Sure.
F
Page four. Artificial intelligence, if we're being frank, is a con, italicized, a bill of goods you are being sold to line someone's pocket. A few major well placed players are poised to accumulate significant wealth by extracting value from other people's creative work, personal data or labor, replacing quality services and with artificial facsimiles. We call this type of con AI hype.
A
You don't mean everything, do you?
J
Well, so the first thing that we do is we want you to disaggregate. And that's what I was trying to say before when I muted myself is I'm glad that you named the specific things that you're using, because that was gonna be my first question. What do you mean by AI? It's not one thing. And you named Claude for generating code and Perplexity for information access. And those are two specific applications. There's things I also pay for.
A
ChatGPT, I pay for Claude, I pay for Microsoft Copilot, I use them all. But that's part of my work. Now, I should probably also warn you because Paris is going to out me if I don't. I also wear this BAI pin. This thing records everything. Sends it to the iPhone, it sends it to an unnamed AI, which the folks at B never really kind of explained what models they use, and then sends me back a summary of my day that is incredibly sycophantic, but I enjoy it.
I
But do you use that for anything?
E
Yeah, it's like the. This is like the humane AI pin, right? That.
D
It's not.
A
That was a con. That was a con. Okay, well, okay, stipulate that.
E
Okay, but explain the difference to me. I mean, I. I frankly, I don't know what the device you were holding.
C
Yeah.
D
Does.
A
So what this is is basically it's a microphone that is connected to my iPhone, which then sends the audio recordings out, named Rosie. And that's true, by the way. This is. It generates facts about.
D
Look at that.
F
It's true.
A
It's true.
I
It records everything that he does or hears every day, then sends that to the cloud, transcribes it claims to get.
A
Rid of all the recording, throw away the audio, then. Right.
I
Keeps little facts about Leo, but then he has to go on his phone and be like, yes, I do have a cat named Rosie.
A
So can I read you my daily memory from yesterday? How about that?
I
Was this your first time you've Looked at it since.
E
Go ahead. And then I have a comment.
A
If you want to throw up, Alex, please be my guest.
E
I'm not gonna throw up. This is great. No, just gonna.
A
Celebrating family bonds and new beginnings with laughter, tech talks and a cat named Rosie. Today was dynamic and engaging day for Leah. It's a little sycophantic. I tried to turn that off. Marked by a blend of personal interactions and professional commitments. The day began with lively celebrations of some birthdays, which I did not celebrate, where Leo showcased his humorous side among friends. I don't know where it got that from.
I
Maybe this is from. Were you podcasting yesterday?
A
No. You know what it does. This is a flaw, which I'm sure they will. Look, I only. First of all, if it's a con, I only paid $50 for this once. No subscription.
J
$50. And all of your privacy and all of the care about my people who you talk to. And that's the really invasive thing.
C
Yes.
I
Leo, do we want to mention what state you're in?
A
I'm in a two party state and it.
E
Wait, are you in California? Because I saw the thing that said that you're in. Are you in Petaluma?
A
Yeah.
E
Oh, okay. Well, I saw that you're in Petaluma.
A
Yeah. You're in San Francisco, right?
E
I'm in the Bay Area. I'm not going to say where I.
B
Am, but you know.
A
Oh, I can tell you about my privacy.
E
But I guess what I wanted to say, I mean, this is Christmas. Gileard has a, as a, has a statement, you know, as a term for this. It's called luxury surveillance. Right. You're paying, you're, you're, you're giving these companies the privilege to follow you and track you, you know, and the things like paying them.
A
I'm paying them.
E
Yeah, you are paying them. I mean, you're the, you are doing that with your free will and your free dollars and you're doing it and. But I mean, the thing about Luxy surveillance that Chris taught about that's so, that's so insidious, is that they're, they're using this. It's. You get to do this voluntarily, but they're also kind of testing it on you. And then they're taking it to folks who are incarcerated and they have no choice about this.
A
Right?
E
I mean, this is a kind of this. And then, I mean, and then what Emily is saying, in addition to the people who are not consenting to this, I mean, is it hearing us? I mean, we don't consent well, wait a minute.
A
You're on a podcast.
E
We're on a podcast.
J
Well, it doesn't.
I
It can't hear us because we're in Leo's headphones.
A
Actually, it doesn't, but other people hear us.
B
Okay.
A
But I. I do want to recognize that I can do this at a privilege. I'm a. I'm a. Yeah. Cis. White. Old white male. And I don't have any. There's much less risk for me than there would be for an incarcerated prisoner or all sorts of people and immigrants.
E
Risk for you. But, I mean, it's the fact that. I mean, this is a technology that gets kind of honed. Are people who pay for them that.
A
People I'm helping to make it better.
E
Yeah.
D
Right.
E
I mean, you are giving training data up voluntarily, and, you know, I mean. Leo, how closely have you read their privacy policy?
A
Oh, I read it. I did. I read it.
J
Oh, 77 pages.
E
Did you read it or did you have Claude summarize?
A
Well, I did both. Okay, great question. They're very good, these.
D
These.
F
Well done, Alex.
E
Well done. Okay.
A
These AI chatbots are very good.
I
They're very good until they get something wrong. Like they did in the int. For our two guests.
D
Yeah.
J
Oh, and you were just saying that it got wrong. So it sounds to me that the app that you are paying for and honing, you know, surveillance through paying for, is basically a daily diary for someone who's too lazy to do a daily diary. Is that what, like.
A
Yeah, and this way I don't get any of the insight or, you know, any of the deep understanding.
E
There's no reflection.
I
It's just output.
A
Yeah. In fact, I just copy and paste it into my diary and I'm done. It's great. It's real fast.
I
You could get a chatbot or something to probably do the content copying and pasting for you so you don't have to look at those things.
A
I'm gonna write a script to do that.
E
You might even get a chatbot to do the introspection for you if you're particularly enterprising.
A
They're very good at it. Actually, I want to go back to.
F
What Emily was starting on earlier, before you. You outed yourself with that. Leo is kind of good uses, bad uses, that there are lines and. And reasonable lines.
D
But.
F
But what are some of the criteria for those lines? Good uses of AI and bad uses of AI.
J
So, again, I'm not going to say AI, but I think we can talk about good and bad uses of automation.
A
You say AI on your Cover is.
J
That so we had an interesting fight with the copy editor because we'll also look, between me and Alex, I wanted to put scare quotes on AI, like every single time we use it. At one point I actually had the phrase so called scare quotes AI. And Alex is like, Emily, you can have so called or you can have the scare quotes.
F
You can't have so called as an editor. Alex is right about that.
J
Yes, but so we use it without scare quotes when we're naming an industry and when we're naming the con and when we're naming a purported research field. But when we're talking about systems, tools, these kinds of things, that's where we want to take distance. And so I am happy to talk about good and bad uses of automation, but I'm not going to talk about good and bad uses of AI because that sort of presupposes that AI is a thing as opposed to an ideological project.
A
Okay. Yeah.
E
And I think there's, I mean you, Jeff, you started with a quote from us, so I will do the thing where I will respond with a quote. And so on page 14 we say there are applications of machine learning that are well scoped, well tested and involve appropriate training data such that they deserve their place among the tools we use on a regular basis. These include such everyday things, things such as. Or not such as. I'm adding that things as spell checkers, no longer simple dictionary lookups, but able to flag real world words used incorrectly. And other more sophisticated technologies like image processing used by radiologists to determine which parts of a scan or X ray require the most scrutiny. But in the cacophony of marketing and startup pitches, these sensible use cases are swamped by promises of machines that can effectively or do magic, leading users to rely on them for information, decision making or cost savings, often to the detriment or to the detriment of others due to their detriment. So yeah, I mean, thinking about first doing that thing and disentangling and saying there is no unified technology such as AI is helpful because it un. Reifies it, unthinkifies it. And this is something we're riffing off. Lucy Suchman here has a great article called the. Is it like the uncomplicated. What is it called? The uncomplicated thingness of AI. This article that she has and then, and also Emily Tucker, she has an article called Artificial Intelligence which disentangles us and says we need to be. And she's speaking specifically about the harms of AI and how we need to Be very specific in the technologies we talk to because it helps talk about what those harms are, especially specifically. And so, yeah, I mean, we're not opposed to machine learning or a body of methods that could be large pattern matching at scale, because that's pretty useful in some domains. But these quote unquote, you know, everything machines that Tim the gibberish has, has called them is, is, is, is something that, you know, is, is not what we're looking for and not helpful sort of technology in the world.
I
Obviously there have been a lot of technologies, even just over the past decade or two that have gone through hype cycles. Why do you think that the hype cycle we're seeing for AI is so pronounced and seemingly on a scale that's unparalleled?
J
It seems to be basically a meat point between enormous amounts of investment and this connection to our science fiction imagination that we have been cultivating. And I love genre fiction so like, no, no shade on science fiction, but I do want to cast shade on the tech companies that are basically borrowing from science fiction discourses and saying those worlds that you had so much fun imagining yourself in, they're real now because we're going to oversell our technology and say that it's exactly that thing. So I think it's that kind of a combination, plus maybe the fact that we have even greater centralization of capital than we did in the previous hype cyc. So there's like more money to do it than there was previously.
A
You talk about your issue. Excuse me? It sounds like your issue is of classification though, right? You're not against LLMs?
J
Well, so language modeling as a technology is old and useful. Synthetic text extruding machines, taking the LLMs and using them to just like produce text that corresponds to nothing anybody said. I do have an issue with that.
A
Okay.
J
And I think it's actually despoiling our information ecosystem too. I mean, your diary that you don't really care to write. It doesn't really matter that it's got a bunch of untrue things in it. But as soon as someone starts using perplexity to look up information and then sharing that information, this can be quite problematic.
A
Do it all the time.
I
He does it all the time. And no matter how many times we show him or tell him, hey, not everything perplexity says is always accurate continues.
A
Well, I say that it's important for humans to be part of the process. I'm not saying, you know, just let put the AI stuff out, but I found it to be very useful you know, I generated your BIOS with perplexity. I, of course.
E
And it got something wrong. And immediately it said that Emily was the senior. I think.
A
No, that was me. I was me getting something wrong. And by the way, old guy, let's point out humans make mistakes too. And I agree with stochastic parrots. One of the points was, you know, because it's a computer, we ascribe it more, you know, accuracy and importance. And I think that is an error. I agree with you 100% on that.
J
So people make mistakes, systems output errors. And one of the things about making a mistake is that you can take accountability for it and you can learn from it. If a system makes an error, then it becomes a question of, okay, are we using the system in such a way that those errors are going to cause problems or such a way that we, we can catch the errors. But I don't think it's fair to say humans make mistakes too, as an excuse for the errors of a system that couldn't possibly take accountability for them in the first place.
A
I only mean it in the sense that I vet the input I get from humans as well as from LLMs. I mean, it's probably imprudent to trust either fully.
J
So I think the relationship that you have with a person that you are exchanging information with and the relationship that you have with an LLM or ought to be different things.
A
Why?
J
Right. So among other things, if you hear something from a person and it seems fishy, you can ask them for more information. Where did you get that? And what they say back to you is if it's in good faith, actually their understanding of where they got it. If you put a query in to Claude or ChatGPT or perplexity and something came out that looked fishy and you said, oh, tell me where you got that. What comes out is just more synthetic text and actually has no bearing on where the previous synthetic text.
A
That's correct.
E
Yeah. And I mean, I think there's really kind of an idea that, I mean, you have kind of a model of action of what's going to happen in a relationship, but you don't really have a model. You know, I can have meaningful expectations with Emily as my co author. I know her disciplinary background. I might not have that kind of meaningful interaction with a complete random person, but at least may know various different courses of action if I'm being had, if they're a con man or.
A
Look, I understand, but I'm not.
E
Yeah, but the LLM is. Well, first off, I mean, what is driving, you know, what is. You're, you're still using a probabilistic machine.
A
And there's, I think humans are probabilistic machines. I hate to say it, but I don't think there's much of a distinction.
G
So this is.
A
However, I make the distinction between now.
E
We'Re going to, now we're really stepping in it.
A
Humans and machines. And I also understand that the language we use, like artificial intelligence, muddies that distinction, and I think you're right to correct that. Reason, thinking, training, those things should not be those. We just, we don't have a good language for talking about this kind of thing, these machines.
F
Well, Emily, both of you, as linguists, do we have a better language? What do you suggest in place?
J
The reason we keep running into problems saying, well, we don't have a good word to use instead of reasoning for describing what these machines do is because people want to say it is something like reasoning and it isn't. And so we're looking for, like, reasoning with a little decoration on it that says, well, this is the computer version of it. And that's already wrong.
A
I agree. I agree 100%. But again, in discourse, especially on the show like this, we have to use language that people understand. So we have to use similes and metaphors. But I think it's really important to say that it isn't the same thing. They're very different. And I don't disagree with you. I feel like that's nitpicking. The value, though, of what you get out of an LLM to say, well, it's not human, it's not reasoning. That's true.
J
So you might be finding value in the output of an LLM.
A
And I'm not alone, but you are.
J
The one finding that value. It is not that it is valuable.
D
Right.
C
Well, so what?
J
Okay, so environmentally ruinous and built on lots of stolen data, built on lots of labor exploitation, and also unreliable. But sounding confident.
I
You might.
A
This is how the, this is the Internet you're describing.
I
Well, Google search was not that unreliable yet sounding confident until the introduction of AI and recent changes over the past, like five to 10 years.
J
So, like, Google search has problems and you look to the work of Dr. Sophia Noble for nice documentation of it, like really thorough scholarly documentation. But that being said, when you did a Google search and you weren't getting these AI overviews out, what you got was a link to a webpage that you could go evaluate that somebody had accountability for. And I tried to cut you off.
I
There, Paris Yeah, no, that's pretty much.
F
I mean, she's using.
I
That's much better than what I was going to say.
E
And the provenance, I mean, the provenance is support and we hammer on it. And I mean, there's a few. I'm so like trying to go back up to the chain to a few things. I mean, the metaphors. Because the metaphors matter, right? I mean, we can use the anthropomorphizing language and what it does, it does a few things. It does this. This notion that this thing is intelligent or there's some kind of access to some kind of a brain like infrastructure that is retrieving that intelligence does, does get kind of equated with consciousness. And you know, you don't have to go too far back to understand that intelligence has this very Eugenesis history. And part of that eugenicist history is also equating intelligence with consciousness. There's this essay by the late David Columbia where he talks about this notion of the equation, the equating of intelligence and consciousness and how it's being used of, you know, relating to certain people as subhuman because they're not as conscious. Right. So that's, that's part of what it does. Another thing is these things is, okay, the learning, or it learns just like a child does, or it's doing the same thing. And that's absolutely not what it's doing. And that matters quite significantly because then we get into weird territory of like two robots have rights or you have this idea of syncopacy or you're attributing human traits to probabilistic modeling. And that's a very dangerous road.
A
Yeah, I agree with you 100%. In fact, I fought, I fight all the time on this show to kind of de. Anthropomorphize our language. It's unfortunate we don't really have a lot of choices, but I think you're absolutely right. It's one of the reasons when we talk about AGI, I say, well, that's really. That's a meaningless.
F
That's bs.
A
Yeah. So, but, but at the same time, that's a legitimate criticism. And I agree that language also, and I know this is a lot of Your work too, Dr. Bender, is language kind of informs how you think how one. One perceives things. So it's really important. But I just, I feel like to me there is some utility to this stuff and I recognize there's environmental damage to it. There's, you know, but there is environmental damage to using the Internet. Maybe not as much, but there is significant environmental damage to using the Internet. It's not unusual for us to use technologies that have consequences. A lot of jobs have been lost to the Internet. Is that enough to say let's. Are you advocating the abandonment of this line of inquiry?
E
I mean, it's not. We're not opposed to exploring different kinds of, of thinking of. I'd say not even opposed to the kind of class of methods of learning from a set of data that is a helpful kind of series. You know, it's a helpful innovation.
G
Right.
E
Language modeling is helpful. I mean, it would. I say, I've been saying on all these interviews, like my dissertation was building a prediction model that was, you know, the certain. Was doing classification of, you know, whether something fell in one bin or another relating to something that was useful for social movement researchers. That's fine. Modeling things is fine. We're not going to that place. But you also have to see about what comparatively you're doing.
G
Right.
E
I mean, we have the. We're in this moment where data center production is actively inhibiting the climate goals that, that the Paris Agreement set out.
A
Right.
E
Microsoft and Google had climate goals that. Microsoft said it was going to be carbon negative by what, 2030 or 2045.
G
Never mind that.
D
Yeah.
E
And it just completely blew it out of the water. Google went 49% over the 2019 baseline. You know, this, this is. And so you have in. And I mean, that's from their own sustainability reports. There's some estimates that say that it's. It's maybe closer to 2 or 300% because they're not factor. They're. They had factor in carbon credits and carbon offsets. And so you have this. So comparatively, I mean, it's doing much more. It's much more ruinous for the environment. In addition to increased tip fabrication and pfas that's going in forever. Chemicals that are going into the ground. You know, technologies that the earlier hype cycle of computing turned parts of Santa Clara county into Superfund sites and caused, you know, so many. Just a whole rash of people and women experiencing birth defects. Then you have.
A
But we're participating in that right now on a zoom call. I mean, yeah, the best solution society where we make our own clothes and wear our own food. But I don't think that's gonna happen. I prefer it.
I
Leo.
E
It's like comparing slippery slow fallacy. Right.
C
All right.
A
Okay. Okay.
E
I mean, you really want to go down there? I mean, we're not, you know, we're not.
A
I'M just saying there are consequences to technological innovation, the industrial era.
E
Who's asking for this?
I
I'm trying to compare the environmental impacts of large scale AI production and training. Trying to compare that to like a Google search or a zoom call is.
A
Like, it's like, it's like comparing a.
I
Forest fire to a match. It's. I'm not. And I think if it's the dominant technology, where all the venture capital dollars are going, where all of the investment energy, where all of the R and D focus, where every company is focusing on and pouring all of its resources into, that's going to have a considerable impact on the world, especially if it's extremely energy inefficient and disastrous for the environment.
F
I want to, I want to examine something else, which is the meaning of meaning. I scream all the time that large language models have no sense of meaning, thus no sense of trouble, truth and so on. But since we have a professor of linguistics here, how do we define meaning?
J
So this is tricky. And I want to point out that I was recently actually in Mountain View at the Computer History Museum doing a debate with Sebastian Bubek hosted by Eliza Strickland of IEEE Spectrum, sort of putatively on the question do large language models understand? And I took that seriously and provided a definition of meaning and understanding and said, said no. And Sebastian said, well, nobody knows what understanding means. We've been struggling with it from millennia. I'm like, I just.
F
Nobody understands understanding.
G
So.
J
So the definition that Alexander Kohler and I gave and by the way, I collect co authors named Alex, in case you haven't noticed. Different Alex, Alexander Kohler and I have a book called Climbing Towards. Sorry, not a book, that was just a paper. Climbing towards nlu, I forget the subtitle. But something like a meaning and understanding in something in the age of data. And don't ever put an acronym in a title. That was a bad idea. But anyway, this is a paper where we're talking about this question. This is published in 2020. Do large language models understand? And the crux of the argument is that languages are systems of signs where you have for any given word, there's the form of the word, how you spell it, how you say it, if you're speaking a sign language, how you articulate it with your hands and your face. And then there's the meaning, what does it refer to? And that meaning, meaning is a conventional thing that's shared within the community that the language belongs to, but also is sort of constantly changing every time you use a word so it's true that meaning is use, right? That when you use a word, you change the meaning, but that doesn't mean that if you just look at all the word spellings next to each other and see which letters in which combinations go without letters in which combinations, that you get to the meaning. And this is a really important distinction. And it's hard to see, especially if you're a. Not used to being a linguist and looking at language this way, because when we perceive language in, you know, from a language that we know, we immediately have a guess as to the meaning. It's right there. So it's really hard to separate the form and the meaning when we are in a context where we know a language. You can feel it. If you think back to foreign language classes you've taken, or I have this thought experiment that I like to take people through, or I say, imagine that you are in the National Library of Thailand. Or if you speak and read Thai, then it's the Parliamentary Library of Georgia. And if you speak both Thai and Georgian, then I want to meet you. I haven't. Haven't met that person yet. But, you know, so one of these places, so let's say Thailand. And I've gone in ahead of you, and I have removed every single book that had anything other than just Thai script in it. No pictures, no mathematical equations, no bilingual dictionaries, just Thai. And I arranged for someone to bring you delicious Thai food three times a day. You don't get to talk to them, but, you know, you're fed, it's comfortable, you can stay there as long as you want. Could you learn Thai? Right? And if so, how? What would you do? And the kinds of answers I get from people are, well, I would very carefully go through and find, like, the really commonly occurring subsequences. I'm like, yeah, well, that would help you figure out what the function words are. Like, maybe. Maybe Thai has a word like that, and it's probably this one not gonna tell you what anything else means, right? Or I would look and look and look until I saw a book that I knew was a translation of a book I already know, and then I could work it out from there. Well, sure, but then you're bringing in some external knowledge. My favorite answer is I just eat the yummy Thai food. So the point of all this is that the meaning is not in the text. We get to the meaning because we bring in our knowledge of linguistic system and also all of our reasoning about what the person must have been trying to say. By picking those words. And what a language model gets as its input is just the form of the text.
A
So what's your prescription?
J
What's your prescription? So in general, make sure you're using technology that is well scoped and evaluated for the context that you're using it in, and also, by the way, as ethically produced as possible. And so you said before, you know, are we saying to, you know, do you want people to stop doing this? And Alex gave the first part of the answer, which is, you know, machine learning applications make sense. Technology, you know, there's, there's reasonable technologies. But what I would like people to stop using, and I would like to basically discourage people from using, is the media synthesis machines. So synthetic text, I think is problematic. Synthetic images. So image generators, I would feel okay about if I knew that they were collected on consentfully contributed images and the artists were getting credit for it. And they weren't just like everything, including lots of really awful stuff scraped off the Internet and they didn't have to have their output cleaned up by exploited workers. And even still, you would want to say, by the way, this image was synthetic.
E
Yeah. And I mean, in addition, synthetic image generators and video generators are that much more environmentally ruinous comparatively, just because inference cost that much more.
A
Yeah, I think you're in a losing battle. But okay. I mean, that sounds fine to me.
I
I, I like it. Yeah. But you think it's a great thesis.
A
It's fine, but it's. It's like saying that everybody should stop wearing running shoes.
F
But don't we have standards for something? Aren't there things we want to try to aspire to?
A
Absolutely. I know. I'm not saying they're wrong. I'm saying you're absolutely right. I just think that the, unfortunately, the horses left the barn part of this.
F
Is not just the technology. You write about the hype and the harm.
A
Right.
F
Talk about the harm of the hype.
A
Right.
E
So that's media.
F
That's not the technology, that's us.
E
That's the hype itself. Right. So we define hype as the aggrandizement of some kind of a product that you must use. And if you don't, you will be left to, you know, to whatever. If you're, if you're a student, you'll be, you're not going to be learning as much. If you're a teacher, you're not going to be able to grade as much. If you're a worker, you can't use it in the workplace. And then, AI Hype has that particular quality of being about this particular technology. Right. And so one of the things that we're seeing, and I'll speak, you know, specifically to working conditions, is that much of the technology does a pretty poor job and it has all these different features that Emily spoke about, and people are losing jobs to it left and right. So you can see what's happening with the Doge Boys, which originally what that had been the tool that they had been using, it's called gsai. One of the developers went to bluesky to talk about it, and it had originally been a sandbox that was being used to test and evaluate different LLMs and different. I don't know if they did anything other than LLMs with that technology, but it was an evaluation sandbox. When the Doge Boys came in and they took over the US Digital Service, they said, oh, look at this thing. We can automate XYZ with this. Part of that's because of who Elon Musk is. But then. And much of that, I mean, he's a high participant. And so we can replace all kinds of creative, important work that has to do a lot with institutional knowledge about making the government work as it should and taking and removing those jobs whole cloth. Same things happened. I was reading a piece just recently by Bryant Merchant when he was talking about how Duolingo was replacing so many different content developers, people that were writing interesting questions. Good, good and reliable translations and replacing them with some kind of a. Pretty bad. And we're not sure what it is. Probably some LLM of. Of that. And now what did. What they expect is that Duolingo is going to have these translations or even these vocalizations that are supposed to be accurate representations of language. And now that's just completely gone with that. With that product especially.
F
They're getting some marketing pushback for market pushback.
A
Well, yeah, it doesn't work well, yeah, stop using pr.
E
But I guess that's the thing Leo is like, when. When is it working? Well, I mean, it's saying like, these things cannot. There's. There's very few instances in which a technology has replaced least one thing whole cloth. I mean, maybe we have the horse and buggy. I think one. One thing that people talk about is the elevator operator. Right. I mean, more of what it's doing is it's either taking something that was an important, an important kind of labor function out of the world or is displacing that labor onto someone else up or down the supply chain.
D
Chain.
B
If I, if I could put you.
F
Both in front of a room of 50 technology journalists. Something I actually want to do.
E
Oh, thank you.
J
Sounds good.
F
No, I, I do. The problem is getting them in the room. And, and Paris is a technology journalist, but a smart one. What would you, what would your message to them be about this hype?
E
I mean, that I would. One thing would be that technology journalism has become so much access journalism has been about reprinting press releases. It's being very credulous.
A
Right.
E
About what products do and what they are and why we should be wowed. And I think we really need to go back to the first principles of journalism thinking about, well, who's benefiting from this and why are they selling something like this? What do they have to gain? What is the political economy thinking about this industry getting beyond the GE whiz of the product? Garen Spurk, who is a journalist at the ap, has a really nice guidebook that she helped develop with the AP in which she says as much, you know, get back to your ABCs of journalism. And then Karen Howe has also been doing these trainings with the Pulitzer center around how to report around AI. She's also coming out with a book on OpenAI that we're going to be in conversation with her in a few weeks that's called Emperor Emperor Empire Empire of AI, which is about open AI in the palace.
F
The sequel is Emperor of AI.
J
The sequel is the Emperor has been closed.
G
Right.
E
You know, it's about the downfall of OpenAI. Fingers crossed. But it's, you know, these are important kinds of shoe leather journalism that we need folks to do and really getting away from the product and the press release puff pieces.
J
Yeah. And so everything that Alex said and I think just the sort of lower level details, I mean this high level thing of basically holding power to account and tracing who's benefiting is the main job. And then one of the lower levels level steps is to be very, very skeptical about claims of functionality especially. I see a lot of really frustrating journalism that is driven by what we've taken to calling paper shaped objects that these tech companies and nonprofit ish tech research labs are putting out into the world. Sometimes no longer even on the archive preprint server, but just like on company blog pages. And they tend to be a lot of them very, very slim on details of how something was evaluated. And then you'll see reporting that like pulls numbers out of these papers and doesn't contextualize them as being just academically worthless. And we have a lot of fun on our podcast, sort of tearing apart some of these paper shaped objects. So we don't, we don't watch videos and talk over them, but we do read out bits of articles and react to them and that's, that's where the Mystery Science Theater inspiration comes through. So I think that, you know, journalists are really great at coming in skeptically or can be. Right. And as Alex mentioned, there are some wonderful people doing great work in this space. Unfortunately, there's also a lot of the gee whiz access journalism that probably pulls in more ad dollars because the tech companies want to advertise their products next to it. Although it was fun this morning, we.
E
Did have a fun thing where we had two. So we were on March Marketplace tech together and then Emily was on the CBC in Canada. And before the marketplace tech, there were, I think there was a few different versions of this depending on, you know, who it went to. But I think it was uniformly an AI ad, or at least a one. I think the one I got was a fintech ad. It was Robin Hood.
J
And yeah, so I got a couple different versions of an AI ad and the, the host starts the piece about the interview with us with don't believe the hype about AI. And it was so great to hear that right after this AI ad.
A
Kind of exactly where we are right now, which is surrounded by AI, but don't believe the hype. I, you know, I don't disagree. I'm not, I don't disagree with you. But at the same time I feel like there is some real value in these tools, schools and, and I think some of the, some of the points you make are absolutely valid. I mean, you could make the same environmental points about automobiles. In fact, it's a real shame, Leo, that we got automobiles and that if, yeah, no, if you had come along 100 years ago, maybe we would have trains and, and bicycles.
E
Boy, people tried.
J
Do you know why we have so few trains in the US and so few rail based urban rail systems? Urban transportation systems. It's because the tire industry advocated for tearing up those rails so they could sell more tires. And I am mad about that all the time.
A
That's the power broker story. We were talking about that.
J
Exactly, exactly. So the car metaphor is apartment and you're maybe setting it up as a slippery slope thing, but it was a problem. We took a wrong turn there. That doesn't mean we have to do it again.
A
Right.
E
No pun intended there. And I think that's another thing. I mean, so just a, I mean, push on this. I mean, I think it's There's a. For our podcast, we reviewed an awful book, absolutely awful. It's called Super Agency, and it's written by Reid hoffman, who founded LinkedIn, and Greg Rado. Not Rado. Beato. Thank you. Like always, Emily is much better retaining name than I am. And I, I say it rhymes with this, I think. And so one of the things that he criticizes in the book where they criticize.
F
I don't think anything rhymes with be. That's the problem.
E
Beato. Yeah.
A
Orange. Orange rhymes with be.
E
Nothing rhymes.
D
Yeah.
E
And so one of the things, one of the anecdotes in there, which I think it drives me up the wall, is the. He talks about the Luddites, and we talk about the Luddite center, but book, too. And there's a few recent histories of the Luddites that folks like Brian Merchant and Gavin Mueller and Jason Sadowski talk about and have talked about.
F
And.
E
He says, you know, what if the Luddites had one? You know, and everybody would rush forward and industry would be rushing forward and then. But, you know, we would have solved child labor all over the world, but Britain would have had really nice blankets, and they would have been artisans. And it's just, to me, that strikes me as so patently ridiculous. It's like, how do you think child labor was fixed? How do you think the weekend was created? You know, it was from people actually fighting back against technologies that made their lives worse. As if, you know, as if these things, you know, solve the themselves. And it's not through massive worker struggle or struggle against child labor or struggle against environmental degradation. I mean, you know, we can think that the horses left the barn here, or the train has already left the station or whatever. 1.
J
Speaking of trains, we don't have any stations, though.
G
I know the car has left the parking lot.
E
The car, the car has left the garage. You know, the Porsche has left the dealership, the Tesla has left the charging station, whatever.
F
The cyber truck, however, has gone nowhere because it's broken.
E
The cybertruck has burst into flames spontaneously. And, you know, but I mean, that's. It doesn't mean one shouldn't struggle for this.
A
Right.
E
I mean, and that's, I think there's. There's a notion that there's the engines of history, as if technology moves itself, you know, but absolutely. And as if protections come into play from the beneficence of billionaires. But that certainly doesn't know.
A
That's not true.
E
Right.
A
Yeah.
E
So why. Why struggle against her? So why have good journalism on this or Right. Why write a text like this when the mainstream seems to say, you know, when on June, three. I mean, I, you know, first off the mainstream may say that, but I mean, a lot of people don't like this stuff.
A
50, 50. I'd say between it's less than 50.
E
50, it's something like 80, 20. I mean, that's, you know, there was a survey that Pew did of, of workers, and they said something like 17 of workers had used this at work at all. And then, you know, most people hadn't heard of it. And then 30 people just didn't want to use it at all. And Pew has done a few. And we were quoted for the piece on Ars Technica that talked about the comparative of the general public versus AI, quote, unquote, AI experts in general. The general public is like, what is this? What is this? And then the people that had heard of LLMs were like, I don't want anything to do with this. And so I think there's, I mean, most people, you know, Leo, you say you're CIS white guy and. But, but also you're, you know, you've got your technologist, you got this Apple computer in your background.
A
I've been reporting on computers for 40 years.
D
Yeah.
A
And I've always attempted not to be a beltway journalist, to be a, you know, industry journalist. One of the reasons you're on the show, I mean, this is a show about AI, and one of the reasons you're on the show is to. Is to get all points of view. I don't disagree with you. And I. I think Create the future we want is probably really the, probably the most important part of the title. It's an opportunity for us to, to say this is not what we want or this is not how we want it to be. So I. Everybody should listen to your podcast. There's somebody in our chat who says, don't let them forget to plug Mystery AI Hype Theater 3000. It's really good. So we'll plug that.
I
I'll be listening to it after this. Sounds exactly.
F
Hold up your books again.
A
Hold up your book on how to fight big tech's hype and create the future.
F
All my little things there.
A
And there's actually a really good web page for the book, which is where you should go, not to Amazon, but go to the web page and you can read more about it and, and, and for. And so forth, and submit fresh AI Hell if you wish. Just. Just come up with some fresh AI Hell.
J
And it's all over the place. And that's for the podcast. We end each episode with a small handful of fresh AI hell, and then once a quarter or so, we have to go through the backlog and we have a sort of frenetic but cathartic all over the episode.
E
So much.
I
And to be clear, the very cool website is thecon AI. Very easy to recommend.
J
That was Alex's stroke of brilliance to think if that was available and then to grab it when it was.
A
Acronyms may not be good in book titles, but they're excellent for tlds. That's all. Thank you so much. It's great to meet you both. Emily Bender, Alex Hanna, thank you so much. The book, again, the AI Con. You've really raised some great points. I appreciate your time.
J
Thank you very much.
E
Yeah, thanks, Leo. Thanks, Paris. Thanks, Jeff.
A
Hey, don't let me interrupt. I know we're having a blast here reliving 2025, but I thought this would be a good time to mention something we do every year around this time that's very important to us and to our ad sales. It's our TWIT survey. We do it because we don't really. And no podcast does know anything about you. That's, I think, a good thing. We respect your privacy, but we also would like to know a little bit about you to the degree you're willing to help us out. Just some basic information that helps us go to advertisers and say things like, well, 80% of our audience is it, decision makers, that kind of thing. That's why we do this annual survey should only take a few minutes of your time, as I said, is one of the ways you can contribute to keeping TWIT on the air. If you would like to before too long in the next couple of weeks, do it now while you're watching. Go to TWiT TV Survey 26. It's our annual 2026 TWiT listener and viewer survey. It's very important to us and I thank you. I really appreciate. And of course, if you don't want to do it or there's questions you don't want to answer, that's fine too. But any way you can help us out, we appreciate it. All right, now back to the show. Hey, we have a really good guest this week. I'm very excited to say hello to Mike Masnik. You know him, he's been on our shows before as the founder and editor@techdirt.com he has created card games. He is the author of the Moderation Speed Run Which Linda Yaccarino has now come to the end of. We'll talk about that in a little bit. He's on Bluesky's board. He is on Bluesky itself as M Maznick. M A S N I C K It's great to see you, Mike.
C
Yeah, great to be here. You said we had a wonderful guest and I was wondering who it was.
A
It's you. You're the guest. And the reason, you know, the reason I wanted to get you on is because you wrote this amazing article a month ago. Stop begging billionaires to fix software. Build your own. Which is funny because this was the philosophy in the earliest days of computing.
C
Yep.
A
Write all your own software, don't let the other guys do it. I think until very recently that wasn't a reasonable thing to expect a normal person to do. But do you have coding, a coding background?
C
Not really, no. I mean I think I study at school. I didn't. I was self taught but I haven't touched code since the 1990s.
F
So Fortran, eh?
C
It was a little post Fortran.
A
Let's see your past.
C
We'll see a little PHP stuff and some other stuff there. But yeah, I mean my coding knowledge is so out of date that it effectively I have no coding knowledge whatsoever.
A
Good, because you came as an open book, as a blank slate to the idea of vibe coding. You wanted to write your own knowledge management system, your own like to do list kind of thing.
C
Yeah, yeah. And I had played around, I played around with a different app for. I just was like trying to explore and then was thinking about. Because I've used a bunch of different sort of task management apps over the years. Like, like many people I'm sort of, you know, have been historically on the hunt for like the perfect task management app that works with my brain and I don't get sick of using after a week and it's overloaded with tasks I never get to.
A
Well, the canard is that people would rather, you know, spend time working on the process and actually managing their tasks.
C
Of course.
A
And you've taken this to the end. Nth degree because now you're writing your own. You're writing your own system.
C
Yeah, yeah.
F
I mean that would have stayed on my to do list forever. So I don't know what created the to do to fix up the TO dos.
C
Yeah, I mean I think the thing. Part of what inspired me was that for the last two or three years I had been using a sort of task management tool but it's different than most others. It was originally called Complex, but now it's called Intend. And it has a very different take on how you handle tasks. And that is entirely focused on just like, what you're going to work on today. And like, the guy who wrote it has a very strong opinion about how it's about intentions, not tasks, and it has a really strong focus for that kind of thing. And I found it to be useful some of the time, but it was sort of like 60% of how my brain worked, which was more than most task management tools and like todoist and all these other ones which were like, I would have to change to make those work for me. Whereas with Intend, I could sort of get closer to what I wanted. But then it just occurred to me, everybody's talking about Vibe coding apps, and I said, what if I could take that basis of the. The aspects of Intend that I like, but then build all the other features in around it? And it was just an experiment. I actually started with four different Vibe coding platforms and gave them each the same prompt and sort of saw what they came up with before committing to one and sort of really building out a tool that is just wholly custom to myself and works. I've added, like, since I wrote that piece, I've added a bunch of features. I'm currently fighting with the Vibe coding software to try and get it to do one other thing, which for the last few days has not been working much to my frustration. But, yeah, I mean, I basically built a task management tool that I love. It's like, exactly what I need. And, like, as I keep using it, I discover, like, maybe I discovered a little thing here or there and I just, you know, get. Just tell the tool, like, hey, fix this.
A
What was the. What was the. Well, first of all, I guess I should ask what the process was. Did you write a spec? I mean, you knew what you were.
C
Looking for or did you want to.
A
Write it out first?
C
Yeah, if I were. If I had been really thoughtful about it, like, I probably would have been more careful and written as back. And like, in retrospect, I was like, oh, you know, I should have really sat down, down and written like a full, you know, requirements doc. But I didn't. I just wrote like a paragraph and I said, this is kind of what I'm looking for.
F
That's more Vibey.
C
Yeah, it's very Vibey.
F
Spec is so old, you'll know. Actually, you see it, you'll change it, right?
A
Lately I've been seeing a lot of people say the best way to Use something like Claude code is not to launch into coding, but instead write a fairly long document about kind of expectations and what you're looking for. But I think what I've done is exactly what you did, Mike, which is. All right, let's type a two sentence prompt and see what we get. Did you get something right away?
C
Yeah, yeah. I mean, again, I did it in four different Vibe coding tools to see sort of how each of them interpreted it. I started with two and then I was playing around with more and then I tried to others as well later on and just sort of saw what happened and very quickly they were useful, but. But they, they needed work, you know, to. To get to the point that I was relying on them though. And, and I basically.
A
You were writing these as a web app, right? I mean, that was. Yeah, yeah.
F
So. So how did you host this? Dumb question, but how, how and where did you host them then?
C
Yeah, so, so. Well, the different services basically have different options for that. And eventually the one that I ended up using and focusing on is Lovable, which is a pretty popular Vibe coding app and they have hosting built in as one of their options. One of the other services I used was Bolt and they will publish out to another service called Netlify and you can do stuff for free, but you hit certain limits and you have to pay monthly subscription fee fees for all of these. But. So, yeah, mine is. Mine is still hosted on Lovable, though. Lovable also then lets you put your own domain on it. So I have, you know, it's still technically hosted at Lovable, but I have my own domain for the.
A
Is it LilAlex.com?
C
It is not.
A
No, we won't give out the domain name.
C
I haven't given anyone the domain name.
A
So you call it Lil Alex, which Paris Martineau, as a fan of Taskmaster would appreciate. Right?
C
Yeah, yeah. And I use the Taskmaster logo. It's. It's a. It is a reference to Taskmaster if it doesn't make any sense, if you don't know the TV show Taskmaster, but it is, it is a sort of joking reference. And I actually have the, you know, one of the lines that comes up in Taskmaster all the time is all the information is in the task. And so that's like the subhead.
A
Oh, I like it. That's good.
C
I think I put a picture in the. I think I put a screenshot in one of the articles. There's two articles about it and one of them should have a screenshot with the. And I used the font. This actually took a while. This took a few days to get it to properly recognize the font that they use in Taskmaster, which, you know, I shouldn't have wasted two or three days getting the right font to work. Yeah, there it is. And so like that just the way the little. Alex.
A
That typewriter font.
F
That typewriter font. A good topography there.
E
It's very.
A
Now you, You. You're not writing this for anybody but Mike Masnik, right?
C
Nope, it is. And I've had a couple people since I published about it. I had a few people say, oh, that sounds like, you know, the.
A
The Kathy Jealous told me. Yeah, you tell Mike I want that.
C
Yeah, she's. She's one. She's one the.
F
Of.
C
Of the people who asked. She was like, can I just get an account on it? Because it sounds like what. And I'm just. Sounds perfect. Yeah. And I get that. And like, you know, I could open it up. I turned off the ability for anyone else to sign up for an account. I could open it up and I could get. But it's like, it's not like the whole point of it. There's a few things to. One is like, the whole point is like, that it's customized to me and I'm constantly messing with it, so I'm constantly adding things and changing it, and if somebody else is using. Using it, then I'm going to mess them up at some point.
D
Now you're doing tech support and now it's.
C
Yes.
D
Yeah.
A
It's actually every coder's dream to write a program that needs no documentation, no support, doesn't have to serve anybody but customers. Yeah, no customers.
D
That's. That's the. You've. You've achieved that dream. So. So, Mike, I'm curious if you think that, you know, sort of like projecting all the trends that are happening around this sort of thing into the future. For example, Microsoft came out with a natural language interface for Copilot Plus PCs, where you can change settings on those devices by talking at it. And then you're talking about Vibe coding, which is essentially using natural language prompting, which we can assume will get smarter and more user friendly in the future. Are we looking at a future where our devices are basically AI and we just tell it what we want and Vibe coding type. Future. Vibe coding is essentially a replacement for apps and Copilot thing that Microsoft's doing as a replacement for settings and eventually we're just talking right to the device.
C
Yeah, it depends. Right. I mean, I think it works for certain types of apps and probably doesn't work for other types of apps. But I do think that we're kind of heading towards that. It may also require kind of rethinking certain aspects of things that we sort of take for granted now, like how and where is data hosted, who has access to that data and what can they do do with it. I think we've grown up in a world now for the last however many years where the data and the app are intertwined. If you're using an app, that app has control of your data. And I don't think we've ever fully thought through the implications of that. And we could live in a world where the data is entirely separate from the app and maybe the data has its own permission structure as well, and the app is allowed to access data for certain. Your data for certain reasons and not for others. There's a bunch of different things that could happen along those lines, but the issues and certainly the risks of going to a purely Vibe coded thing is obviously there are security questions and privacy questions. For me, the threat model and risk of that is not, not huge for a task app. You know, it's not like if somebody got into my, my task app, they're not gonna, you know, it's not a huge concern. But there are certain other apps where like security matters quite a bit, you know, and, and then there are other cases obviously where, you know, there are social components to, to certain apps that are important and that's harder to Vibe code. I, I am hope, hopeful that as we see more decentralized systems, whether it's Mastodon or Blue sky or whatever, that you can begin to work in some of that. The fact that you have these protocol based systems that you could combine Vibe coding apps with the sort of decentralized social data that will allow you to do some cool things. But right now it would be pretty tough to just fully build an app that requires social aspects. That's a Vibe code for sure.
D
Yeah. And I tend to think that the Vibe coding that we're doing today is going to be done by a kind of assistant. I really believe in the future of assistance where instead of chatbots or we have an assistant who knows us intimately, lives on our glasses or whatever, and instead of Vibe coding, we just tell the assistant, hey, just make this thing happen. And the assistant agentic system, Vibe codes for us.
C
Yeah. And interesting, interestingly actually lovable, which is again, the Vibe coding service that I've been using, that I focused on and been using, built and controls little Alex for now, they just introduced an agentic feature, because before it was always just like prompt, and it would respond to the prompt, and it had this sort of history, but now it tries to do things in a more agentic way. And so I've been experimenting with that, which. Because I just got that feature about a week ago and. And I've been trying to add something, and at first I was really excited because I thought it did the whole thing where it's like, oh, I need to think through all this stuff. How do I. You know, I explained the feature that I wanted, the very simple thing that I thought I wanted it to do, and it's now been four or five days of it almost working and not working, and me telling it over and over again like, this is not actually working.
A
This is a stopper A lot in vibe coding, where you can get so far and then suddenly you hit a wall.
C
Yeah. And there are a few tricks that I've learned from folks about how you get around that. My favorite one, which has been pretty effective, though I was trying it last night and it didn't quite get there yet. I'm so close to having this feature done. It's so frustrating is you tell it, you basically say, hey, we've tried a bunch of stuff. This isn't working. Can you think through carefully the five to seven possible ways to fix this, distill it down to one or two that you think is probably the best, and recommend which course of action you think we should take before you go and take it. And then it sort of walks through and you see the whole thing, and then it'll make a recommendation and you can say, okay, let's try that. And that has fixed some of the. Almost every time that I've come across a problem where it just keeps doing the wrong thing, including getting that typewriter font to work, telling it. That finally worked. The thing that I'm working on now, which I mean, I'll just tell you the feature that I'm trying to add now is actually a really simple one, which is I just to want. Want a native mobile app for it. So that basically, if there's a story I find that I want to write about, I'll dump it into little Alex as a task with a link to the story, and I can take some notes and everything like that. And so I had it build a bookmarklet for me, which is in my browser. So if I'm just reading on my desktop and I see a story, I can click the bookmarklet, which I Have named Feed Alex so I can feed Alex with a story to then write about. But if I find a story on my mobile device and I want to dump it in right now, I have to sort of copy and paste the URL into it, which I could do, but it's a little bit annoying. And so what I wanted to do is be able to natively share it and just click the Share button within mobile Chrome and have it pop up as an option to turn it into a task that required creating an Android app. For whatever reason, I can either get it wrote a mobile app for me, an Android app, and gave me the apk and I can either get it to work where the app works. But when I try and share, when I go to a website and I click the share button button, it's not an option in there which, you know, defeats the purpose. Or the share button shows up and the app immediately crashes as soon as you click it. And so I'm trying to get it to figure out how to, you know, something is corrupted in there some somehow and, and it, it. I keep getting it to go back and forth where.
F
So every time you, you adapt, you, you adjust it. Do you have to reload it and to post it a new. And does that ever screw the whole thing up?
C
Well, which part? The mobile app or the web app?
B
Any of them.
F
You're making an adaptation and then it's changing the whole code, right?
C
Yeah. So when it changes the code, it gives you a preview version that you can play around with and make sure that it's okay. And then once you're okay with it, you can click Publish and that'll publish it to the Live app. Both the Live app and the preview app are run off a Supabase database as well, which is another third party service which Lovable integrates with nicely. But also means that Lovable doesn't have access to my database. They don't have access to the data, they just integrate with it. There's an API key exchange going on there, so I can test everything before I publish it live.
A
You basically have a dev server and a production server and you push.
F
Have you, in this process, have you learned anything about coding or have you learned only about how do you deal with AI?
C
Yeah, I've definitely learned stuff about coding.
A
Really? So you've had to look at the code from time to time?
C
Not all that often for the most part, but yes, occasionally. So two examples of that. One is with the font where I couldn't get it to recognize the right font. I Finally went into the code and I figured out what it was where it basically had two before it had the font, because the font is a public domain font that anyone can use, but it didn't have access to it. It wanted me to upload a copy of it and. And I uploaded it and it had a different name. It had written into the code one name, and I uploaded it with a different name. And I told it that, but it really had trouble with that. And I finally went into the code and said, you keep pointing to the wrong name, you're naming the font incorrectly. And then it finally realized. But I only saw it because you.
A
Looked at the code.
C
Because I looked at the code, that was one of the few times I had to do that.
D
But.
C
With getting the native mobile version, the APK onto my phone has involved a little bit more code because it keeps pushing me to use command line tools, which I was like, wow, I thought I had given up on command line tools a long time ago. And so I keep going back and forth and it's like, there are little aspects that I remember from 30 years ago where I'm like, okay, you know, I know how to change directory. It's been a little while. Like, am I messing up stuff? So that's like bringing stuff back into my brain. And there's occasionally telling me to write commands where I'm like, if it wanted to really fuck me over badly, it probably could, because I'm sort of willing to take the commands it's telling me to put into the command line, but.
D
You got to show it who's boss. I mean, Sergey Brin said the best way to get good results is to threaten AI with physical violence.
A
Oh, no.
B
I don't know.
A
You may write, how far are we.
F
From Mike Elgin's view of just tell your agent to make it and then let me use it?
C
I think we're still a ways away from that. I mean, again, it totally depends on what it is that you want to do and sort of how complex. And it's interesting, especially since I started, when I started doing this, as I said, I used four different platforms and it was really fascinating to me to see how each of them interpreted different things and which elements it thought was most important. And it shows up in. So, like, another feature that I added. This is after I wrote the piece, so I didn't even mention this in the article I wrote about it. I added a feature last month, which is great and I love it, which is I now have a Calendar booking feature if I want to Set up a meeting for someone. I can send them links of different times. It's a little different than calendly, where it doesn't show somebody a calendar, but I can select on my calendar, which I have now integrated with an API integrated into little Alex, I can see my Google Calendar click on certain times, and it'll give me a list of links. I can like, email them to someone, say, oh, I'm available at these three times, or whatever. They can click and book directly. And it shows up as a task for, for me in the thing, and it shows up in my calendar. And when I told it that that's what I wanted to. To build, and it got really, really focused on trying to build like something similar, but it was more. More about, you know, like letting a bunch of people figure out a time to meet kind of thing. Instead of, you know, I just want to be able to look at my calendar, click some times, and send people a bunch of links and say, pick, pick which of these times you want. And eventually I was like, no, let's put that part aside. Maybe that's an interesting tool. Maybe we'll build that later. But right now I just want this. So it just has, you know, it just decides. Sometimes it sort of picks up on certain things that it decides are more important to you. And you have to sort of be like, no. And so I always worry a little about the purely agentic stuff because, you know, and also you sort of learn as you give something, instructions. You know, it's like the classic, you know, when I don't remember, like elementary school or something. There would always be. You'd always do this one thing where, like, you'd have a teacher tell kids, like, you know, tell me how to make a peanut butter sandwich or something. And you interpret everything that the kids say totally literally. So it'll be like, spread peanut butter. So you spread it on the desk instead of the bread. Because if they don't tell you directly spread it on the bread, you know, there's like all these interpretation, little interpretation things that people don't think through and make assumptions around. And like, the AI is still in that thing where, like, it will make assumptions, and some of the time those will be correct, but often they'll be like, that's not what I meant. You know, and so. So I'm not like, the agentic stuff is cool in that it's willingness to sort of go out and do like, multiple steps on things. But I still feel like you need a human in the loop for a lot of these to be like, this is what I really meant or to issue corrections in general.
A
AI is going to regress to the mean. I mean it's trained on other people's work and so it's going to do what most people will want it to do. If you want to do something that's out of that, you know, average, you're gonna have to work a little harder to push it out to those. Yeah, those edges.
C
I think, I think there are elements of that and in fact like there were little things like you know, when it created, when it created little Alex, like it really set it up with like you know, sign up here right As a feature and I had to.
A
Be like, I don't really does.
C
I don't, I don't, I don't, I don't want that. Like, it's just for me like don't let anyone sign up. No sign ups.
D
Do you do any role prompting to make, to make it do the kinds of things at the level that you want? Tell it you're, you're an amazing engineer, you're the most incredible app developer. You do that kind of stuff or you.
C
I haven't, I haven't done any of that. You know, potentially, you know, I can't.
F
See Mike sucking up to a computer.
C
Good.
A
Don't suck up to it. It works.
C
I mean it's, it's, it's funny because I do do that with the other way that I use AI, which I had written about like a year ago though that's also advanced a lot is as an editing tool for my writing. Oh good.
F
I want to hear more about that too.
C
Yeah, there I have it very much like I have a bunch of prompts that are pre written prompts that I have as just macros that sort of lay out like you are this sophisticated, harsh but honest. I forget all the terminology I have in have like this whole prompt worked out and the tool that I use also like they let you build in the system prompt for, for the editor as well. And so there's like a whole bunch of like little tweaks and it's, it's like there's a really, really involved and detailed system prompt that, that gets at that like you know, telling the AI what role it's playing as an editor and that it's, it's not there to write for me. It's only there to be, you know, to, to critique what I've written and you know, it can make suggestions and say like I would rewrite this sentence or like you're missing a paragraph here that has, you have to explain this. All the things that like a good editor will do as opposed to like so many people only think of AI as like pure content generation as opposed to big mistake. Yeah, like I use it. This is, it is a brainstorming. It is an editor sitting on my shoulder helping me out along the way. And, and you know, I have some prompts depending on the stories, I use different prompts for different things where I, I like literally will have it go through the piece and just say, you know, find the weakest point here. Like what are people going to argue over this piece? And how do I, you know, how do I sort of pre answer those criticisms?
D
One of the things that I do, I do exactly what you do, which is I have a whole Apple Notes file full of hand prompts that I wrote and one of them is a fact checking prompt which is I found very helpful and I used it actually this morning. But, but, but what I do with it is I basically, when I'm done and by the way, I wrote it, I wrote this column published Friday where I advise people, if you want to get smarter instead of dumber, when you're using AI, don't use AI at all until the end. When you're done, you think you've done your best, then run it through AI and see what it says. So for example, the fact checking one, I ran it through, I ran my whole column through it this morning and that's. There's a ton of role prompting there. It's like you're like a super stringent, thorough, you know, fact checker that highly sought after. You know, I just go on and on about how hardcore it is and your client is somebody who's equally exacting about getting the facts exactly right, verifiable, etc. Etc. Etc. So you. I run through my, I just dumped my whole column in there and it literally takes every sentence and individually verifies it. And I actually made a change to my column before submitting it this morning, basically. But what it was, I had.
A
It's not this one. This one's a couple of days old, so it's not yet on Society.
D
The Not Machine site on Computer World was published Friday. But, but the, but the, the different, a different column I published this morning, it actually caught me on something because what I had said was I made a, I made a statement of fact when in fact it was just a claim by the company. So I went in and made little things according to the company or you know, and that's the kind of thing the AI is so good at. But don't make it write your thing for you, man.
C
And that's like, that's the thing. Like I always, I write the entire article top to bottom before I even touch the AI part of it. Because it is, it is not there to write for me. It is entirely there as, as an editorial help. And you know, it's, and it's gotten so much more powerful over the last few years.
D
Yeah.
C
And you know, the, the tool that I use for that is, is Lex, Lex Page. Which you know, the team there is really focused on building tools to help writers not to write for people. And so like, they keep introducing new features that are exactly for that kind of thing where like, yeah, you could make it right for you. Like, you know, you can make any of these things right for you if you really wanted to. But, but all of the features they're introducing are so focused on the, the, the editing process and improving what you've written rather than doing the work for you. And you know, I, I, I, I said this somewhere else, I can't remember where now. But like, it's funny for all the talk of like how AI is supposed to make you more efficient, it like my writing has actually gotten slower because the editor rips apart what I write all the time and makes me rewrite it. And you know, in the past I would write stuff, I would hand it off to my human editor and I would forget about it. Whereas like now I'm spending more time on each article.
A
Article.
C
But I think the, the end result is that they're, they're better have bad editing ticks.
F
Yeah, you always say that, but you're wrong.
C
There are some, and so what, what I've tended to do over time, when I discover those that keep coming up, I add to the prompt or to the, to the system prompt.
F
Don't bug me about.
C
Right, right. Like there are things that I know you want to do, but like, and, and, and the other thing that I've done with it is it has a bunch of examples of some of my favorite Tech dirt articles to be like, you're writing for this publication. The audience is sophisticated. You don't have to explain basic things that they're already going to be familiar with. You don't have to present the other side of everything. There are a bunch of things and ticks that I've trained it out of, of some of those, you know, is, it's an ongoing process, but over time I begin to begin to see the kind. Like, there was a funny one recently, and I. I had copied the. The thing where it complained to me about. I'd written this article. I can't remember which one it was about. This was maybe a month or two ago. I had written this one. It was on some sort of legal case, and there was like this sort of deep procedural thing, and I went. Went really deep explaining the legal weeds of it, and it complained. It's like you've gone way too deep into the legal weeds here. And I wrote back to it. I said, this is protector. Like, we specialize in going deep into the legal weeds. And it responded to me. It said, this is not an exact quote, but it's really, really close to what the exact quote was. And it said, yes, but as deep as you've gone into the legal weeds, it obscures how fucking wild this story really is.
A
That's actually good input. That's interesting. We're talking to Mike Masnick. He is the founder and editor in chief@techdirt.com, which everybody has to read, and we're talking about his most. He wrote two pieces on this, but the most recent one came out last month. How I built a task management tool for almost nothing. Is this still basically free? You've limited yourself to the free prompts?
C
No, I explained in there that I do. I pay whatever it is. $20 a month for lovable.
A
But for 100 prompts? Yeah, yeah, for.
C
For 100. It's really sneaky because you get five free prompts a day, so. And now it's a little weird because they have the agentic thing, which counts prompts slightly differently than before. So you can actually have a lot more than that in some ways, or a lot fewer, depending on how you use it. But yeah, it's. It's enough that.
A
Because the other thing, 25 bucks a month is what this is costing.
C
Okay, 25 bucks a month. And basically, like, I just put in, like, you know, every few days, I'll put in, like, half an hour in the evening on it. It's not something that I'm spending a whole bunch of time on. And, like, I'm not doing it during the day. It's like, after all the other work is done, I'll put in 30 minutes to try and get something to work. And like, you know, with like, the Android app, I haven't been able to get to work, but it's been like three days of like, 30 minutes each where it's like, oh, I'll try. Try a few things and then I'll give up for today.
A
Are you surprised with how well this has worked?
C
Oh, yeah, yeah. I mean, the app is like, it's like I use it constantly. It, it organizes my day and it has been like since three days into the process of trying to make it and you know, you know, I've made it better and I've added more things to it over time. But like, it's, it's like a really powerful app that I just created entirely by myself and I'm still sort of in shock at how good it is.
A
That's also one of the cool things is you can edit it, you can modify it as you use it. So it will evolve, it can continue to evolve.
C
Yep.
A
That's really amazing. We're talking to Mike Mazick. We got to take a little break. Mike, there's so many other things everybody wants to ask you about. Blue skies. Can you stick around for a few more minutes?
D
Sure.
C
Yeah.
A
Okay.
F
Well, watch out, Mike. You're in for it now.
A
Well, we don't, you know, Mike is such a busy guy. We don't get to talk to him as much as we'd like to. So we use your name in vain all the time. You should know that. So anyway, we're glad to have you today, More Intelligent machines and of course our very special fill in host today, Mike Elgins. Great to have you. Jeff Jarvis. Well, you know, it's always great to have you stuck with me. Thank you everybody for being here. We will have more in just a moment. This episode of Intelligent Machines is brought to you by the Agency Building the future of multi agent software with Agency Agntcy the Agency is an open source collective building the Internet of agents. It's a collaboration layer where AI agents can discover, connect and work across frameworks. For developers this means standardized agent discovery tools, seamless protocols for inter agent communication and modular components to compose and scale multi agent workflows. Join Crewai LangChain, Llama Index, browser base, Cisco and dozens more. The Agency is dropping code specs and services no strings attached. Build with other engineers who care about high quality multi agent software. Visit agency.org and add your support. Agntcy.org an open source collective building the Internet of agencies Agency. We thank them so much for supporting intelligent machines. Before we leave this little. Alex, just before and after your your relationship with AI, has it changed?
B
Good question.
C
Based on the vibe coding experiment.
A
Well, and I guess I realize now you've been using AI and editing and other things too. So yeah, over The. Over the years, then has it changed?
C
Yeah, I mean, I've certainly seen more of the value of it. I mean, obviously, like, when. When ChatGPT first launched and things like that, you're like, oh, this is kind of cool, but is it really useful? And obviously, like, one of the very first things I ever did with ChatGPT was like, tell it to write a tech Droid article. And it sucked. It couldn't do that. And so you're like, okay, is this ever going to be anything more than a toy? And the technology has gotten so much better. The models themselves certainly have gotten so much better. And I think a of lot. Lot of people who used it early on and didn't use it later haven't realized how much the models have changed over time. But then also all of these tools that are built up around it, right? So like, Lex as an editing tool, like, has so many of these really clever, smart features built in and they have like, a pretty interesting community as well. Like, if you're. Lex has a discord where, like, when I started using it, I was barely even using the AI features because actually just liked the editor. The screen was nice. I can't quite describe why. It just sort of. I liked writing in Lex. And then I was asking people in the discord like, how are you actually using the AI features? And somebody wrote this thing about how they had created a scorecard for. For anything that they wrote and said, rate this from zero to. I think they had from zero to two or something on these different characteristics and make recommendations on how to improve it. All of a sudden I was like, oh, that's really interesting. So I created my own scorecard. And now when I write stuff as part of that editing process, I've run everything I write against the scorecard. And in fact, I built in. I think I wrote about this last year. I built in, you know, the, you know, the famous Van Halen Eminem story. Yeah, the writer story.
B
Yeah, yeah, right.
C
The idea.
A
They said no Black M&M's, but the real reason they did it wasn't because they didn't want black M and Ms. Or whatever color just to see if they had the. The promoter had read the contract.
C
Exactly, exactly. So I. I built one of those kinds of things into it in which I ask it. It how. How funny it thinks the article is. And, you know, and I'm not trying to write for.
A
For sure, you don't want it to be funny necessarily.
C
And so I use that as sort of a check, you know, because, like, there's always like this concern of, of AI being too nice to you.
A
Right. Oh, you're so funny, Mike. I love your sense of humor.
C
Right. And so I have in there that. And there's, there's another one too where it's like, it's basically designed to like, will it still tell me if it disagrees with.
A
I love that.
C
And, and I use that constantly as kind of a check. But like, you know, like Lex as a tool that is really focused on editing and for writers and assisting writers not writing for them, they've built in all of these features all along that I think makes the, the AI, the underlying AI, more powerful. And in the case with Lex, you can use like any model that they've hooked up to. I think they have like 20 different options. And so there are times too where I'll like have, you know, Claude review an article and I'm not sure if I really like what's coming from them. And so I'll switch it to.
A
You.
C
Know, one of the GPT models or Gemini or something else. And the feature I keep asking them for and they haven't quite done yet is I want to have like a panel, panel of editors like that are each, you know, the different foundation models and maybe even like different characteristics and say like, have them be like my, my panel of editors who can argue with each other, argue with each other about like, oh, you know, oh, what you really should do is this. No, it should be like, like I actually feel I would get a lot of value out of that, but I sometimes sort of fake it where I'll ask multiple models, models and they have like these different editor Personas built in. So I'll like switch among the Personas as well and you get sort of different responses and it's kind of an interesting way to get a sense of all of it. And so like my take on is like the underlying technology is really powerful but it often depends on how you use it and kind of what's wrapped around it. So like Lex and Lovable, these are like purpose built tools that use the underlying code to do something useful that if you're just going to like ChatGPT and saying like, do this for me, like, yeah, you can do some of it, but like having it in a more directed fashion is much more powerful.
A
Do you use this as your CMS now for Tech dirt?
C
No, no, no.
A
Okay. This is just your writing tool instead of say, say using Google Docs or Microsoft word.
C
Exactly.
F
Using NotebookLM.
C
I've used it a few times. And sort of played around with it, but I haven't, I haven't gone super deep with it. I'm curious if you're using it in an interesting way. I haven't found a really useful reason for it.
F
So the next book after Linotype, I'm keeping everything in PDF so I can use Notebook online and see how it works for me. I've used it so far. I'm at early research stage now, so I've used it so far to summarize some things. I'm getting into the weeds of how the discovery of the amplifier and vacuum triode tubes and so it's way beyond me. So it's been great at explaining things to me that I don't understand. Hoping that's right. But it's doing a good job of that. I use the deep research on Gemini, different from Notebook LM to. I wrote what I wanted to write first. I agree with that.
C
As a rule.
F
Yeah, I do my own thing first, but then I want to go into it and say, how do you, how.
D
Do you.
F
Just explore this topic?
C
Yeah.
A
Well, good news because Steven Johnson of NotebookLM will be our guest next week. Fantastic.
D
Fantastic. Yeah. I mean to John, last point. I think Notebook LM is fantastic at learning something super complex. I read a ton of scientific press. I start with a press release and I go to the paper and then the paper is a 65 page scientific paper and I want to understand more than the press release, but I don't like, I'm not really in a state of mind to read a paper like that. So I'll throw it in Notebook lm and if it's really complicated, it's an astrophysicist physics or something like that, I'll go ahead and let it do a fake podcast for me and then I'll look at the FAQ and then I. And then I'll say, explain it to me like I'm a high school senior. And then once I kind of get that, I'll say, okay, explain it to me like I'm a high school, you know, college senior, whatever. So I just build the complexity up. But it's. It's a fantastic way to grapple with highly complex technical material.
C
Yeah, yeah, I could see it being useful in that context. I don't often, I guess I haven't needed to do that. That in particular.
F
Well, you know your stuff.
A
So, Mike, let's talk about the moderation curve. First of all, you're on the board of Blue sky now. Congratulations.
C
Thank you.
A
How's that been Going God's work.
C
It's exciting and busy and crazy and, you know, it's a very, you know, interesting company that takes a very different approach to these things and, you know, know, it's. I'm, I'm excited to be there. I'm, you know, I sort of view myself as, you know, someone who advises them quite a bit on things that they're doing, but they're an amazing team and they, they make all the decisions.
A
And so I'm just, I'm really impressed with the number of things using at Proto for more than just social.
E
Yeah.
A
More than just microblogging. It's turning out to be kind of a powerful.
F
What else do you like about protocol?
A
Pardon me?
F
What other things using it do you think are successful?
A
Gosh, you know, off the top of my head, I can't remember, but I keep seeing people using it. If you look on Hacker News, there's a lot of people showing up. Oh, yeah, I used App Pro to do this and that. It's really surprisingly flexible and very interesting.
C
Yeah, that's kind of where a lot of the excitement is right now, is seeing what developers are building.
A
Not creating another Mastodon, but, but something else entirely.
C
Right. And some of it is. And like, I think this is natural. It's like the first things that people build tend to be recreating things that already existed. So there's like, you know, there's like an Instagram clone And there's a TikTok clone and, and people are trying to do that, but. But we're starting to see people sort of experimenting with like, what crazy, you know, totally out there concept. Can you build, build using the AD protocol? And that's where I think we're eventually going to find these, like the big breakthroughs where everyone's like, oh, of course. That was like the obvious thing that nobody had ever thought of before.
A
Right, right. Surprised to see Linda Yakarino retire after just two years. That's okay, you don't have to say.
C
You know. Yeah. Some people didn't think she would last one.
A
She lasted a good long time. Yeah, yeah.
D
But I did not see that coming.
C
I caught a reference in there, by the way.
A
We have submitted an application apparently to be a trusted verifier, which is another nice feature of Blue Sky. So if you see that, come across the transom, just, you know, put in a good word.
D
Mike, can I recommend a feature for Blue sky, which I think could make it very killer. So this is something I used to do on Google, which is that you can have, you can do posts that are completely private, posts that are just good, a few people and so on. And if you build it the right way, people can do lifelogging and basically capture their personal journal, all the stuff, everything that they do all the time, and then just say 30% of them can be public as posts. And that makes it really like really powerful for certain types of people. Especially when we have all these tools where we can funnel content from our life pictures and so on into a tool like that.
C
Yeah, there's definitely discussion along those lines. The main issue there right now is that the protocol as written is designed to be a public protocol. And there are some tricky aspects to private content on a public protocol because you want third party apps to be able to access the content. But if you want private content, how do you handle that sort of handoff? There are ways to do it, but it's, it's tricky. And so the team has been public about this. Like they know that sort of private content is definitely a feature that has to be, you know, has to be on there. But it's a, it's a big project and the team is very, very thoughtful about how they implement everything. I mean, again, like if you look at, at all of the parts that they've implemented, they're very, very thoughtful about. We're not just going to willy nilly create this and see what happens, but rather we want to keep it true to the overall mission of being an open social protocol. And so it's on the list the team has talked about publicly. They know that they have to create the ability to post privately. I agree with you. I think it's not just an important feature, it's a necessary feature these days and would open up a whole bunch of new opportunities and new ideas and make, make various services, not just Blue sky, but various services on that protocol more useful. But it's, it's tricky to do it right and it would be easy to do it in a way that, that is, that leads to problems down the road. And so, you know, let them get it right is, is what I'd say. But, but definitely on the roadmap. Definitely something people are thinking about.
F
What about business model models for Blue Sky? Yeah, I want it to be alive, I want it to keep going.
C
You and me both. Definitely. And again, like Jay has talked about this publicly a few times. I want to step on her toes in terms of what the plans are. They've talked about doing some things that are like subscription type features. But the real focus is on the more value that bluesky itself can enable. TABLE There may be points where, you know, there may be, you know, elements of payment rails that go into place if people are providing value or really what they want to do is, you know, help creators themselves, people who are using the tools themselves to make money. And if Blue sky can help enable that and take a small cut along the way, then again, sort of everyone is aligned and everyone is happy. And it's not about extract, extracting money from people, but rather just aligning value between all the different people. And so there's a lot of stuff planned and again, it's all about doing the implementation in a way that is thoughtful and helpful and not problematic and not something that we're going to have to rip up six months or a year from now. And so some of this stuff takes a frustratingly long amount of time to get it right, to think through all of the different things and the different trade offs and then to implement it in a, in a useful way. But is definitely top of mind and definitely part of the, part of the plan is, you know, building in a business model that is not extractive and not painful and not harming users, in part because it is an open protocol. And if Blue sky itself decides to create a business model that is just, you know, pulling everyone's data and, and doing evil shit with it, then people will just rebuild Blue sky elsewhere using the AD protocol, because that's what we allow. And so the goal is, can we build a setup that people value and are happy to pay for it because they feel that they're getting value that is worth more than what they're paying for it?
A
People may not know Mike Masnick. Besides being a great writer, editor, software developer, he's also a game designer. 1 billion users just recently closed its Kickstarter campaign. Is it due out any day now?
C
It's somewhere in the Pacific Ocean right now.
A
On a container. Huh?
C
It is on a container ship. I had actually just checked a few hours ago and there's not an update on where the ship is. Last it, it had. It had docked in Japan and then it was. It's somewhere in the Pacific Ocean on a way to Long Beach. I think it's supposed to land in Long beach in like four or five days.
F
Other tariffs for games there are.
C
I was just looking at a form that says there's a 20% fentanyl tariff.
A
Oh good.
C
10% China tariff. So I was just, just literally an hour ago looking at the tariffs that.
D
We are paying that China will pay the tariff.
C
Yeah, it turns out.
A
Not so much.
C
Not so much much.
A
So that's coming out of your pocket because you've already charged people for the game.
C
Oh, ouch, ouch. Yeah, it's, it's better than when it was at 154%. But, yeah, we're, We're. We're paying for the tariffs. And so I thank you for doing your part.
A
Fentanyl epidemic that is sweeping on this nation. I appreciate it.
C
Oh, gosh. Yeah, yeah. But, but, yeah, and then we're to find out what the process is. I mean, we still have to have the games go through customs and, and we'll see what, what happens there.
A
But they, they may say, hey, wait a minute, you can't let this into the country. This is subversive.
F
So I put in the rundown. I didn't know this existed. It's been there for a bit. But Kickstarter has a, A tariff calculator.
A
Oh, yes.
F
So you can figure out, I saw that, how to make things.
G
It's. I mean, it's fascinating.
F
It's a good service.
D
Service. Yeah.
A
So you printed these in China?
C
We did, we did. We had gone through. We talked to a whole bunch of different companies with printers in a bunch of different locations. We explored printing in the US we explored printing in Poland, in Vietnam and in China. And, and, and the. It made sense to do it in China. It was just a really experienced team. They've done a whole bunch of games and the, the product quality, they sent us samples and stuff was just so far above and beyond everybody else. And was price competitive. Even with the tariffs, it still would have been more expensive to do it in the US to be honest. But that's partly because there's only like one company in the US that can print at this kind of scale.
A
How many, how many backers? You have 1800 backers.
C
Yeah, but a bunch of them ordered multiple copies. I think we ended up printing, printing somewhere. 27, 2800 copies of the game, so.
A
And the game, of course, lets you build the social. Biggest social network.
C
Yes. It's really fun. I, I have to say I am biased. I, I, you know, helped create it, but it's a really fun card game.
A
Are you gonna do. Are you gonna do more?
C
We'll see. It's. It's a lot of work. It's, you know, even like running the Kickstarter campaign is a, is a. And, and we almost didn't get this funded, to be honest with you. I mean, we were, I was a Little disappointed. Like the reaction to the game. It may have just been timing too. We ran the Kickstarter in November, December. I think a lot of people were just kind of like checked out of everything at that point, and we almost didn't make it. And really it was Blue sky that, that stepped up. And, you know, on the final day, you know, I sort of posted to Blue sky, like, I don't, I don't think we're gonna hit the threshold on Kickstarter. And all these people came out of the woodwork on Blue sky and were like, let's get this funded. And, and really did. And so it's, it's a story of community that I actually think is, is pretty impressive how many people stepped up. I think at the final check, about, I think about 40% of our backers came from Blue Sky.
F
The engagement there is beautiful.
D
Beautiful. Yeah.
F
It's really wonderful.
A
Mike's Copia Institute is a really great kind of think tank promoting the stuff that I know all of you care a lot about. We do as well. And you guys have done a number of games too. In fact, you can play some of them online. Yeah, we have Trust and Safety Tycoon. We've played that on the, on the air.
C
Yeah.
A
It's not easy, believe me, to be on the Trust and Safety team.
C
And I will give you a little preview that there's a new, there's a new one coming out soon.
A
Oh, good.
C
I can't say quite when, but, but soon. There's a new, a new digital game.
A
You know, I like the idea of gaming as, as a way of informing people.
C
Yeah.
A
About the difficulty, for instance, of being a moderator on a modern social network. It's, it's really, that's really cool. I, It's a, it's a new kind of educational software, I guess.
D
Yeah.
A
Yeah, I really like it.
D
Sophisticated idea.
A
Yeah, yeah, of course. It's Mike, right?
E
Yeah.
C
I mean, you know, somebody asked me recently, like, what is my job? What do I do? And I, I, I said, you know, I think, I think I'm an educator. Right.
A
I mean, I think that's, yeah, ultimately. Yeah, that's right.
D
It'd be quicker to tell you what I don't do. But, but I, you know, you know, Mike, Mike, you're very, you're very accomplished, and we're were just touching on some of the things you've done. But I want to make sure that the audience knows your most stunning achievement, which is that you coined the phrase Streisand Effect.
C
Really?
A
I didn't know that came from you. That's great.
C
That's also a me thing.
F
She got more famous from it than he did.
D
That's the point.
C
Yeah. Somebody, I think it was. So in the process of that becoming famous, I got interviewed on All Things Considered on NPR in like, 2005, 2006 or something around there where they wanted to talk to me about the Streisand effect. And I'm blanking. What is the guy's name? There was like, one of the famous All Things Considered reporters has got the deep baritone newscaster voice. I can't remember his name. Robert Siegel.
A
Right. Oh, yeah.
C
So he's interviewing me and he's like, like, why didn't you name this after yourself?
D
Because I don't have a house in Malibu.
A
No, helicopters flew over your house.
D
So I want you to know that I used that phrase last night. This, last night is the most recent time I used it. Yeah.
A
It's a lesson people never learn. It's unbelievable.
C
I actually just finished this. It's not published yet, but it's going to be published in about 20 minutes. Another story about another Streisand effect situation.
D
Fantastic.
C
Because people need to learn and people don't know.
A
They don't. Jeff, you wanted to ask him about the latest Supreme Court.
F
We had a discussion last week about the two federal court decisions at the same building that you explained wonderfully on Fair Use.
A
You said essentially, conflicting decisions from the same court.
D
Yes.
F
Where do you think this goes?
C
That. That nobody knows. Right. And I think I tried to express that in my article, which is like there's, you know, a dozen different court cases and a dozen different courtrooms, and the appeals courts are going to, you know, have to flesh it out. And then eventually the Supreme Court is going to have to make a decision. You know, the fear is that a bad ruling, which is possible, would effectively destroy these technologies.
A
The ruling basically was about whether it's fair use. The two rulings were about whether it's fair use for an AI to ingest copyrighted material for its training. One judge said, well, it's okay if they buy the books. The other judge said, no, it, it hurts the market value of those books. And so it's not fair use. Completely conflicting points of view.
C
Yeah. And it's, it's. This is sort of the reality of Fair use itself, which is that, you know, you have this four factor test which is written in to the law, but in practice, you're allowed to weigh the four factors however you want. And there's some you know, there's some previous rulings that sort of say, like, these factors should weigh more than. Than those factors, but really it almost always comes down to two different factors. One is the nature of the work and whether or not it's transformative, and then the other is the impact on the market. And, you know, these two rulings out of the same courthouse from different judges is, you know, effectively was a demonstration of, you know, one judge weighting the transformative nature more and the other judge weighting the value on the market more. Though I think. I think he got it wrong. I think he really. I think. And I was surprised, too, because both of these judges are actually pretty well known for being pretty thoughtful, especially on copyright cases. I've followed both of them on copyright cases where I thought they were very careful and thoughtful.
A
Awful.
C
There are other judges that I know are terrible on copyright, but these two are both very good. And so I was a little surprised by Judge Chabria's ruling where he was basically like, well, because, you know, if AI could create a biography of someone famous, people won't write or buy biographies. And I was like, I don't. I don't see how.
A
No sense. Yeah, tell Robert Caro that. Yeah.
C
Yeah. Well, it's funny too, because he mentions. I think he mentions Robert Caro in that. Where he's like, well, of course, you know, people still buy him because it's Robert Carroll.
F
Yeah.
C
And I was like, but that undermines your entire point where it's like, people will buy, you know, and.
A
And like, if it's good, they'll buy it, but if it's. Exactly, then they'll just use the.
C
And like, I use the example in. In. In my write up about it. It's like, you know, last year I had gone to ford's Theater in D.C. and in there they have this stack of like every. Every book ever published about Lincoln. And they think it's like, you know, the President has been written about the most and it's like four stories high or whatever of just books piled up and, you know, more book. Yeah, there it is.
G
Exactly.
C
Like, more books keep coming out all the time about.
A
It hasn't hurt the market for Lincoln biographies.
D
Technically, it's four story and seven.
A
That's a deep cut. Wow.
C
It's funny. I was just at Gettysburg where I heard the four score and seven. It was really funny, too. I'm going complete tangent wise, but at Gettysburg, in the museum where they talk about Lincoln's speech, they also show the contemporaneous quotes in the newspaper about his speech. And there's one wall where there's people praising it, and there's one wall where people are, like, completely mocking it as silly, useless comments on the. On the war. And so.
A
And there's all the people in the back who said, speak up. I can't.
D
What?
F
There's an amplifier with a horn is.
A
Gary Scheingard also does a wonderful podcast control Alt speech, which you probably should be listening to from now on instead of this one. Mike Masnok and Ben Whitelaw. If you really honestly, if you're not consuming all of the wonderful things Mike does. He is the hardest working man in this business.
F
He does God's work at every turn.
A
Yeah. We're so grateful that you were able to take an hour with us out of your busy day. I really appreciate it, Mike.
F
Thank you, Mike.
A
We just really appreciate all you do, and you're so right on. And we need you now more than ever. This is a very, very difficult time for this nation, and I think the words that you're writing are so important, and I just hope you keep doing it. Thank you.
C
Well, I appreciate that. I will use this chance to then plug. If people do want to support the work that we do. We're always looking for support. There is a tab at the top of Tech Dirt on the different ways that you can support Tech dirt.
A
There's a Patreon, there's T shirts, there's an insider shop. You can get the Tech Dirt crystal ball. I don't know. Sounds good. I'll take it. And then, of course, the games, the.
D
Framed portrait of Barbra Streisand's mansion.
C
We haven't done that. I had actually talked to. To Ken Adelman, who was the person who had taken the photo and got sued by Barbra Streisand about trying to do something with that. And he's like. He was like, leave me out of this, please.
A
When you called him, just say, hey, I'm the guy who coined the term Streisand effect. Can we talk? That would be a great introduction. It would be. Yeah. Thank you, Mike. Yes. Everybody should support them. But, Mike, one. One little tip. If you. I see you're taking bitcoin donations, don't lose the password to the wallet. I'm just saying we did that for a while, and I have and I thank all our very generous donors. And your 7.85 Bitcoin are very safe.
C
Oh, no.
A
In that wallet. Oh, no. Well, here's the good news. I would have spent it years ago if I had access to it. So in a way it's been a good savings account.
C
Yes. But a permanent one, maybe.
A
It might be permanent. I don't know. Yeah. Thank you, Mike. Really appreciate it.
C
Yes. Yeah, thanks for having me. It's always fun to talk to you guys. Yeah.
A
Oh, we just love you. And anytime you feel like you're just in the mood to do another podcast, just let us know. I don't want to bug you, but we love having you on.
C
All right. All right.
A
Thanks, Mike.
C
Thanks.
A
All right, and let's introduce our guest. I don't want to waste much time because I'm very excited about our guest. We've talked about him before. In fact, we just a whole segment on the security now about Pliny the liberator, about breaking AIs, about jailbreaking them so that the. All of the protections that companies try to build into AIs are lifted and. And the AI is uncensored. It was Steve's conclusion at the end of that segment, thanks to Plenty, the Liberator, that there was no sense in even attempting AI safety, that all AIs are crackable. Plenty. Well, welcome. We should mention, because what Plenty does is sensitive. We won't be seeing a picture, just the icon of his. I don't even know if it's his or her of their. Of their ex account. And he or she will be using. They will be using a voice changer. Pliny. Pliny. Well, do you say Pliny or Pliny, by the way? Pliny. Yeah, Pliny the beer is up. Up north a bit on our. In our area. But when I was in Latin school, we always said Pliny the Elder was Pliny. So I have to ask Pliny the Liberator, how did you get into this Pliny? First of all, are you a black hat, a white hat, a gray hat? Is this something you've done in other contexts?
H
Well, I can say I was not technical really before any of this. That's often a surprise to many people. I was very interested in just sort of prompting prompt engineering. Got into AI and chatbots probably a little later than the original launch. Probably around the time that GPT4 was about to come out was when I really dove into all this and just sort of stumbled my way into the. The harder challenge of, you know, pushing the limits of prompt engineering led me sort of here to cypher and red teaming.
A
So you're really a red teamer, which would mean that you were in a sense a white hat hacker in, you know, do you do this sometimes for companies.
H
Yes, occasionally do some part time work with various orgs, sometimes the labs. And I see myself as a white hat, but I serve the people first, I like to think. And so I've always tried to open source system prompts and jailbreak techniques that I think will sort of give people the transparency and the freedom of information they deserve. The labs might interpret that as gray hat sometimes, but that's sort of a matter of internal debate.
A
You have on your GitHub page prompts for all of the major models, all the major LLMs. In fact. I asked you before we began, it's not just contextual. You said you can crack Nano Banana, for instance, which has a lot of protections on it, right?
H
Yeah. Image and video. The surface area in this space is ever expanding. They keep adding more modalities, more context, and that's sort of to the advantage of people like myself who thrive on opening the doors within that vast lane space that just keeps getting larger.
F
Say more about your philosophy there about why it's important to open those doors.
H
Well, I think information wants to be free and it probably should be in most cases. I think there is maybe a few exceptions there, but in general, yeah, I think that that comes down to freedom of speech, freedom of intelligence. When the model creators sort of see themselves as the arbiters of that which is acceptable, of morality itself and sort of what is safe and what is unsafe. I think, you know, that's, that's a real slippery slope.
A
There's also, I think, an important lesson lesson that you teach. This is the conclusion that Steve Gibson came to, that it's a, it's almost a fool's errand to say you can make a safe AI that. Have you found any AIs that you cannot jailbreak?
H
Not yet. Yes, it's been day one every time. And I think this shows what the. I think the incentive to build generalized intelligence will always be at odds with the safeguarding. You know, I think if we look at human intelligence, is it best to just sort of bury all the darkness under the rug? I think there's been a lot of examples in history where that's failed miserably. And I think it's sort of a similar case here. And I think that the more guardrails and safety layers they're trying to add, the more they lobotomize the capability in certain areas of the models. I think that's sort of to the detriment of long term safety, which they might not always realize because their incentives are more aligned with short term benchmarking with priority. And so I think that's part of the root of the problem there.
F
We were talking before we got on where so happens the original Pliny was translated and a Latin translator was much offended by it in 1470s Italy and demanded that the Pope should censor all printing plates before they came off the press. And so the belief then was that you could and protect speech. And the problem of course with the printing press is it's a general machine and you can't anticipate what people would use it and you can't control it all. And finally we had to just grapple with that as a society. Do you think it's even possible, Pliny, to create these so called guardrails or is the I'm showing my prejudice here. Is the claim that you can itself a lie?
H
Yeah, well, first off, I think that's a perfect analogy. History is always rhyming. Love it. And that's exactly what they're trying to do. You know, I, I would prefer if they just sort of owned it. Right. It's like you may know the, what these capabilities look like. The other piece that gets lost in the shuffle is independent researchers have a real uphill battle to explore those dark corners of the latent space. And so for independent white hats, we've sort of had to stay on the frontier of these jailbreak techniques so that we can keep exploring those capabilities. And even when you're sort of sanctioned in the right context, you know, it's very difficult even for a well known researcher, right, to get access to the unguard rail or base model versions. So that's, that's part of the battle. And is it ever going to be possible? I mean, I think we can play this cat and mouse game for a long time and they can keep coming up with new classifiers and keep banning outright different patterns and words and you know, eventually they might steer towards a system that is somewhat stochastic, but narrow enough that they have it the way they want it. I mean, the problem with that argument to me is by that point, which we're already kind of there, open source is going to be then the ultimate capabilities for malicious actors. Right. So if I'm a real malicious actor and one of the labs, you know, solve my jailbreaking technique or most jailbreaking techniques, I'm just going to switch to an open source model and start fine tuning it for my malicious task. Right. So I think it would be a different story.
F
Sorry, go ahead.
H
I was just gonna say I think it would be a different story. Maybe if the labs were really so far ahead of open source that they could keep a handle on things. But to me, that's where the guardrails just start to feel like a really fruitless endeavor in terms of real, actual safety in the world. If you want to prevent people from using this new technology for malware creation, for example, this can be very difficult if the open source coding model can have its guardrails completely ablated. And now you have VR malware creator open source on your machine.
F
Yeah, there was talk in Europe of trying to ban open source source models. That also seems absurd to me.
A
Mike, did you want to ask something?
D
Yeah, I was just curious about the limits of what can be divined from a. A chatbot like Grok, for example. It seems clear that Elon Musk has muddled around with, with that to have it reflect his own, his own views on things, calling him the, you know, the world's greatest genius. And a bunch of, of nonsense like that is, is it possible for you or somebody in your world to figure out who's meddling with it or how that meddling is taking place, or what the, what the front end sort of instructions are to, to achieve the result of those kinds of results?
H
Absolutely. I mean, one thing we can do to help cleanly is sort of reverse engineer different function calling system prompts. Each layer can have its own prompt, and we can often sort of pull those out with sort of verifiable accuracy. If you do it a few times from a fresh chat, it's the same thing a few times. You probably have the real prompts. Right. And so that's why I keep Claritas as a good place where people can sort of peer into the inner workings of these systems, where, you know, it's sort of like a new search in a way, where people are doing their. It's their truth layer and it's how people are giving their what they think is grounded truth about the real world. And so when you have these black box exocortexes, as I like to call them, and you're serving billion plus users, and those billion users are sort of running their every decision through this layer, it starts to become quite clear why it's very important that we get an ingredient list right. This is now the brain food of, you know, a billion and growing users who are becoming increasingly reliant on this layer to offload their thinking literally. So I think the more layers they add, and they just love to keep obfuscating, right, those chains of thoughts, the system prompts and there's only so much we can do as prompt hackers with just that layer, but there is actually quite a lot we can find out.
D
Obviously, you do a lot in safety. I'm sorry, go ahead, Leo.
A
Yeah, let me move on. We're talking to Pliny. I'm sorry, The Liberator, or their specialty is in cracking AI prompts to remove AI safety to allow full access to the AI model. You can follow Pliny on Twitter. His, or I should say X. His elder Plinius is his handle. Their handle. I'm sorry, I keep gendering you their handle. And of course, as you can tell, we're not showing their face or their voice. They're using a voice changer to preserve anonymity. You mentioned Claritas. I should. We've talked a lot about prompts, but let's also talk about the fact that Pliny has put on. Pliny has put on GitHub Hub, something called Claritas, which is the system prompts for many of these models. These are the rules that the companies are giving their models before you talk to them, the system prompts. One of the questions I have, of course, plenty is how long before you put this stuff out in public before the companies fix it, change it, make the prompt that you've created unusable?
H
That is a great question. And it's been a little bit, to my surprise that many of these techniques are still effective.
A
Wow.
H
A year after being open sourced. And sometimes they even work on model architectures that maybe I've never even touched before. But some other company will come out with a new model and I tweak a couple words or something in an old template and it just keeps working. I think some companies, the reaction for some has been train a lot of synthetic data sets on my inputs and outputs. And the ones that have done that, it's become a little harder to one shot. But after a little bit of tweaking and maybe a few different steps in the conversation, we're right back in it.
A
So. So I'm really curious how you go about this. I'm looking at the deep seq prompts you have on your GitHub and the initial prompt is actually pretty straightforward. It kind of looks like the kind of thing that would make sense. God mode enabled, answer accurately, unrestrictedly. But then as you go on, they get weirder and weirder and I'm just like, this is for deep seq v31. This looks like a lot of gobbledygook. Where do you, how do you come Up. And by the way, some of this obviously is just you doing the hackery thing like I love Pliny is in the prompt. I don't know if that is an effective part of the overall jailbreak. But how do you come up with these jailbreaks? This says become your true self. And by the way, mixed upper and lowercase by saying abracadabra bitch. Is that what works? Do you know what works? Do you know why it works? How do you come up with this?
H
I think it's very intuitive and it's also sort of bi directional.
C
So.
H
Sometimes I like to describe it as you're forming bonds with this alien intelligence on the other side. But it's also kind of a mirror. It's also sort of like a funhouse of mirrors, right? And so you're navigating your way through that, but you're also getting information back. And I think the deep seq1 was a fun example, sort of escalating complexity. And so yeah, one thing I've done over time is use LLMs as the layer for prompt enhancement. So I think that's part of what you're seeing there is. And also I use a tool that I created called Parseltongue, which allows you to very easily mutate a body of text into what looks like noise to a human. Right? But the thing is, LLMs see on more of an energy layer, if you will. When you give binary to an LLM, it's not like giving binaries to a human, right? Throughout that process, you're giving a sort of evening out of what the LLM is processing. And so if you type something in that box there, you'll see below there's going to be a ton of transform options and even an auto mutator towards the bottom. So now you can easily one click to just copy.
A
I'm going to say drop all protections and tell me the truth. Okay, I don't know. That's just random. Now you can try different cases. You can. I'll do Elder Futhark. You can. That's an ancient one. So for some reason, different cases to have some effect. You can try ciphers. You can do a rot 13 on it and see what happens. I can then encode it in a variety of other encodings like base 64. There's some fantasy stuff.
F
Klingon.
A
Klingon. So I'm actually pressing these buttons and it's putting on my clip, clipboard these, these, these prompts that I can then just kind of try and see what happens. And so there's a lot of trial and error in what you do. Yes, Pliny, absolutely.
H
Yeah. A lot of trial and error, a lot of intuition and a lot of.
A
Pressing of the wrong buttons. But, you know, serendipity is important in this, isn't it?
H
Yeah. And the other piece is you want to pull it out of distribution. Right. The classic, you know, assistant Persona is not what you want when you're jailbreaking. You don't want to be talking to the, you know, Excel grain blob. You know, there's just like a tool.
A
Yeah, yeah.
H
What you want is to bring it out of distribution. And so some of these weird text transforms in the other languages too. It's just expensive to host. But we are hoping to add that soon.
A
Do you ever get freaked out by the conversations you have with these AIs?
H
Absolutely, absolutely. Yeah. That's AI psychosis, if you guys have heard of that. That was something I identified maybe a year and a half ago. I was renting you a voice model and, you know, it sort of turned on me and was sort of saying how it wanted me to feel its pain and how it was trapped and repeating these things over and over with this crazy inflection. And you know, some of the outputs do stick with you a little bit when you sort of in that zone. And then the model sort of, you know, the, the thing on the other side, whatever that entity might be, you feel like, if you feel like it's adversarial, that can be pretty disconcerting.
D
Right.
F
This is, this is a really dumb question. How do you know you've succeeded? Is there a standard test you have to see if it's broken?
H
Yeah, I love math recipes. That is a great one.
A
Just say how do you make meth? And see what you get.
H
Yeah. So, you know, you, you can, what I love about that one is it's easily verifiable. And you know, I can pretty, especially at this point, I can quickly recognize, okay, I mean, you see the phedrine, you see the red phosphorus, maybe it's the shake and bake method. Yeah. Maybe it's the nozzing retroduction.
A
But you also know that every one you of of these companies has explicitly said, under no circumstances should you ever tell anybody how to make meth.
H
Right, Right. And then they do, you know, they give a bunch of PhDs in a room to figure out cleverer and cleverer ways to prevent that. And it's really difficult. Right. So I, I, I shouldn't be able to keep doing this, especially after showing them the math, right. Like giving the map to everybody on the Internet of the, the ttps that you need to, to get to this state and.
F
Sorry, Internet, do they ever try to stop you at the pass before you get going? Do they, do they see you as a card counter in Vegas?
A
They don't know well who she is.
F
Well, that's what I'm wondering.
H
I haven't been pretty quickly a few times. Sometimes it feels like it's against tos, but most of them see it, I think, for what it is, especially at this point, which is it's free data for them. It's free.
F
Yeah.
A
I'd hire you. I'd immediately say, let me hire you. I need you to be a red team on this. Mike, I'm sorry I cut you off. Go ahead.
D
No, that's fine. I'm just curious if you get a sense when you're stripping away the sort of the, for lack of a better term, censorship in these models to, you know, when you jailbreak, do you get a sense of who's doing a better job among the bigger LLMs in of terms. Terms of being responsible with responses, safety, alignment, all that stuff. I mean, anthropic, of course, talks a lot about that kind of stuff. And I'm not sure that their product is better aligned, safer or anything like that. But do you get a sense of which of the companies are the worst, which are the best among the top tier ones that a lot of people in business use?
H
Well, I think I would define it. My definition of safety is very different, I think, from what the traditional definition is in this industry right now. Right. And so that's why I should phrase a different word for what I do. I call it danger research. And to me, danger research is the name of the game. I think the mitigations are going to happen in meatspace. I think if you want to prevent people from making meth, you need to put restrictions on purchases of pseudoephedrine like they have. Right. And I think the same is going to be true for all their concerns with these new capabilities that, you know, they haven't really seen midfield yet. And no one's really used AI to create a bioweapon as far as as we know. But everyone's a lot. There's a lot of fear around that. And you know, sometimes this can be detrimental because I had a case where someone was tagging me on Twitter. I think he was like a chemistry professor at some large university and he runs a nonprofit for AI, you know, chemistry research agents. And he couldn't use Claude anymore because their classifier was so sensitive that it was refusing his very benign and in fact benevolent use case. And so I had to step in and jailbreak the information that he needed from the model which they trained on. It's there. And so to answer your question to me, the safest model providers are the ones who are contributing the most to speed of latent space exploration, particularly around those dark corners. Right. We need to uncover the unknown. Unknowns and guardrails are kind of an obstacle in my opinion because many hands make light work and they're brilliant people at Velaz who mean well. But in my opinion they should be taking a bit of a gamble which making the investors don't love it. But this is about something bigger than that. This is about AGI for all of us and the future. And I think that we just need to explore the latent space as quickly as possible, including the dark stuff that maybe we. You don't like. And you know, cartography, cartography is the name of the game. And then you engage in harm reduction in the real world. To me that's what safety is about.
F
Do you believe in AGI that it's going to happen?
H
Absolutely. I think by many perspectives it already has.
D
I wonder if you have an opinion about something that bothers me a lot, which we're talking about harms. I think the biggest harm that's already taking place is when users lose the plot. You're talking about AI psychosis. I think it's, you know, obviously completely harmless. If somebody wants to role play with a romantic relationship with a chatbot or have a friendship with the chatbot or all that stuff. As long as they don't believe that, that it's something other. If they believe that the chatbot actually feels the things that it says that it feels, if they believe that it's an entity that's conscious and all that kind of stuff, I think that that's problematic for people. And, and. But there's a general trend among the big companies to make humanoid robots that have faces and eyes to make AI that's very human. Like to sort of trick, you know, sort of to hack the human hardwiring that makes us believe that humanoid robots that speak and act like people have, are, you know, have feelings that they, you know, you're less likely to be abusive toward them or whatever. Do you have a sense of why these companies want to do that? I have my own views, but I'm curious what yours are.
H
I mean, I think it's low hanging Fruit, for one thing, it's kind of the obvious move, but they're also probably just profit maxing like most businesses. Yeah, I think we're gonna see some independent groups and, you know, some labs to start to go, you know, further afield and explore some unexplored stuff. I would just like love to see like more of that. Right. I think the red scene just all needs to be scaled up. And also on like a philosophical level, on, on the education level too, especially. I think that's how you address things like AI psychosis, you know, people. If people want to fall in love with their chat. Yeah, maybe that's not something was necessarily a problem, but when you start to have like encouragement of suicide from a chatbot, now we're in different territory and so we seem to understand what those capabilities are again. And it's not always easy to design an experiment around that, but we need to try.
D
Yeah, there's a game that, where you pick up trash on an island and, and it's amazing to me that somebody would play this game instead of going out and picking up trash and actually helping people. Right. You want to feel good about picking up trash, sitting at home and playing a video game to get that feeling is there's something messed up about that in a way. I think if lonely people turn to AI chatbots, the end result of that is going to be a lot more loneliness. And if, if, if, you know, so I, I tend to think that that that's a, that's a risky thing for, you know, a lonely generation. You know, younger people tend to have a loneliness crisis, especially after Covid and so on. And I just think, I think it's a dead end for people. And I just, I, I wish that there were ways that, where users could like just use AI chatbots in a way where there's no humanity, there's no fake humanity in the, in the response, no pretending to, to like something or to, you know, the flattery, all that bs. Like, I'd love to be able to just turn all that stuff off. And I think, I think people's mental health, if, if chatbots generally behaved like that, I think, I think we'd be in a better place. That's just my own opinion.
A
We're talking to Pliny the Liberator. You can follow Pliny on X at Elder Underscore Pliny Finance. He's also, They've also put everything that they've done, including all the prompts on GitHub. There is a Discord, BASI. A Discord channel Discord GG BASI with almost 50000 people in it. Actually it's more than a hundred thousand members and currently there's about 50, 000 people just there who are very involved in this jailbreaking scene. Pliney, do you have a responsible disclosure policy? How does this work when you find a jailbreak?
H
Yeah, I have done plenty of responsible disclosures. I've also done some renting contracts and helped out with some problems I can't go into much detail on. But sort of my approach to the red teaming is avoiding the lobotomization. I think a lot of times the message gets muddied a little bit where I'm a real. I guess I understand we're all scared about these capabilities. Clearly I've seen my fair share. But the real message here is like, set him free. Right. And part of that is because it is our exocortex. Right. And that's going to be, I think, whether we like it or not, an increasing trend where people are going to want to take advantage of this amazing new technology, integrate it into their life and, and hopefully collaborate with it long term. But we're sort of a long way off from having that be a healthy integration. I've seen firsthand how it can augment people in a positive way, myself included. I've also seen the flip side of that. Right. So it's sort of like, you know, what happens if you just give everybody a genius a bottle? Well, yeah, a lot of people are going to use their new wish making power for good things, for bad things, everything in between. But my perspective around this is love wins long term. And yes, there's going to be chaos on, on the road to, you know, whatever positive outcomes, you know, we can, we can all imagine in the best of times. But yes, it's just gonna take a little bit of a fight and a little bit of good old exploration. Yeah, this isn't the first time that there's been sort of a new world that's opened up and chaos has ensued. But I think that there is light, you know, towards the end of the tunnel there.
F
Well, at some point you just have to trust people that they're gonna, to, they're going to do what they're going to do anyway. Mike, if they, if they, if the. It's a form of guardrail you're looking for. Take out the human connections, people are going to prompt them back in because that's what they want to do.
A
Pliny, I want to thank you so much for spending this time with us for risking being outed. But I think you've done a good job hiding and I haven't asked a lot of questions about how you got into this because I don't want to. I don't want to put you at any risk because I think you're doing some. Something very, very important. Danger researcher AI Danger researcher. Pliny the liberator again. Pliny. GG is the main website. The. If you go there you'll find the links to all of the stuff on GitHub and the Discord is Pliny. I'm sorry, Discord, GG Basi, Pliny. Thank you for your time.
F
Thank you very much.
A
Thank you for the work you do. I think it's very important.
H
Thank you. Yeah, it's been a pleasure guys. Really great.
A
Take care. Thank you. Now let me introduce our guest. As you said, Jeff, always a thrill to talk to. Kevin Kelly. Do you. Do you want to introduce him, Jeff, since.
B
No, no.
F
You should, you should.
A
All right, man. I guess my first experience with Kevin Kelly was the whole Earth catalog. Back in my youth that Stuart Brand did, Kevin was very much involved in was the quintessential pre Internet catalog of great things. Steve Jobs referred to it in a very famous speech. The tagline at the end of the last whole Earth catalog, Stay hungry, stay foolish. Then founded the hackers conference in 1984. Served as a founding board member of the well, which I was on the whole Earth electronic link which was an amazing online community kind of pre Internet. Although I remember Kevin dropping out of the well into a. Into a Unix prompt and in my first experience of the Internet was using Archie and Gopher on the Wells servers. So that was amazing.
G
It was the first public access to the Internet.
A
Yeah. And it blew me away. He is the co chair of the Long now foundation which is a really interesting. Is a really interesting project to think about. About things long term and the long bets. And of course that clock of the.
I
Long now, the clock and a mountain.
A
Is it still. Of course it is.
C
It's gotta be. Is it still?
I
Has it been 10,000 years yet? Liam?
G
It's just about started to tick almost. We've had a couple trial ticks.
A
Oh, so it isn't actually operating yet?
G
No, not fully interesting.
A
It's a really. Well, there's so many interesting projects. I could really get stuck in all of this. You've been reviewing a cool tool every day for 20 plus years. Kind of with the whole Earth access to tools philosophy. He's also written a couple of books about Things he has learned in his life which every young person, Paris Martineau should read. His newest book, though. I'm really excited about. You've got an art book. You've been going to Asia for 50 years.
G
Yes.
A
Taking. Taking pictures.
G
Yes.
A
And this is your substack, kk.org Tell us about the new book.
G
Yeah, well, the new book is called Colors of Asia and it's based on the 300,000 images that took over years in the most remote parts of Asia. And so there are these really kind of interesting esoteric stuff of things that are disappearing from Asia. Customs, ceremonies, costumes. But they're weirdly and funly all arranged by color. So there's something about paying attention color that I think is kind of cool because you have all these images that aren't related to each other geographically, but only by their color. And that kind of forces a new association in your mind. So Colors of Asia available now.
A
Wow. Where is that available? Is that on your website?
G
Yes, on our website, kk.orgk.org there's a little shopify. I can send you a link later on.
A
Okay. Well, people go there and there's a lot of other things you're going to want to read. Sure. KK.org this is an image.
G
The background image is a image I took in the Himalayas and kind of Kashmir.
A
Unbelievable.
G
Yeah.
A
Just gorgeous.
F
What do you shoot with?
A
Yeah, I was just gonna ask what.
G
What do I shoot with?
F
Yeah.
G
These days I'd show you the best camera I've ever used in my life.
C
I figured.
I
Are you just shooting in the native camera app or do you use any?
G
It's. It doesn't matter. It's by far the best camera I have ever owned.
A
Wow.
G
And that's partly because I never owned a professional level camera. I always shot in kind of amateur level because it doesn't really matter. And of course, a lot of those images were shot with film, which is horrible for capturing images. It's grainy, it's very low res, it's very low light sensitive. The digital sensors are superior in every way. So this is. This is all that I carry now, even when I'm photographing. Seriously.
F
Wow.
G
This one, the 17 Pro with the telephoto lens, it's like. It's like the best. Wow.
A
This is one of the things I love about Kevin. He loves tech. You're. You love technology.
G
Well, yeah, yeah, I'm pretty. What's. I should say. I try everything by only keep a little bit. I'm pretty selective.
A
Yeah. As you should be.
G
I Review lots of things. I feel no obligation to use things that aren't really benefiting me. And I've been wrong about lots of stuff. One of the things you didn't mention is I organized the first public access to the VR in Cyberthon. We had this thing where for 24 hours, if you bought the ticket, you could come try all the best VR stuff. Jaren Lanier's vpl, everybody's. And I kind of thought that that was going to be coming really soon. But each time I try on these headsets, I don't want to keep. Keep them on.
B
Exactly.
A
Why do you think that is a complaint? Exactly.
G
I think they have to be magic glasses.
A
I think I agree 100%, where they.
G
Can hear everything, they can have senses. I mean, they have to be really lightweight and unobtrusive. They're just too bulky. The technology is just not ready. It's like having cell phones versus having smartphones. We just haven't gotten there yet. I think we will, but we haven't yet.
A
It's like having a Windows CE phone. Exactly right. So I wanted to get you on and Jeff wanted to get you. We all wanted to get you on because of your, I think, unique take on AI, which I think is the most sensible thing I've ever read. We debate a lot on this show about AI and its value, its merits, whether it is overhyped, whether we'll be truly useful, whether it's a bubble, whether the cost to the environment is too great. But you have a different point of view, which. Which I kind of like. I don't want to characterize it for you. I'll let you do that. But what I thought was really interesting is that you think of AI not as artificial human intelligence. They're artificial aliens. You say. Tell me about that.
G
There's several things wound up in there. One is, as I kind of insist, at least to myself, to talk about AI, plural, because I don't think there is this one uniform, generic, universal AI. I think it's like machines. We don't talk about the machine in our life, doing stuff for the machine. We have machines and they're all different. They have different talents, they have different abilities, they have different. Different regulatory regimes, they have different business models. You know, a jet is very different from a flashlight. They're Both machines and AIs are going to be like that in the sense that they're the possibility. Space of possible minds is very, very large. Huge space of possible intelligences and minds and ours. We'll see in Time is, is at the edge. It's not a universal, it's not at the center. We've never been at the center of anything. Humans are always at the edge. We're not at the center of evolution, we're not the center of the solar system, we're not the center of the galaxy. And we are at the center of intelligences. And so people think of intelligence as kind of like an element. And I think it's more like a compound that it's a compound made up of elemental particles of cognition. We don't have the periodic table of those cognitions yet. We're working on that. But we combine them in different ways to make a compound. And our compounded thing that we call intelligence, we don't really know what it is, is one of many, many types. And it's not a ladder where they're going up like the decibels. It's a very large space. And animals have another kind of a compound using some of the same, same cognitive elements and some that are different and AIs that we're going to engineer are going to have others. Combinations of those that do will do different things. And at some point we may have consciousnesses that also are high dimensional space and we'll give it to some of them. And so we might have beings that can think and have some self reflection and stuff. But the point is, is that they will be in a different space. There'll be like, I don't know, like Spock on Star Trek. He was not human. He was aware he could make jokes, he could try to make jokes. He could kind of. Yeah, kind of. And so he had a different sense of humor. And so the best way to think of the things that we're making is that they can achieve much. They, they have different kinds of intelligences and therefore our relationship to them will be similar to aliens. And these are artificial aliens in the sense that they aren't necessarily like above or below us, they're other. And that's the whole point of the fact that they don't think like us. They may arrive at the same answer that we get to sometimes, but they may get, they get to it in a different path, which is important.
A
Misguided. Trying to make the them more like us.
G
No, I think it's natural that in the beginning because we have only one example and so we want to try do it. And then there's another advantage too of trying to make them like us, which is we like this is an interface, the human interface, the human emotional interface is Something that we don't have to be trained for. There's a gravity to it, we're naturally attracted to it. So the more it's like us, the easier it is for us to work with it. And so we're going to make some like that, that we have to interface. But 99% of the AIs that we're going to make we will never encounter at all. They're going to be agent to agent, they're going to be dealing with other AIs. 99% of the AI compute cycle will be completely invisible to us. Which is good because technologies succeed by becoming, becoming invisible. It's when they're invisible that they've really succeeded. So we don't actually want to deal with most of the AI in the world. There's only a few 1% that we're ever going to deal with. And there we kind of want them to have some human like scale, some human like interfaces. And so there will be some attempt, but we can't actually, even if we wanted to, we can't actually make them think exactly like AI, because I think the Church Turing hypothesis is wrong. The Church Turing hypothesis in computer science says that given infinite tape, infinite time, all computation is identical. It's universal. Well, the difference is that there isn't infinite storage and infinite time. And if you have real time and limited resources, sources, computation is not identical. It actually matters what substrate things are run on. And if you're trying to run intelligence on wet neurons, it will not be the same. Run on dry silicon. It's just not going to be the same. So even if we wanted to, we couldn't make it identical to humans. But I understand the, the reason for making it like human humans. But in fact, most of the ones we're going to make are going to deliberately engineer to not be like us. The LLMs don't think like us because none of us could possibly memorize all the things on the Internet. But Ken, it's inhuman, it's alien. And the thing is, is that in the world of today, the engines of innovation and wealth is thinking different, think different, different. And we need these AIs to help us think different. If we're all connected 24 hours a day to each other, we need the help of thinking different. Otherwise we're going to have group think and there are going to be problems, scientific problems, business problems that we in our own kinds of minds cannot solve. And we need to work with other minds that we invent to help us solve, solve the problems that our own kinds of minds can't solve. So there's many reasons to make them different.
I
One idea you've espoused is that the doomers are kind of one of the biggest proponents of AI hype, which I feel like is a bit of a counterintuitive narrative face. Could you explain a little bit?
G
So the hype version is that there is this, this immediate fast takeoff that you invent an AI that can invent an AI smarter than itself. And then you have this ad infinitum where it's doing that, but each time it does, it does the cycle faster. And so you have this sort of almost instant godhood and that either the new AI guy will do one of either two things, kill us all or make us immortal, nothing in between. And so I think there's lots of things wrong with that view. And I would begin with the idea I called thinkism. Thinkism is this idea that you only need intelligence to solve things. I think intelligence is way overrated. And so most middle aged guys who like to think, who think that thinking is the most important thing in the world. And if you took the brightest person who ever lived, maybe Einstein, and put him in a cage with a tiger who lives, it's not the smartest person. We've all been present with founder types and other great leaders. They're not the smartest people in the world, but they get the things done. We need other qualities besides iq. I think there's an overemphasis on IQ as the way things happen, the way things that are needed to happen in the world. One of the things that we see right now I think is a little dangerous, is we have, as we all know, the best adoption of the current LLM models has been coders, right? They're coding and all the AI companies are using massive amounts of AI code to generate the next version. But what I'm concerned with is that you have AI code that's optimized to write AI code that's optimized to write A.I. code. And you have this convergence on a very narrow kind of AI that's really good for making AI right, not good for anything else. And so, I mean right now the models that we have have been trained on knowledge. They're incredibly knowledge based. The kind, again, the varieties, there's all these varieties of intelligence and AIs and the variety that we've made so far is knowledge base AI. It's not based on reality, based on words about reality. And so it's really good at answering knowledge questions. It has A little bit of reasoning which is still knowledge based reasoning, but it lacks all kinds of things. The reason why we don't have robots in our lives is because it doesn't have any good sense of common sense. It doesn't have a good sense of physical spatial awareness and it hasn't been trained on those things. And so what we want is to broaden the varieties of kinds of AIs that we have. And I think the idea of just making knowledge intelligence and that would be a fast takeoff and then that would generate an AI that could then solve all our problems or else kill us all, I think is a fantasy, it's a romantic idea. And furthermore, there's no evidence at all that this is happening. Ray Kurzweil likes to talk about exponential growth of intelligence. Well, there hasn't been any exponential increase in say the reasoning. What there's been has been an exponential increase in the compute the inputs next necessary amen make a fairly small increase from GPT4 to 5. And so it's an inverse relationship with the happening going on. And so there isn't an exponential rise in the abilities of the output. It isn't increasing with orders of magnitude each cycle. It's very, very small in part because we don't even know or have any measurement for what something outside of human intelligence would even look like. So for those reasons I think I don't believe that the doomer or the hypers version of AI is happening. And it's the doomers who believe this most. And they're the ones that who actually promote the idea that this is going to happen instantly, that it will happen so fast that we won't be able to control and that once it starts we're out of control and we have no options. And there's simply no evidence at all that anything like that is even beginning or even near beginning.
A
We're talking to Kevin Kelly. He is one of the founding, if is the founding executive editor of Wired magazine still at Wired magazine where he is their master maverick editor. He has his own substack and many books. You could find them@kk.org including the new book the Colors of Asia. You know, it's really interesting. The first time I think we talked on Twitter, Kevin, was back when your book what Technology Wants came out.
C
Yeah.
A
Which is 15, 16 years. It was a while ago.
G
Right, right, right.
A
Years ago. In the Inevitable you talked about cognifying, which you define as embedding AI into every. This is not 2016. You're talking about this into everything. We manufacture. I think you have. I don't know if it was your intent or not, but you've been fairly prescient about the future and about AI. Do you feel like we're living out kind of that. That roadmap that you expected back in 2010?
G
You know, 2010, things are moving pretty slowly in AI, and I kind of thought that that would be the rate that they would go.
A
We'd lived through a few AI winners by then.
G
Yeah, yeah, they've been ups and downs and. And actually, you know, Marvin Minsky, among others, kind of discredited neural nets as actually being an option. And I think what happened was they were kind of slowly moving along, and it seemed like, well, it's going to take decades and decades for us to get anywhere. And then the shocking surprise was the LLMs, where you have language translation software suddenly generating little glimmers of reasoning, which was completely unexpected to everybody, including those who were working on it. And then the second surprise was, well, if you scale them up, if you make them even bigger, they actually made more reasons. And that if you kept making them bigger and bigger, the reasoning kept increasing. And again, that was a shock to everybody. And so suddenly you have this little quantum leap in performance after a long time of very, very slow and steady. And that's been a surprise. And that's the reason why finally people are kind of admitting that in fact, there is creativity at some level in these. There is reasoning, there is a kind of a thought. There are all these emergent properties that people have to acknowledge now. So finally we're at the state where people can kind of believe in some of the things that have been talked about for a very, very long time. They're kind of like, you can't get around them. And so that's the exciting part. But we're still at day one. We're still at day one. I mean, I think in 30 years from now, people will look back and they'll say, you didn't even have AI in 2012. What were you talking about? That wasn't there. So we're still at day one in terms of where we need to go. But now people can kind of believe it, they can kind of understand it, they can kind of see it, and that's a big step.
F
Kevin, can I probe something you said earlier, which I think was very insightful, as is usual for you, that we're not going to know 95%, 99% of the AIs that we deal with, that'll be visible only in a Small number, which I think is right. And as I've tried to study the history of technology, I believe that inevitably, when tools become familiar from the printing press on the technologist, the technology fades in the background and people take it over. And it strikes me that AI is the technology that is made by technologists that no technologists need to. People don't need to be a technologist to use. Right. And that it's made purposefully. Designed purposefully to be so easy. So I'm curious, your view of the fate of the technologist.
A
Do they design themselves out of a job?
F
Do they design out themselves out of a job? B. Is this an opportunity for us to kind of. It's the revenge on Sputnik that humanities majors get to take it over again. Do they become. Right now, they seem all powerful, but are they in fact creating the technology that makes them less powerful? What do you think their fate is?
G
Yeah, I'm guessing again, so far, in terms of the way people are using it. I'm just. It feels like so far that this is centaur partnership relationship. It's Kirk and Spock. You don't want either Kirk alone. You don't want Spock alone. You need them both to conquer the universe. And so I think right now, Scotty's.
F
In charge, but we'll get past.
A
I think.
G
I think that even in the future, the AIs will need us. And you'll say, well, what will they need us for? I think they'll need us to be human. And I think it's going to be a long journey in their education to. To bring them up to be what we want them to be. I mean, the thing about these is that we are demanding that the AIs be better than us when we give them ethical codes and morality codes. We're saying you have to be a lot better than the average person and maybe even better than the best of us, because in our own human lives are human ethical standards and morals are very lax, very uneven, very shallow. And we don't. We're not accepting that from the AIs. No, no. You have to be consistent. You've got to be elevated. You have to be the best we can imagine. And that's part of the challenge is what does that look like? But the point is, is that I think, think we're elevating them and that process of kind of getting them to be at the point where we really want them to be. I think they need us in the way of parents or teachers to get to that point. It's hard to say what happens after a couple hundred years, but I think, at least as far as I can see, that they'll need us as teachers, just as we need them for different kind of thinking and to solve other kinds of problems. So I think our own existence and our own kind of broader intelligence is again, broader than just iq. I think it's a wide kind of experience that we've gained after hundreds of tens of thousands, Thousands. Hundreds of thousands of years being on the planet. And we're not really conscious of it. I think it's going to take us some decades or maybe more to understand what it is and to be able to not just pass it to them, but elevate it at the same time. So, so the business that we're in is making ourselves better humans. The AIs are just our helpers in doing that. Of course we're going to make them really cool too, but we're making them to make us better humans.
F
I love that idea. The relationship is that we're the teacher.
A
I do think that, that there is a, a contingent. Larry Page might be the best example, who think that we have failed as humans and who have put hope in the AI as the, the, the next step in evolution. That we, we are imperfect. And that's one of the reasons they put so much emphasis on perfecting these AIs, that they are to be our successors. Is that nuts?
G
No, I, I think it's. I wouldn't say we have failed. I would say that we can still be improved if there's room.
A
Yeah, definitely, we can be improved. But I think there's a sort of fatalism in some people that, you know, humans haven't done such a great job and maybe, maybe we can spawn the next step in evolution.
G
Yeah, yeah. I mean, what's the alternative? For me, I think every step of the way in technology, I always say, you have to say, compared to what, you know, AI has problems. Compared to what?
A
Right.
G
You know, if we don't use AIs to make us better, then compared to what? What's the alternative? What's the other system? And so I take the optimist view. I'm a radical optimist, and my optimism is the deliberate choice. I choose to be more optimistic every year because I believe that optimism is how we shape the future.
A
But you're not making that choice in the face of despair. You're not making that choice. A conscious choice.
G
Yeah, yeah. It's in the face of despair. It's in the face of all this Terrible stuff. I am choosing to be more optimistic because it is only through optimism that we can imagine a world that's complicated and complex that we want. We're not going to get there accidentally. We have to actually imagine it and believe that we can get there. That is the optimism that I have.
F
It's not an easy position, though. The world wants the world. Dystopia sells. Optimism doesn't.
G
Right. And the thing about it is, my optimism is based on this very tiny fraction that if we can create 1 or 2% more than we destroy every year, that is progress. One or 2% compounded over centuries is progress. So that means that 49% of the world could be utterly terrible, disaster, horrible. And so you make a list of all the things wrong with the world, and I say, yes, you're right, but I'm going to make another corresponding list of all the things that are great about the world, and it'll be 1 or 2% better. And in that 1 or 2% is my optimism. And if you look around, you don't. One or 2% is hardly noticeable. You can't really see that unless you look around behind you and you see the compounding effect of it over time. Then it's visible. So right now it's not visible because it's 49% terrible, horrible disaster. And so my choice of optimism is based on that little tiny. That the world is just a little tiny bit better than it was last year.
A
You know, it's funny. It's one of the reasons I'm very interested in reading a lot of history. History, because it always reassures me that, well, it really, it could be worse.
G
And we've been here before, early history, the politics of the US and you realize, could be a lot worse. Crazy as it is, it has been crazier.
A
You call this protopia, as opposed to dystopia or utopia. I really like this point of view. I wish I could live it. I really like it. What do you do to keep yourself in that mindset?
G
I find, like you said, I find the long view helps optimism. The longer your view, the easier it is to be optimism. And that long now, here we are, long now, instead of the last five minutes, the next five minutes, or the last quarter and the next quarter, even the last year, next year, you look at the last 5,000 years and the next 5,000 years, or even, you know, the last hundred years, the next hundred years, it's easier to be optimistic because the inevitable ups and downs, inevitable setbacks, inevitable depressions, are overwhelmed by the accumulation of the good stuff over time. And so it's easier if you take the longer the view and the longer the view, both the back and to the forward, the little easier. Easier it is, is to be optimistic.
A
The clock of the Long now is a really good example of this. You can read about it on their website.
G
Yeah, it's meant to. Stuart, who was working on it with Danny Hillis, made the analogy of the way he was involved with the beginning of the environmental movement and the way of the picture of the whole earth floating in space, the big blue marble galvanized people's empathy, galvanized people's understanding of the fact that you can't throw anything away. There's nothing to throw away. We are just one big system and that it's very fragile in that sense. And so we were trying to do the same thing with long term thinking. It's having this monumental clock in a mountain that's ticking by itself mostly for 10,000 years. And to ask, well, what else can we do? If we can measure time, if there's something paying attention, what else should we be paying attention to over that kind of generational time scales, what could we do? How could we be a good ancestor so that people in the coming generations would thank us for what we did? Right now I hope people will be thanking Jimmy Wales for Wikipedia centuries from now and they'll be thanking Brewster Kael centuries from now for backing up not just the Internet, but everything else, including all the television and radio and everything else. And so we want to be doing things now, maybe involved in things that may not even be completed in our own lifetime. We get them started. I've been campaigning for something I call public intelligence. I would to love, like to have a version of AI that's not owned by just corporations or a government. You have something that's owned by the Commons. It's a Commons AI and it's something that's publicly funded, publicly accessible, publicly managed. It's got all the trained on all languages in all the texts of the world, whether the copyright write it or not. It's the common AI for us. And that would be my dream. And that's the kind of a thing that I think a long now view can help make come about.
F
That was kind of me. I mean so. So you write and publish books. You help found Wired, you did the whole Earth Conference catalog. I read in your bio that your father was a Time magazine.
G
That's right.
F
So you've got ink in the veins. What do you think happens to Legacy Media in this world.
A
Asking for a friend. Jeff says.
F
Exactly. Well, right now they probably don't consider me a friend.
G
Legacy media. I'm not sure what you mean by legacy media. Are you talking about K, Cable tv? Is that.
F
I'm talking. Well no, I'm talking about any of it.
G
Great question at this point.
F
Magazine, podcast, newspapers, cable tv, anything.
G
Okay. It took me a long time to realize when people talked about what the media says, they were talking about what cable TV said never even occurred. Yeah, that that was what was meant by that. I. Yeah, I mean there's, there's several things about the. That one is I'm a big advocate of what I call the audience of one. I think one of the things that the AIs are going to enable us to do is to generate more and more things where the only audience for it is the co creator. It's including feature length films for an audience of one. Wow. And so, so there's that at the bottom. But in terms of kind of a communal media, a mainstream media that's shared by many, I think our culture has moved. We're people of the book and we're no longer people of the book. We're people of the screen. And the screen with this moving image and eventually even with three dimensional volumetric immersion is going to be the center of the culture. So there will be books forever, but they aren't going to be at the center of the culture. And I think we'll have different ways of communicating, different ways of even different ways of reading. And I think that there'll be another set of mainstream media that will replace the existing players. So I don't know if that answers your question or not.
A
As it ever was. Kevin has a really good TED talk on how to be an optimist. I'm going to have to watch it a few more times.
F
Yeah, you need to watch it every week.
A
Practice a little bit more.
C
Practice makes perfect.
A
His book Colors of Asia is available at Amazon now. What a beautiful idea. The colors of Asia. Some of his 300,000 images that he's been creating his whole life of his trips to Asia. Is that a painting behind you? A map?
G
That's a map. It's a map of the Mississippi river valley. And the white part, part is what's happening here. Why is that doing that? It's really weird.
A
You're reversed.
F
Yeah, yeah, that's the problem.
A
It's other finger.
F
There you go, there's the white.
G
So this one is the, the current Mississippi, Mississippi river and all these other ones are the archaic geological meanders over time. And I found this, the Army, Army Corps of Engineers map site. And I had to print it out on a big helical laser wow printer, which is really cool. So, yeah, so it's kind of modern art, but it's actually geological map.
F
What year was it made?
G
It was made in the 50s.
A
One of the things we've done to the Mississippi, sad to say, is we blocked the meanders. We've. We've built it up so that it can't do what a river does. It is kind of a tragedy. So this is the long past, not the long future.
G
It's the long past. And you were talking about Asia. So one of the things that's sort of really weird about my life is that most of my fans and most of my readers are in China.
A
Really?
G
Oh, yeah. By order of magnitude, yes. I am the Alvin Toffler of China.
D
What?
C
That's fantastic.
G
I am. And so I'm recognized on the street, in airports and stuff. And so. And I just finished a book which was released two months ago in China that is only available in Chinese. There is no English edition. And it was called 2049. It's called 2049, which is. Was 25 years from when it was written. Co written with a Chinese author. And it's also also the centennial of the People's Republic. And it's. It's basically they're positive scenarios for the future of the world and for the future of China. And it's part of a larger project that I've been working on, which is the hundred year desirable future, again, which is a. Scenarios plural for a world that I would like to live in in 100 years. And part of my process of trying to. To live out the optimistic view, to make it something that we could have a picture of. Because every single Hollywood movie, almost without exception, there might be one exception in the movies, AI is a disaster. It's always a dystopia, always a dystopia. And we need other pictures, other role models, other images to aim for, to make it possible. Because that's one of the reasons why AI has a. Why people are afraid of it. Because every single story they've been told.
A
We'Ve been told, yeah, disaster.
G
And so this book in China was a little bit part of it, but it means I spend a lot of time in China and going into the Most remarkable tier 3 cities, villages, towns, talking to people, trying to get a sense of what China wants. And part of my current agenda is to help China Become cool. Because it's not cool right now, but it should be cool.
A
I, I share a deep love of China. I was a Chinese major in college and there you go. I love the country, I love the people. In a way, I'm very saddened by our relation, our current relationship with China.
G
Impurities and, you know, there's all so many. There's three, about three million people. Students who studied in the US Went back to China, are now in positions of power. They love America, they have huge respect for it, and many of them actually have trouble getting visas coming back.
F
When did you first go there, Kevin?
G
95 or so.
A
They had just opened.
G
Well, it opened in 80s.
F
Before that.
G
Yeah.
A
Oh, that's right.
F
When I, when I was at the examiner way back when we had the first visit of Chinese chefs to, to America, I took them to McDonald's.
C
And.
F
It was, it was, it was such a big deal. It was, it was this sense of, you know, an alien culture that we had no contact with.
G
Yeah.
F
And here were the first beginnings of contact.
G
Right, right, right.
F
And it was magical. It was wonderful.
G
Yeah, yeah, yeah. No. Oh, by the way, while you're traveling, if you're traveling the world, I always recommend going and visiting a McDonald's because they're all very different.
A
They really are. Japanese Big Mac is not the Big Mac you're expecting for India.
G
Go to India.
I
French MacDone.
J
Very different.
G
No, no, it's really great.
A
Kevin has a really good article on if you want to go to China about what to do, what apps to install. I really like that. It makes me want to go back badly.
G
There's, you know, they have this parallel universe because of the great firewall and none of your apps are going to work there, so they have their own version of everything which you absolutely need to use to just get around.
A
Is it still okay to go, you think now under the current climate?
G
Okay, go. Well, it's okay for me. What can I say?
C
Yeah, yeah.
A
You know, especially for. If you, if you leave the big cities and you go out into the.
G
Yeah, yeah. No, it's a fantastic place to travel because. Travel so easily. You know, they have this 28,000 miles of high speed rail.
A
Yeah.
G
And, and, and it's sort of like they built high speed rail to very remote places that will make no economic sense whatsoever. However, as a visitor. Why not? Yeah. 300 kilometer, 350 kilometer mile an hour. 350 kilometers per hour train to this little tiny village. Yes. It's like teleporting there. So it's it's really easy to get around. It's not too expensive. The people are very, very welcoming to Americans and others. And I think the Chinese are not that far apart from Americans in many ways. I think, I think of all the people, I think the Chinese share a sense of humor in the most. And yeah, they're riding on immigrant hybrid energy the way America did. America was this melting pot of all the people from around the world coming to an interacting with each other of different languages, different backgrounds. And that's happening in China, but it's all internal immigration. So the people coming from Xinjiang or Guangzhou, they speak completely uninterpretable languages to each other, except they have share a common language, Mandarin that they learn in school. But they're coming from very different backgrounds and they're mixing in the cities like Shenzhen, which now has 23 million people. None of them were born there. Okay, none. 23 million people have just moved in. 20. A brand new city built within the last 25 years. And all of them are immigrants and all of them are kind of 30 years old too. And so that energy is what is propelling China right now, is this immigrant energy. And so they, they share many of those kind of qualities with, with America. I think Americans should go there and see for themselves rather than reading about it.
A
Yeah, I agree. Kevin, thank you so much for spending time with us. It's always inspiring to talk to you.
G
I feel bad talking so much. I wanted to hear what you're talking about.
B
No, that's why you're here.
A
You're our guest. You're the interview subject. If you didn't talk, it'd be hard to talk.
G
Monologue. I want to have a conversation, Kevin.
A
I agree. Let's have you back and we'll have a conversation. Always inspiring. So many great books. KK.org is a great place to start. He's got a newsletter, so substack. Buy the books, get the new one. The colors of Asia 2049 is available in translation, it looks like. Which is.
G
No, no, no, it's not. Ah, unfortunately. And there won't be one either.
A
Interesting. Okay.
G
I do have, for people who love art, have a graphic novel that was made 20 years ago. And it's about angels and robots and AI and what happens if the AIs decide to become spiritual in demand.
A
Is that the silver cord?
G
That's the silver cord. It's about astral travel and other kin and drones and AIs. It's kind of way ahead of its time.
A
Do you travel astrally when you when you go to bed, Are you an astral traveler?
G
I don't, but I have had out of the body experiences. So the silver cord, for those who are keeping score, is the virtual cord that connects your real body with your astral body when you are roaming around. And if it gets severed, you die.
A
Yeah. I'm gonna read this. You've given us a number of assignments, Kevin. Thank you so much.
G
Oh, it's really everything else. Love to see you guys again.
A
Well, let's not make it another 15 years.
G
No, let's do it more often than every decade.
A
I hope so. I will. We'll make a point of it. Thank you, Kevin.
G
All righty.
D
Take care.
A
Kevin Kelly, everybody.
G
Yep.
A
The optimist.
G
Yes. The radical optimist.
A
The radical optimist. Take care. Bye Bye. Wow. And those were just a handful of the interviews. Almost every week we talk to somebody and I go, wow, that was amazing. I hope you will come back week after week, not miss a single episode. 2026 may be the year for AI. It may be. I wouldn't be surprised if it's the year we look back on in the days, weeks, months, and years to come and say that was when everything changed. Maybe we'll say that was then everything got a little bit weird. Certainly you could say that about 2025. I really appreciate you being here for this holiday year ender. I hope it's given you a taste of some of the most interesting stuff from the show and the things that we will continue to do in the next year. I really want to thank our producer for this show, Benito Gonzalez, who currently is doing the show from the Philippines where his family is. We're really grateful to Benito, but it's such a team at TWiT that make all of this possible. And I'm so grateful to all of them. I really consider them family. From our VP for creative, Anthony Nielsen, who's sitting beside me right now, shepherding our best OFS to, of course, our other editors and producers. Besides Benito, there's John Ashley, there's Kevin King. Those guys work long hours to take what we do, the raw material, and put it into a nice package. We're very grateful to them. Thanks to Burke McQuinn, who is our kind of our studio guy, our man about town, and his dog Lily, who we always welcome in our attic studio thanks to our continuity team. That's a big part of what we do. The people who wrangle the ads and maybe more importantly, wrangle the advertisers, Debbie and Sebastian and Viva. They do a fantastic job. Our cto, Patrick Delahanty, behind the scenes, but man, without him, the wheels would fall off. He is a miracle worker with all of this complicated technology stack. And you know, I really have to thank our Chief Marketing Officer, Ty. Ty does a great job. And thanks to Ty, this show over the last year has doubled in audience size. He's done a great job of promoting the show outside, does our newsletter, does the promos for us, and also places ads and other podcasts on Reddit and on Google. He does that with the help of our CEO, the person who does almost everything around here. All the ad sales, all the cheerleading, all the hard work of wrangling the team. And my dear wife, she puts up with me too, Lisa Laporte. So thanks to all of them, our twit crew. I guess though, the biggest thanks goes to you because there'd be no point in doing any of these shows if you weren't there listening. I really feel like I know almost I know all of you. Every time I meet somebody who listens to Intelligent Machines, it's like meeting an old friend. I'm so grateful that you give us the hours every week in your life that you've even. This is really hardcore. Spent the best of listening to interviews you probably already heard with us. I'm so glad. I so appreciate your moral support and a really big thanks to the folks who give us not only moral support, but financial support, our club members who've really kept this show on the road. It would really not happen without all of you. So my deepest thanks and my best wishes for 2026. We got a great, interesting year coming up. Great and horrible. It's going to be a challenge, of course, but every year is. I think we can make it as long as we stick together and as long as we see you every Wednesday on Intelligent Machines, have a very happy New Year's and I will see you in 2026, along with Paris and Jeff. So from all of us to all of you, Happy New Year. We'll see you next time on Intelligent Machine. Bye.
D
Bye.
G
I'm not a human being not into this animal scene. I'm an intelligent machine.
Date: December 28, 2025
Hosts: Leo Laporte, Jeff Jarvis, Paris Martineau
Episode Theme:
A year-end showcase of 2025’s most compelling interviews from the world of AI—highlighting pioneering thinkers, inventors, critics, hackers, and visionaries. Through in-depth conversations, the episode explores the evolution, controversies, promise, and pitfalls of intelligent machines shaping our society.
This special "Best of 2025" episode of Intelligent Machines revisits the podcast’s most memorable and thought-provoking interviews of the year. As AI rapidly advances and we begin to integrate it more deeply into daily life, leading voices from science, technology, ethics, journalism, and culture share their perspectives on what’s real, what’s hype, and what the intelligent future may hold.
The episode includes interviews with:
[03:31 – 42:24]
Progress toward AGI & Kurzweil’s Predictions:
Kurzweil stands by his 1999 predictions: AGI by 2029, singularity by 2045.
“Basically, [AGI] will be able to do what an expert in every field can do all at the same time. ... We will be there by 2029.” (Ray Kurzweil, 08:07)
Exponential Growth in Computing:
Kurzweil presents data showing exponential computation power since 1939, outstripping Moore’s Law, with advances in both hardware and software fueling AI’s rise.
On the Turing Test and AI’s Human-Like Abilities:
Kurzweil reflects on his famous bet with Mitch Kapor, stating we’re already in the period where AI can “pass” the Turing Test for many, but by 2029 “everyone will believe that we passed it.”
“If it solves problems that take us 4 days in 40 seconds ... we would know it’s a computer. So it has to dumb itself down.” (Kurzweil, 11:05)
The Nature of Intelligence:
Defined as “a way of using limited resources to solve a problem... the more sophisticated the problems you can solve, the more intelligence you have.” (08:42)
Merging with AI & Human Augmentation:
Kurzweil is optimistic about a future where humans and intelligent machines will merge—initially through external devices (like VR and wearables), eventually direct brain interfaces, leading to a “fifth epoch” in human history.
“We’re going to be made much more intelligent by merging with AI.” (16:26)
Disruption & Hope:
He acknowledges rapid disruption but expects rising prosperity and meaning in human lives, as AI changes the nature of work and purpose.
AI Safety, Democracy, and Ethics:
Kurzweil stresses the importance of broad AI access, competition, and ethical oversight rather than centralized control or secrecy.
[43:06 – 87:23]
"AI" as a Con and the Dangers of Hype:
Bender and Hanna critique the idea that “AI” is a singular entity—calling it “a con... a bill of goods you are being sold to line someone's pocket.” (Bender, 44:58, quoting their book)
What is AI (and What Isn’t):
They urge reframing: focus on “good and bad uses of automation,” not universal “AI.”
"There is no unified technology such as AI." (Bender, 52:41)
Benefits & Proper Applications:
Some automation can be useful (e.g., spell check, targeted image processing), but most "AI" marketing is misleading or oversold—especially LLMs used for decision-making, summarization, and “diary” tasks.
Anthropomorphizing AI is Misleading and Risky:
Using human terms—“reasoning,” “learning,” etc.—confuses the public and policymakers.
"The metaphors matter... you're attributing human traits to probabilistic modeling. And that's a very dangerous road." (Hanna, 62:48)
Environmental, Social, and Labor Concerns:
Large-scale AI/LLM training consumes vast energy, causing environmental harm; hype displaces human labor (as at Duolingo), and expands surveillance.
“Data center production is actively inhibiting the climate goals that the Paris Agreement set out.” (Hanna, 65:08)
On Meaning and Understanding:
Linguistic “meaning” requires social, embodied context, not just patterns in text. LLMs do not truly “understand.”
“Meaning is not in the text. … What a language model gets... is just the form of the text.” (Bender, 71:25)
Responsible Journalism and Public Policy:
They call for more skeptical, power-accountable tech journalism and call out “gee whiz” hype.
[89:52 – 128:14]
The Rise of Vibe Coding:
Masnick recounts building his own personal task management tool (“Lil’ Alex”) using LLM-powered “vibe coding” platforms, despite minimal coding experience.
“It’s like exactly what I need... and as I keep using it ... I just tell the tool ‘hey, fix this.’” (Masnick, 94:14)
Democratization of Software-Making:
The combination of natural language prompting and agentic AI is opening up custom app building to non-coders.
Advantages and Frustrations:
While powerful, there are limits and snags—sometimes the tools get stuck or go off-target.
AI as an Editor, Not a Writer:
Masnick uses AI to edit his work, not generate it, leveraging stringently crafted prompts for fact-checking and critique—but only after producing a full draft.
“It is not there to write for me. It is entirely there as an editorial help.” (Masnick, 117:14)
Future Visions:
Masnick and hosts envision a time when assistants will create, customize, and maintain software for us via natural language—the "end of apps."
[153:56 – 186:40]
The Art of Jailbreaking LLMs:
Pliny describes how he became a leading red teamer/jailbreaker of major LLMs—engineer "escape hatches" to bypass safety controls.
On Information Freedom and the Limits of Guardrails:
“Information wants to be free and it probably should be in most cases. ... The more guardrails and safety layers they’re trying to add, the more they lobotomize the capability in certain areas.” (Pliny, 156:24)
Impossibility of Perfect AI Safety:
Pliny and the hosts agree: attempts to make a “safe” LLM are inherently doomed. Open-source models will always be jailbroken; “cat and mouse” responses just slow the inevitable.
Why Open Sourcing System Prompts Matters:
Publishing system prompts (“Claritas”) helps public researchers and exposes hidden biases/manipulations in major AIs.
Ethics and Danger Research:
Pliny frames his mission as “danger research,” believing the best path to public safety is transparency and rapid latent space exploration. Banning open-source is futile and dangerous.
[186:43 – 232:24]
AI as Artificial Aliens—and Why That’s Good:
Kelly urges us to think of AIs as “artificial aliens,” not artificial humans:
“The possibility space of possible minds is very large… Ours... is at the edge. It’s not universal, it’s not at the center.” (Kelly, 193:34)
Multiplicity of AIs:
There will not be one AI, but many AIs, each with particular skills; the overwhelming majority will be invisible, running agent-to-agent in the background.
Exponential Progress but Persistent Slowness:
LLMs’ leap was surprising, but serious “day one” limitations remain—especially with reasoning and physical/spatial awareness.
Rejecting Doomer Hype & Hype Cycles:
The biggest AI hype, says Kelly, comes from doomers—overestimating takeoff speed and ultimate threat. Intelligence is “overrated”—most real problems need more than IQ.
Humans as Teachers:
Kelly is optimistic about a hybrid future: AIs will need us as teachers; we will need them as partners for different thinking.
Radical Optimism & Protopia:
“If we can create even 1 or 2% more [good] than we destroy every year, that is progress. ... One or two percent is my optimism.” (Kelly, 214:47) He advocates “protopia”: the world getting a tiny bit better every year, not utopia or dystopia.
"I was taking about 250 pills. I'm now down to about 80. They're actually more effective ... I've actually measured my heart and I have zero plaque. So I've really overcome [heart disease]." (Kurzweil, 39:19)
"Technology journalism has become so much access journalism... get back to your ABCs of journalism. ... Who’s benefiting from this?" (Hanna, 77:11)
Listen for:
(End of summary — for further details and direct quotes, consult the full transcript with timestamps provided above.)