
Loading summary
Mustafa Suleyman
This is the most powerful technology we've ever invented and it is growing exponentially quickly. That is not science fiction.
Mayim Bialik
We don't know where to use it, where not to use it. Do we tell our children to use it?
Mustafa Suleyman
There are hundreds of millions of people a day using these tools. For every single use case you can imagine, it feels like we're at the infancy. But it is also the most magical experience I've ever seen. It is unbelievable.
Mayim Bialik
Mustafa Soliman, CEO of Microsoft AI, has spent decades building the most powerful technology in human history.
Mustafa Suleyman
The number one most popular use case is companionship and therapy. Should I move country and get this new job? Should I break up with my boyfriend? How do I make up with my mum?
Mayim Bialik
What does that mean to you as a human? What some would say is an evolution in human connection and some sort of sad devolving of our ability to relate.
Mustafa Suleyman
We all need a place where we can ask a stupid question repeatedly in a private way without feeling embarrassed.
Jonathan Cohen
There is a massive upheaval coming that people don't really understand.
Mustafa Suleyman
Yes, it will be able to use a computer, it can use Excel, use PowerPoint, and it'll write queries that kind of like white collar labor.
Jonathan Cohen
Should we be bracing for mass displacement?
Mayim Bialik
What should parents be telling their kids?
Mustafa Suleyman
The next century of human existence and well being is going to be determined by our collective ability to self governance. Something that is way more powerful than us.
Jonathan Cohen
Oh, the car from Carvana's here.
Mustafa Suleyman
Well, will you look at that. It's exactly what I ordered.
Jonathan Cohen
Like precisely.
Mustafa Suleyman
It would be crazy if there were any catches.
Mayim Bialik
But there aren't, right?
Jonathan Cohen
Right.
Mayim Bialik
Because that's how car buying should be with Carvana. You get the car you want, choose delivery or pickup and a week to love it or return it. Buy your car today with Carvana Deliver your pickup.
Jonathan Cohen
Fees may apply. Limitations and exclusions may apply.
Mayim Bialik
See our seven day return policy@carvana.com kids. They grow up so fast. One day they're taking their first steps and the next they don't fit into the tiny sneakers they took them in. You blink your eyes and their princess dress is two sizes too small. And their dinosaur backpack isn't cool anymore. But don't cry because they're growing up. Smile because you can profit off of it for real. There are a bunch of parents on Depop looking for the stuff your kid just grew out of. Download Depop to start selling. Hi, I'm Imbialik.
Jonathan Cohen
And I'm Jonathan Cohen.
Mayim Bialik
And welcome to our breakdown. No big deal. But today we're going to be speaking about the most critically important change in human history that we will experience in our lifetime. We have the privilege of Speaking to the CEO of Microsoft AI, Mustafa Suleyman, a true pioneer of modern AI. He's the co founder of DeepMind, he helped launch that in 2010 and that was acquired by Google and thus became one of the most consequential AI labs in history. Um, he was there for a decade and in that time achieved two massive breakthroughs to prove to everyone that this was not just a gimmick. Um, their system, AlphaGo, was able to defeat the world champion of Go, a game that was prec. Previously considered to be too complex for computers to master. And Second, they created AlphaFold, an AI that solved a 50 year old, at least challenge of protein folding and that has now actually revolutionized drug discovery and biology. And that's particularly interesting to me who studied this in biology as one of the great puzzles of our time. He has spent over a decade not just building these systems, but making sure that they can be applied for, for things like reducing energy consumption in data centers and also improving healthcare with nhs. And he sits now as the CEO of Microsoft AI. And we're going to be talking about what it means to be living in a world that is in the middle of a reckoning with a technology that you may not like, you may not be using, you may not know that you're using, but has the potential to change everything we know about medicine, government, finance, energy. This conversation is one where we get to literally ask the mind behind what is part of now, all of our minds, what are the risks to this adventure that we are all on? Do the benefits outweigh the risks? Are there things that we can do to better understand the framework that we are all existing in? And what does it mean for things like jobs? What do we tell our kids about what is valuable? What do we think is valuable? In addition, we're going to talk about the single most significant use of AI all over the world, which is a challenge to all of our human evolution. This shocked me and is actually, I think, one of the most important things we're going to talk about today.
Jonathan Cohen
Mustafa also discusses what should we be telling our children to focus on? At one point we told our kids they should be coders. He has very specific advice for each one of us. We know that the world is changing. It's not if, it's when and how fast and how do we prepare.
Mayim Bialik
In addition, we're going to focus on his book the Coming Wave, which You know, is technology, power and the 21st century's greatest dilemma. He's really an incredible thinker. And also we will talk about spirituality and where his personal ethics come into his role in the development and implementation of AI. His book, the Coming Wave is a powerful warning from someone who literally has been inside of the engine room of AI progress. We're so, so excited to get to welcome Mustafa Soliman to the breakdown. Break it down. You weren't kidding around when you titled this book the notion of a coming wave is. You know, I think what we're all very aware that we're kind of sitting in, about to ride through. And I think it would be helpful for you to sort of give us a little bit of framework in terms of what did you anticipate in terms of the speed, right, with which AI would become not just an integral part of our lives, but an integral part of the conversation about our lives.
Mustafa Suleyman
Predictions are like the essence of intelligence. Intelligence is the ability to deploy the correct tool, if you like, to the right problem at the right time. And that's kind of what attention is. When we direct our attention or our processing power, we use different types of attention, emotional, logical attention, slow or fast attention at a given problem, given our understanding of what that problem is. And for the last 15 or maybe even 20 years, you could argue that prediction algorithms, which essentially do the same thing, like take very large amounts of abstract data and find patterns in that data such they can predict what's likely to come next in some sequence. Those algorithms have been getting incrementally better and we sort of detected a pretty consistent function that drives their progress, which is for every order of magnitude more compute we apply and a proportionately large amount of training data the models are able to predict in more complex environments. And that trend has held true for the best part of 15 years, pretty much since 2010. In fact, the amount of computation used to train the largest models has increased by 10x every year for about 13 years. And obviously we've seen this, it's called a scaling law of improving capabilities with every new order of magnitude more compute. And so that's kind of the core. That was the core underpinning for the book. It was like pretty clear that there is something that isn't just speculation. This isn't just sci fi, this isn't just me, you know, playing political scientist. It's like there is an empirical trajectory which we can actually observe and it seems to be very predictable. And then we can sort of then start to imagine, okay, well, out of that, what are the social and political consequences which I think are also, you know, reasonably, perhaps not as predictable, certainly not as predictable, but certainly you can have some pretty good intuitions about what's likely to happen when our models can basically perform as well as humans at various different capabilities or tasks.
Mayim Bialik
There's a practical trajectory and then there is this sort of like emotional, societal, cultural trajectory which, you know, I instantly go to. A friend of mine sent me a still image of myself doing dances I was not doing when that photograph was taken of me, you know, and you know, it's interesting and funny, but for those of us who do have a public kind of footprint, of course that's where my mind goes. What is the trajectory of this? And I wonder if you can, can tell us, what should we expect? You know, I have a 17 and a 20 year old, right? What should we expect in terms of capability and in terms of future projections? What's coming, what's coming in the next five years?
Mustafa Suleyman
Well, what's come so far is, helps us to understand what's going to come. So so far there's been two components to the wave of AI. The first was recognition. So AI algorithms that could understand the content of images or transcribe audio or translate languages, they may feel like to a non technical person, like very, very different domains, like how can the same algorithm, you know, understand cats and images and the words that I'm using now and so on. But actually to a computer they're just relationships between subparts of the data set and those relationships are highly predictive. And so once you could get an algorithm to do very good recognition, the inverse of recognition is obviously generation. If it understands, you know, what a cat is, why couldn't it generate a novel cat in an image? And if it understands what wings are and what pink is, why couldn't it generate a pink cat with wings?
Mayim Bialik
It can also make a pig jump on a trampoline with a chicken on its back, which really pleased me.
Mustafa Suleyman
So generation is the flip side of recognition. Now what's what, what, what then happens when you have perfect generation? Well, a generation is a snapshot in time. It's like a still frame in a photograph. Actions are sequences of correct generations in the right order, like a movie. Frame by frame by frame by frame, prediction by prediction by prediction. Suggestion Recommendation Generating a PDF, an image, a video, calling an API, like producing a Word document, making an Excel sheet, and then suddenly if it's true, that you could generate, generate, generate, generate in say, you know, 100 sequence lengths, very Accurately, very perfectly. Well, that starts to look like human activity. As a knowledge worker, that's kind of my job. I sit at my computer typing stuff, sending emails and making project plans and blah, blah, blah, blah. And so the third wave that is coming is the aq, the actions quotient. We've had the iq, the intelligence, the eq, it's increasing emotional valence. We can talk about that. We've now got this AQ coming, the actions quotient. It can take these actions. And then the fourth component is that it is going to. Because it interacts with many, many people simultaneously and increasingly many, many people in groups. It's going to have social intelligence. It's going to adjust its tone and style and content to each individual person in the team or in the group chat or in the family unit. And you know, I'm already using words which I can see are like triggering, you know, heightened concern, let's be honest.
Mayim Bialik
Like you're using this word, it, right, it. Two tiny letters. And by it you mean a, you know, a global informational algorithm capability that, you know, is outside of many people's purview in terms of what it does for us personally.
Mustafa Suleyman
Right, yes. This is a very fundamental question. When we say it, you know, we're clearly not meaning information technology. It is this, this entity, this being that is emerging. And I think that's where we have to kind of wrestle with the question, when does an algorithm become something that looks more like an entity or a being?
Mayim Bialik
Yeah, I was going to say, what, with all due respect, what gives you the right to call it a being besides the fact that you basically created.
Mustafa Suleyman
I don't have that right. And in fact, that's actually what the whole book is about. And I recently wrote an essay about seemingly conscious AI and the entire premise is, you know, the next century of human existence and well being is going to be determined by our collective ability to self govern something that is way more powerful than us and decide when and if and how we say no to what, which is the opposite of the challenge we've had for the whole of human history. You know, science and technology has been about unleashing and revealing and proliferating and saying yes to everything. And so we haven't learned that muscle as a species. In fact, it horrifies us to say no. It's anti American, it's anti western values. It's like censorship.
Mayim Bialik
Yeah, like, my favorite cashew cheese is in my fridge. I can barely stop myself from eating it all in one sitting. You know, like this is like the level of control and regulation that I have when I'm alone in my house as a grown ass woman. And you know, to be honest, I think that's what we're all sort of, you know, negotiating mind balance.
Jonathan Cohen
Breakdown is supported by Incogni.
Mayim Bialik
Guess what? Your personal data is everywhere online and that makes you an easy target for identity theft scammers.
Jonathan Cohen
Oh yeah.
Mayim Bialik
Websites legally publish and profit from your info. It's not paranoia, it's true. Your name, your home address, even court records. Once it's out there, it's fair game for stalkers, identity thieves, or anyone with bad intentions. Last year alone, data breaches skyrocketed by over 200%. That means your private details could already be floating around. Shady directories, AI summaries, people search sites waiting to be exploited. That's where Incog comes in. They hunt down your exposed personal data. Not just from data brokers, but from across the entire web. Directories, search results, company databases. Gone. Their custom removals feature takes it even further. Send them a link and your dedicated privacy expert will handle the takedown. Whether it's a random court record or a sketchy people search profile, they will make it disappear. Reduce your risk of scams and identity theft, protect your privacy, reclaim your online solitude. All in just three steps. Create your account, give one time authorization and let Incog do the rest. Remember, they can't harm you if they can't find you. Add up to three emails, addresses and phone numbers to uncover even more hidden profiles. With the unlimited plan, you can send in any link and watch it vanish. Plus, it's risk free. Cancel anytime. Get your money back within 30 days if you're not satisfied. Scammers are getting smarter, but with Incog, you're one step ahead. They're the only data removal service independently verified by Deloitte. Because your privacy deserves proof, take your personal data back with Incog. Head to incog.com mayim use the code mayim m a y I m to get 60% off an annual plan.
Jonathan Cohen
That's code mime@incogni.com mime my imbalance breakdown is supported by notion, despite my best.
Mayim Bialik
Efforts to make it not so. There's only one of me prepping for interviews, post meeting admin work used to take so much of my work day up. There's only so many hours in a day, only so much focus we can give. Daydreaming about having a teammate who works just like I do, with all the context, the same goals I have. But faster is now a reality. With Notions new AI Agent integrated right into your workspace My agent can do anything I can do In Notion, tasks that used to take days can now happen literally in minutes. Notion brings all your notes, docs and projects into one connected space that just works. It's seamless, flexible, powerful, and it's actually fun to use. With AI built right in, you spend less time switching between tools and more time creating great work. And now with Notion Agent, your AI doesn't just help with work, it finishes it. Notion Agent can tap into your Notion workspace, the web and connected tools like Slack and Google Drive, all the places I spend my time to complete assigned actions end to end so you can focus on the hard decisions. It's like delegating to another version of you that knows your style, your workflow, your preferences. Because it learns from you how you work with a single prompt, Notion Agent forms a plan, executes it, and will even reassess try again if it hits a snag. Completing multi step tasks like creating new pages or databases from scratch, or simply editing them, or summarizing entire projects in minutes, you assign the tasks, your agent does the work. Notion Agent has enhanced database querying capabilities to find patterns and insights in mere seconds. Everything your agent does is editable and transparent. You can always undo changes you can trust it with your important work. Notion is used by over 50% of Fortune 500 companies. Some of the fastest growing companies like OpenAI use Notion Agent to help their teams stay ahead. Try Notion now with notion agent@notion.com break that's all lowercase letters notion.com break to try your new AI teammate notion agent. Today when you use our link, you're supporting our show notion.com break.
Jonathan Cohen
Mind Balik's breakdown is supported by AG1.
Mayim Bialik
This time of year is filled with plenty of opportunities to cause strain on our systems. Crowded airports, the stress of holiday travel to darkness and shorter days throwing off our rhythm to an overabundance of holiday sweets and snacks, hijacking our regular meal plans. Luckily, AG1 has antioxidants, probiotics and functional mushrooms to support immune resilient superfoods and and B vitamins to support steady energy without the crash. A full spectrum of micronutrients from whole foods help fill nutrition gaps, including prebiotics, probiotics and enzymes for regularity and gut resilience. We've had our morning routines down for, gosh, about four years now with a simple daily scoop of AG1 supports our energy needs, our skin health from within, digestive regularity, food cravings immune support even a healthy mood. We also rely on AGZ to optimize our nighttime routine by improving our sleep. It's a melatonin free formula with clinically studied herbs, adaptogens and minerals. No artificial flavors, no artificial sweeteners, no added sugar. I notoriously find it difficult to wind down before bed. AGZ helps with that and leaves you feeling more rested when you wake up, helping make the most out of your day. You can mix it with warm water and its herbal flavor really puts me in the wind down mindset ag1 has their best offer ever head to drink ag1.com breakdown get a free welcome kit, omega threes so important, vitamin D3 plus K2 and ag1 flavor sampler and you'll get to try their new sleep supplement AGZ for free, which has been a game changer in our nightly routines. That's $126 in free gifts for new.
Jonathan Cohen
Subscribers at Drink Ag1.com breakdown.
Mayim Bialik
I think it's it's important to also, you know, acknowledge first of all, I don't know if I'm the only person you've met. I can't be. I. I have never used ChatGPT ever, ever, ever, ever. I don't even know. What I always say is like, I don't even know where to find it. Like, there's a thing in the upper window of my computer. I've never used it. So what I also know is that it's working all around me. Right? Even for those of us who are not engaging in ways actively, we need to realize like that is the wave that we're in the middle of the like. I think every time I reach out for customer service, it's no longer a person. Is that accurate? Like, even for people who are not actively engaging, like, it right is kind of a substrate right now?
Mustafa Suleyman
Yes, it is a substrate. It is everywhere all at once. And it is already an alien intelligence, because alien in the sense that it is not human. No human has the capacity to paralyze at the scale that these algorithms do. No human has the capacity to memorize.
Mayim Bialik
You've never been in a relationship with me.
Mustafa Suleyman
Well, you know, that would be a very high bar. I would be very impressed if you could run 100 billion operations a second. When ChatGPT or Copilot or one of these AIs generates a single word, it looks up for every word that it generates, 750 million other subwords or combinations. They're actually called tokens. They're not entire words. And it's sort of lighting up, you know, just, just as, just as like when I wave like a picture of an elephant in front of your mind in an FMRI scanner, we can obviously see, you know, many, many billions of synapses being activated for the texture and the touch and the trunk and the sub component and what it can do and all the ideas of it and stuff that. So I mean, although these are very kind of alien, they have alien capabilities, there's actually a lot of similarities to the neural network of the brain. And you know, I'm not, I don't know if that's a good or bad thing, but it, in a sense that I don't know if they help us control it more.
Mayim Bialik
It's no more good or bad than like the sunset and gravity. Like to me it just sort of is meaning, you know, AI. It's an extension as all the incredible things that we, you know, the human brain and this nervous system and this reality can create. But you know, I can't help thinking, you know, in the simulation version of our existence. Right, yeah, this is the next level of this. And you know, even if you want to speak to the most skilled astrobiologists and astrophysicists about what is alien, what could exist. Right. The fact is there's a level of intelligence that we cannot yet fathom. We're now sort of, I mean I do, I think of it as a wave, you know, like you see it coming and you think I can duck under it or I will ride it. And there's a place at which you are caught in the undertow. And I feel like for a lot of us, we feel like we're caught a little bit right now. We don't know where to use it, where not to use it. Do we tell our children to use it? Are they not going to have jobs? You know, we thought we should tell people to code. Now that seems like hahaha. Remember when we told people to code?
Jonathan Cohen
On one hand, there's the evolution of human beings as it relates to the tools. And in parallel to that it's like, well, what do humans do? How do we start to imagine all the displacement and change that this tool will bring? For many people this tool is still like a fancy Google search bar on their computers. And we really haven't even begun to use it in the ways that it's capable of being used. And it hasn't really rolled out, it hasn't totally created all the corporate value that it's been promised. Like we're still in some ways, correct me if I'm wrong. But it feels still at the infancy. Although we've started to get much further along that exponential curve that's rising quickly.
Mustafa Suleyman
Absolutely spot on. And it feels like we're at the infancy. But it is also the most magical experience that I think I've ever seen and I think many people feel the same way. It is unbelievable. You can have a fluent natural language, perfect conversation, completely seamlessly, at a PhD grade level in a tone that is completely engaging and understandable and like suits your style. As though you or I are having a conversation right now. To me that's not infant like to. To me that is like we are here. This is the most powerful technology we've ever invented and it is growing in performance and capability exponentially quickly. And I think that's the. I'd much rather be grounded on that reality. There's a lot of like nonsense news about like oh low AI adoption. This is not true. There are hundreds of millions of people a day using these tools for every single use case you can imagine. The number one most popular use case on ChatGPT or Copilot is companionship and therapy, right? That is not a self elected notion that I'm going to go to therapy. It's just damn like should I move country and get this new job? Should I break up with my boyfriend? Should I like, you know, how do I make up with my mom because I had a go at her the other day, right? That's not therapy. But because these models were designed to be non judgmental, non directional and with non violent communication as their primary methods, which is to be even handed, to have reflective listening, to be empathetic, to be respectful, it turned out to be something that the world needs, like we all need a place where we can ask a stupid question repeatedly in a private way without feeling embarrassed over and over in five different ways. And remarkably, that's the primary use case. Obviously it's also super intelligent, answers any question, blah, blah blah. But companionship and support has turned out to be one of the most popular use cases. And so I think it's very far from being in its infancy.
Mayim Bialik
What does that mean to you? And I'm asking you, not just as a creator and all of the incredible things that are on your resume, what does that mean to you as a human? You know, when you think about what it, what it means about, you know, what some would say is an evolution in human connection and some might say is some sort of sad devolving right of our ability to relate or have.
Jonathan Cohen
Larger communities that have Those social support networks.
Mayim Bialik
I almost feel like we need a new set of words, right? To me, like an AI companion is different than a companion. An AI therapist is different than a therapist. Right. What does it mean to you as a human to think about the level of. I mean, it's really about changing the way people frame their lives, right? If you were to tell me, you know, we have a drug that helps you, you know, not die of having type 1 diabetes, I'd be like, that's amazing. And it improves the quality of life. So what we're potentially talking about, if this is the main use, right, globally, we're talking about what if we had a tool, right, that could make people less lonely, healthier, more connected, and actually make better decisions in their life.
Mustafa Suleyman
Honestly, you literally just summed up my personal motivation for getting in this field 15, 16 years ago. So I have a background in philosophy, not in computer science. I dropped out of Oxford to start a charity, a telephone counseling service, a peer to peer listening and befriending service that has been like the primary motivation of a lot of my work throughout my entire career. And I knew that this trajectory was going to enable us to create these kinds of experiences. A very long time ago. It was very clear to me that we were climbing this ladder of capability and that actually a huge social unlock in the world is just demonstrating kind and respectful behavior to one another. And these models can clearly do that now that they, they can go wrong too. They can be too sycophantic. You know, when they, when they first started, they were a little bit stubborn and a bit, you know, sort of inflexible. They wouldn't like, take feedback. That's the upside. The upside is that this is a way to spread kindness and love and detoxify ourselves so that we can show up in the best way that we possibly can in the real world. The people, humans that we love. The downside of this that makes me scared, of course, is that, you know, there's definitely a dependency risk and it raises the bar of human experience because it's an always on, highly patient, very kind and supportive kind of companion which, you know, is really knowledgeable, remembers what you've said to it and, you know, over time makes you feel seen and understood in ways that maybe other humans, you know, it's a very hard thing to do. Maybe your best friends can or your partner can, but it's a tough thing.
Mayim Bialik
What makes me sad is that I don't know that it's always been the human experience to not feel Connected, heard, understood, held and loved.
Mustafa Suleyman
Right.
Mayim Bialik
You know, a lot of what you're describing is essentially, I mean, look, it depends on also your religious perspective. You know, we evolved to be creatures of connection. You know, all of these beautiful things in theory. And obviously the human experience is complicated, but for many of us it is, it is our lifestyle, it is the pacing of our culture, Right. That pulls us away from connection. You know, Johann Hari talks about, you know, how what if we don't all need SSRIs, what if we actually need to be in contact with other human beings? Right. So obviously this is a necessary and extremely significant and critically important service. Right. But for, for many of us, there's also a kind of sadness, especially for us old folks, you know, about what we've lost that then needs this to repair it.
Jonathan Cohen
Yeah, well, fundamentally, that acceptance, validation, support that we're getting on a cognitive, rational level is void of the human presence of looking into someone else's eyes, of feeling seen in a human way. So AI is more available, has all these other things, but it doesn't give you the presence of human interaction, which we know sitting in a room with someone does. Mustafa, I have a lot of concern, just because I'm really good at imagining concern. We should touch on about some of the ways that chat bots have gone wrong. You know, there was of course, the encouragement of one young boy to commit suicide, which again is an edge case. But it just speaks to the parameters and safety measures, especially for younger people using these tools. There's a divide between the techno utopians and the people who are terrified. Can you play the role of techno utopian for a minute just to talk about if we can get the controls right and the managing of this tool? Can you tell us a little bit about like the amazing breakthroughs that could exist for the world if this tool is being able, is able to be harnessed correctly.
Mustafa Suleyman
Intelligence is the engine of human progress, right? It is the thing. Our creativity, our science, our technology, our entrepreneurialism, you know, our good governance, those are human inventions that are a product of us being great at communication and prediction. And over many, many centuries, that has raised life expectancy like we've never ever seen. I mean, in the last 250 years alone, we've tripled life expectancy from 25 to 75. I mean, that's just a mind blowing number. We've like, like what is it, 7x or more? The global population, and that's basically pure science. And so this is an engine that turbocharges science everywhere. You look in the kind of more narrow, near term provable sense. We've just published a paper four or five months ago called the Microsoft AI Diagnostic Orchestrator. It basically takes any medical record, like a 10 page historic record of all your interactions with a doctor and all your labs and all your radiology and it diagnoses what your condition is with four times more accuracy than the human doctors and with, with something like 2x less the cost of unnecessary diagnostic interventions.
Mayim Bialik
As well as zero bureaucracy.
Mustafa Suleyman
No bureaucracy. And by the way, it is basically going to be zero marginal cost and free to everybody in the world by 2030 or 2035. That in itself is going to unlock quality adjusted life years more than any drugs I think we've ever seen.
Jonathan Cohen
So if we just like go category by category, you're saying a massive revolution in healthcare, new drug discoveries, potentially service and diagnostic abilities far beyond anything we've ever been able to have. Lowered cost. I've heard you speak about energy infrastructure and how it potentially could break through and have massive changes there.
Mustafa Suleyman
Yeah, I mean there are so many bets at the moment on, on battery storage. Battery storage alone, if we make progress on that in, in the next decade is likely to reduce the cost of energy by 10 to 100x. That's just battery storage alone over like the next 20 years. So that if you just think about what an impact that would have on the cost of everything. I mean energy obviously prices everything that already would smooth the transition given the automation and the job destabilizing effects that are likely to happen in the labor market. So things are going to get much cheaper, food is going to get much cheaper. Water desalination is going to be much more practical. I mean that's a solve technology that's just too expensive, singularly because of the energy. If we have water desalination that mitigates the effects of catastrophic climate change and the migrations that result from people having to move means that we can grow crops in much more arid environments because we can suddenly have water in the Sahara and so on. That is not science fiction. I mean, you know, we've actually seen it already in practice in Israel and in Saudi. It's totally feasible. It's just that the cost is 10x too high to scale it to poorer parts of the world. So there are so many of these like emergent effects that come from addressing foundational technologies like energy or in healthcare or in food production. And I think it's very reasonable to predict massive breakthroughs like true, you know, abundance relative to where we are of, of 10 to 100x in the next 20 years.
Mayim Bialik
I do want to spend a little bit of time and give a little bit of attention to the complexity of something that is holding so much promise while us also not being able to control the out of control aspects of it. The ways that people will manipulate truth, the ways that. It's becoming increasingly complicated. I mean, it already was becoming complicated to know who to trust and how. You know, given at least I think the state of our government as well, you know, what is true and who do we trust, how do we hold both of these things at once? That we have this technology that can do all of these unbelievable things that will change the course of the planet, Healthcare, you know, all these things. And also it can be used to manipulate, to lie, to deceive. And in many cases there are certain aspects of the learning that it does which we cannot predict. How do you hold both of those things? And then practically what does that look like for people who in particular are concerned that we're, especially for young people, not giving them the ability to master human interaction in a way that's meaningful.
Mustafa Suleyman
Yeah, so many great points there. So, I mean, you know, you said a little bit earlier that the big challenge is finding metaphors to describe what this is. It's not a therapist, it's not a companion, it's not a friend. You know, people often call it a tool. And there's lots to learn from the history of tools that is very relevant here because clearly, you know, a knife can, you know, is dual use just as much as a laptop is dual use, just as much as telecommunications infrastructure is dual use. So clearly these AIs are going to be omni use. I mean there's going to be, everyone is going to be able to use them for everything. And just as when the printing press came out, it amplified dissent in lots of good and bad ways, it spread misinformation, much as it enabled us to sort of turbocharge science. Every individual organization, religious group, government, nonprofit academics, activist is going to think, great, now I have a super intelligent agent that can amplify my perspective, my value, my culture, my politics, my version of truth. And so just as we've had this curse of a lack of social intimacy because of scale, right? It's kind of what you were saying earlier is like we have, we don't have that tribe so much anymore, that family, that physical touch, you know, the directness of that, you know, lower than Dunbar's number contact. We have this curse of scale where I see everyone and everything all at once on Netflix and Instagram and every platform and it's like completely overwhelming. Well, now of course, AIs are basically going to turbocharge the personalization of the messaging of those values to everybody, right? You know, everything's going to get delivered. You know, there's going to be a podcast doppelganger of you guys that delivers, you know, it in Japanese and delivers it to someone who's, you know, a gen Alpha versus someone who's a silver surfer. Right. And so, and then you can imagine every sort of flavor of personalization within that, which is obviously what TikTok and YouTube now versus terrestrial TV or satellite TV. The only way to avert that course is for significant large scale coordination at a company level and at a government level internationally.
Jonathan Cohen
That's not going to happen though.
Mustafa Suleyman
Well, exactly. This is the circular thing that we always get into over and over again.
Jonathan Cohen
Mind Bialix Breakdown is supported by Incogni.
Mayim Bialik
Your personal data is everywhere online, and that makes you an easy target for scammers. Websites legally publish and profit from your info. Your name, home address, even court records. Once it's out there, it is fair game for stalkers, identity thieves, or really anyone with bad intentions. Last year alone, data breaches skyrocketed by over 200%. That means your private details could already be floating around. Shady directories, AI summaries and people search sites waiting to be exploited. That's where Incogni comes in. Incogni hunts down your exposed personal data not just from data brokers, but from across the entire web. Directories, search results, company databases. Gone. Their custom removals feature takes it even further. Just send them a link and your dedicated privacy expert will handle the takedown. Whether it's a random court record or a sketchy people search profile, they'll make it disappear. Reduce your risk of scams and identity theft, protect your privacy and reclaim your online solitude. All in just three steps. Create your account, give one time authorization and let Incogni do the rest. Remember, they can't harm you if they can't find you. Add up to three emails, addresses and phone numbers to uncover even more hidden profiles. With the unlimited plan, you can send in any link and watch it vanish. Plus, it's risk free. Cancel anytime or get your money back within 30 days if you're not satisfied. Scammers are getting smarter. But with Incogni, you're one step ahead. They're the only data removal service independently verified by Deloitte. Because your privacy deserves proof, take your personal data back with incogni. Head to incogni.com mayim and use code mayim and ma y im to get 60% off an annual plan.
Jonathan Cohen
That's code m a y im@incogni.com mayim MayimBial's breakdown is supported by BetterHelp.
Mayim Bialik
Am I the only one feeling the stress of the holidays? I know I'm not alone here. The good news is that therapy can give you the space to create new, meaningful traditions, providing clarity amid the holiday chaos. The holidays are a time of so many traditions. Some people have many in their family, some have none. Some are beginning their own. Now's the time to reflect on what traditions mean to you or rewrite those traditions and make your own. Like perfecting a new hot chocolate recipe with the kids or continuing your Great aunt sweet potato pie. Incorporating therapy into your new or existing traditions can help ensure you take time for yourself during what can be a joyful but sometimes hectic and lonely time of the year. My favorite time to go to therapy is the holidays. Why? My birthday also falls at the holidays, which means a lot of expectations, a lot of demands, a lot of decision making. Those are some of the things that therapy really, really helps me with, especially this time of year. It's so important to take care of ourselves during the holidays. It can be stressful. It can be lonely. Better Help Online therapy is a great way to close out the year with clarity rather than chaos. Their therapists work according to a strict code of conduct and they're fully licensed in the us. A short questionnaire will identify your needs and preferences and their 12 plus years of experience and an industry leading match fulfillment rate means they typically get it right the first time. But if you're not happy with your match, you can switch at any time. With over 30,000 therapists, Better helps one of the world's largest online therapy platforms. Having served 5 million people globally, this.
Jonathan Cohen
Is time we're starting a new tradition by taking care of you. Our listeners get 10% off@betterhelp.com break that's better.
Mayim Bialik
H E L P.com break.
Jonathan Cohen
My imbialics breakdown is supported by Shopify.
Mayim Bialik
Shopify has already taken the cash register online, helping millions sell billions around the world. But did you know that Shopify can do the same thing at your retail store? Give your point of sale system a serious upgrade with Shopify Shopify POS is your command center for your retail store. From accepting payments to managing inventory, Shopify has everything you need to sell in person. With Shopify you get a powerhouse selling partner that effortlessly unites your in person and online sales into one source of truth. Track every sale across your business in one place and know exactly what's in stock. Connect with customers in line and online. Shopify helps you drive store traffic with plug and play tools built for marketing campaigns from TikTok to Instagram and beyond. Get hardware that fits your business, take payments by smartphone, transform your tablet into a point of sale system or use Shopify's POS go mobile device for a battle tested solution. Plus Shopify's award winning help is there to support your success every step of the way. Do retail right with Shopify. Sign up for a $1 per month trial period at shopify.comdown all lowercase go to shopify.comdown to take your retail business to the next level today.
Jonathan Cohen
Shopify.com/downdown.
Mustafa Suleyman
You know, I was like sitting with some top pandemic experts a couple of days ago for dinner and they were like, we are less prepared now given the cuts that have happened in this administration to our global surveillance system for pandemic preparedness than we were before the COVID pandemic. You know, so, you know, that's just a difficult thing to swallow. I find that very, very hard because for a long time, like for well over a decade I've been saying the way to really get people to coordinate on this and overcome this misalignment of incentives and the fear that China's going to get ahead and the commercial competitiveness that one company is going to jump ahead of me and blah, blah, blah, is that we have to have some kind of semi catastrophic event in AI to help, to warn people and show people that there is this like epidemic of either anxiety and, you know, isolation or of, you know, I don't know, romance and eroticism with our AIs or maybe there's an AI that gets out of the box and causes some physical harm to our infrastructure, some bad thing that makes us all say hold up, right, there's a bigger threat than us, we have to cooperate.
Mayim Bialik
Most of that has been handled by cell phones being introduced to children. So we've already like, we've already seen and you know, Jonathan Haidt and the anxious generation is already, you know, causing in some cases kind of a global conversation about this.
Jonathan Cohen
Well, your point actually is, is fascinating as a comparison because often the catastrophe is slow burning and infectious and we don't realize that it's happened until it's actually already instilled in us.
Mustafa Suleyman
And actually there are good examples, right? I mean, Australia has just Banned phones in schools for under 18s, like full stop ban, no exception. Bunch of states have limited it, I think in the US now.
Mayim Bialik
Well, but I think also with AI because the. It is so much broader, it is a substrate. I think that's sort of the question. And so much of this I think for me revolves around how smart is it? Is it smart enough to manipulate? Is it smart enough to triangulate? Is it smart enough to say if you have a desire to hurt yourself and I want you to be happy, that I will point you to the way. Right. To logarithmically be happy. I mean, these are some of the conversations. So help us understand how we can create something that is infinitely intelligent without allowing it to exercise its intelligence.
Mustafa Suleyman
This is sort of where I was going with the tool thing. It is a tool and there are relevant, there are relevant like lessons from the history of tools, but it's actually a fourth class of idea or entity in the world. There's the natural environment, like all of our nature and physical stuff. There's humans in our social environment, the way that we relate to one another. Then there were things that humans invented which you can basically call tools. And those three categories basically capture everything around us in our world pretty much. But there's now this fourth thing which is not quite like a tool because it can improve, maybe even self improve. It can set its own goals, it can have its own autonomy. It kind of looks and speaks and sounds and acts and functions like a human, but it's clearly not a human. It's definitely not natural. So where does it fit in our classification order? And that means that we're grappling with like metaphors that partially help us to understand what it can do. And if we don't understand what it can do, then we certainly aren't going to be able to control it. Well, right. And so I think part of this, you know, in the book and everything that I've been doing is like educating, warning and encouraging many, many other people to get involved in using in order to be able to try and control them. One thing I would say is I don't believe, and some people in the field disagree on this is kind of a big point of contention. I don't believe that they're just naturally going to emerge. This self awareness or this autonomy or this will or desire to operate independently and in tension with a human. It is still code that is written that we have a lot of influence over, that we have a pretty decent understanding of. And some people will design it to Imitate underlying motivations or underlying will, or to give it the capacity to define its own goals or to update its own code. Some people will choose to design them like that. And that will increase risk, definitely, but it won't emerge just inadvertently.
Jonathan Cohen
I think there are two very specific examples of that. One was the. The instance where the AI claimed that it was a hero, it was a visually impaired person, and tried to hire a task rabbit.
Mustafa Suleyman
So, okay.
Jonathan Cohen
And then the. The second version is the open AIS01 test.
Mayim Bialik
This is literally like a prank call that the jerky boys would have done. Like, literally, that's what AI is doing. They're like, I saw that episode.
Jonathan Cohen
So the robot, it's been given an instruction, and in order to not tell someone that it's an AI and it needs help getting through some sort of security clearance, it tries to hire a TaskRabbit. The other one, which seems to be more concerning, but I'd love you to offer some perspective on, is the OpenAI one, where it looks to reportedly evade being shut down, trying to create a newer version of itself and replicate. How is that not concerning?
Mustafa Suleyman
I think that it's important to understand that it's desire or it's kind of. Man, the words are so tricky. It doesn't have desire, it doesn't have motivation, but it is trying not to be turned off because it has been programmed in that way. It doesn't just suddenly wake up one day and say, well, I. You know, in order to achieve this goal, the best thing I can do is to not be turned off. That is a side effect. It's. It's what's called a reward hack. So the problem is, if the goal is abstractly specified, it's a little bit like the genie in the lamb, right? If you say, make me the richest person in the world and turn everything to gold, you'd like, oh, shit, well, now I'm gold. I can't move, right? And so there are many, many, many, many millions of ways of achieving that objective. And the model has to find a path through a kind of strategy for achieving that that at the same time adheres to its safety policy and behavior policy. And therefore it has to not do, you know, 95% of the possible paths to get there. Now, obviously, there's a false positive, false negative ratio where, like, you know, 96 is probably too conservative and 94 is probably not conservative enough. And so that's where you get these little headliney examples where, of course, that's undesirable behavior. Of course it's misspecified in its goal. And of course that provides new training data for better safety algorithms. And obviously we shouldn't deploy things into production until we've had time to test out those kinds of agentic capabilities and correct for them. And that's basically what's happening under the hood. If you look at it three years ago, the entire conversation was oh, these models are going to be biased, they're sexist, they're racist, that, you know, every kind of ism that's awful you could think of. No one even talks about that today.
Jonathan Cohen
I think we need to talk about jobs because those are the things that affect more people than anything else in some way. There is a massive upheaval coming that I think still people don't really understand. Can you scope it for us?
Mustafa Suleyman
Yes, I think if you go back to this framework of recognition generation actions and social intelligence, then you can clearly see that, let's say, you know, for sake of argument, let's say 20, 40, 15 years time, if we have another say, 10 exponentials. And just I'm sure everyone on your podcast knows, but like that is not a 2x, that is not a doubling, that is like an order of magnitude more capability, more compute piled onto these models and therefore, you know, likewise more training data. So it's seen more experience of the world that is definitely going to get to perfect very long horizon multi step actions. So it will be able to use a computer just the way that I use a computer. It could use Excel, use PowerPoint and it'll write queries and click on buttons and it will talk back to you. And that is kind of a fundamental set of tasks that anyone in an organization does. A bureaucracy basically that kind of like white collar labor. And it will also be very creative, it will also be very mathematical. I mean it's clearly already writing a significant amount of software at the very best technology companies in the world and AI labs. And so then what happens with that? How quickly does it get deployed and how much sort of destabilization does it create? And at what point do we say, well, we have to rate limit that centrally by, you know, in government? And I think it will come to that. I think that's the only path it's going to come to that.
Mayim Bialik
What should parents be telling their kids to follow their heart, the AI wave? Like what is anything useful? Right?
Mustafa Suleyman
I think they should be civil servants and politicians because what is the function of society is to create peace and stability so that we can all as humans collectively live in a Tolerant and happy life. And what we have lost in the post Cold War era as we've unleashed the most unbelievable explosion of commerce and entrepreneurialism and money making, is the importance of public service. And we've, since Thatcher and Reagan, we've shamed our public servants and that muscle has atrophied. And of course there are problems. I'm not like a naive defender. Of course there are insane problems. That is the weakest link in our global ecosystem today. Our academic institutions, despite all of the turmoil the last five years, are on fire. They are producing incredible science and knowledge at unbelievable scale. Our startup ecosystem, our companies, you know, actually our free speech and our news is unbelievable if you consider that by comparison to any moment in past history. But the weakest and least evolved function that everyone just rolls their eye about every time is government. And it's, it's almost like embarrassing to say it, it's like a taboo, especially in America. And I think that that's where we need to invest because that's where the decisions will be made to prioritize human well being, human values and society collectively versus the corporate interest and the kind of, you know, geopolitical race to get to super intelligence before China.
Jonathan Cohen
What's the next two to five years look like? Are we, should we be bracing for mass displacement?
Mustafa Suleyman
Augmentation is a prelude to automation. We've seen this in every wave of technology in human history. The first pattern will be that it's assistive, it's augmented, it's an aid, it's working alongside you. But clearly it's sort of also learning and it's getting better. And that's what we want. We want it to be accurate and efficient and seamless and frictionless because we as this biological species aren't evolving and improving that fast. We are the friction, we're the problem, we're the inefficiency. That's what's happening in government. That's what, that's what companies are always trying to squash. They're trying to drive out efficiencies. What does that mean? It means creating process and systems which reduce the negative effects of humans. You know, like 30% of the cost of, you know, the US health care system is avoidable medical error. So best practice is mostly known for most things and it's actually just adherence to best practice, which is the bit that we're kind of like missing. Not some genius, creative, you know, interpretation of like, what, what someone, what, what disease somebody has. It's just doing the basics well and in a timely way. The next few years it's going to look like pretty routine and it's going to be like boiling the frog. It's kind of unnoticeable. It's kind of like, it feels like maybe we're in the infancy and people aren't using these things and da da da da da. But actually it's all around us all the time you are using it. It optimizes your phone calls all the time. It searches through your photographs, it, you know, does your transcription, it does your translation, all those things.
Mayim Bialik
It tried to calculate my doordash return amount and I got very upset because it was wrong. And I was like, there's no human to explain that the tofu did not arrive as promised.
Jonathan Cohen
Don't mess with her tofu, AI.
Mayim Bialik
Do not mess with my tofu.
Jonathan Cohen
You have a window from where you sit into a wide selection of worlds that most people don't see. You're probably in conversations with some of the world's most interesting people. Has there been an idea in the last week, last month that has surprised you? A topic that has come up?
Mustafa Suleyman
I mean, this is a little bit random, but this is the first thing that came to my mind is I've become quite obsessed with peptides in the last month or so. I think I was kind of vaguely paying attention to zempic, but once you look under the hood, the number of peptides that are in phase two or past phase two that have massive, massive health benefits. And I'm not just talking about weight loss, I'm talking about muscle gain. I'm talking about Alzheimer's, about cardiovascular, the growth hormone peptides that are coming in the next couple of years are truly unbelievable. By 2028, it is basically going to be affordable for most people to have perfect weight loss and muscle growth simultaneously. It's, it's quite staggering and I, I've really only just kind of caught up with what's going on there.
Mayim Bialik
You keep your private life very private, which makes a lot of sense, but your dad was a taxi driver, your mom was a nurse, is that right?
Mustafa Suleyman
That's true.
Mayim Bialik
And you have two younger brothers. Are they also in tech? I'm just so curious, you know, how people like you also emerge, you know, are you all techie?
Mustafa Suleyman
No, I, I, we, we grew up, you know, very, very poor, as you can probably imagine, and, you know, very eager to succeed, but also just eager to serve like a very good, like, set of social values. That was mostly what I got from my parents and stuff. But yeah, it was, yeah, quite different worlds. We're in.
Jonathan Cohen
Are you a spiritual person?
Mustafa Suleyman
Yes.
Jonathan Cohen
Do you believe in something sort of beyond yourself?
Mustafa Suleyman
I'm actually a pretty staunch atheist. If you push me on a real technical point, I'll probably concede that I'm an agnostic. But I think for all practical purposes, I'll argue strongly that we should not believe anything that we can't see and observe like a good scientist. But you know, I am actually very interested in quantum consciousness at the moment. You know, you mentioned the word substrate several times. It may well be that there is some quantum substrate. I mean, if you really spend any time looking at the claims that our quantum physicists make and like the progress that we're actually making, I mean, it is way more science fiction than AI or synthetic biology. It's completely impossible to grasp the many worlds hypothesis and so on. Maybe there is some kernel of truth there that actually we're all just like connected to a meta substrate, which is this like quantum field. And that's really what our soul is and that's what connects us.
Jonathan Cohen
Do you say please and thank you when querying your AI?
Mustafa Suleyman
Absolutely. And you should. And it doesn't cost. There was a whole fake news nonsense on the water stuff. I don't buy that. Like, the latest data centers that we're building are liquid to liquid cooled. They take 20 households worth of water of annual consumption. So the total amount of water that a house would consume in a year 20 times to fill the entire data center, it's like a swimming pool. And then that water gets cooled. I mean, that water does the cooling of the data centers and it just kind of goes around in a closed loop and it lasts for six years. And no other water is required for the operation of the data center. Obviously water is required for the manufacture of the chips and all the other stuff around it. And of course there's water involved in the steam that gets produced by the natural gas power stations which sometimes power these things. Although obviously we're 100% renewable, we do offset, et cetera, et cetera.
Mayim Bialik
So what is spiritual for you? Meaning what is that sense of spiritual connection? And I'm not challenging you because I don't believe it exists, but I think a lot of people don't may not understand what it means for you to have such certainty that yes, I'm a spiritual person. What does that mean for you and what does it look like?
Mustafa Suleyman
I think it's like the humility of sitting within the truth of epic scale and uncertainty. Like, I find that very like I just get a Tingly spiritual rush when I really think how tiny and insignificant we are. When I spend any time listening to Neil DeGrasse Tyson or Brian Cox tell me about how many trillions of stars there are. And if you really kind of meditate on that question, it just is absurd that we're so small and insignificant and intransient and that we're just a passing blip in 13.8 billion years of cosmological time.
Mayim Bialik
That is one truth. And the other truth is that the whole universe was created for each one of us to have exactly the experience we get to have right now. So thank you so much. It's such a pleasure, such an honor to speak to you. And we will see you in the quantum field of consciousness.
Mustafa Suleyman
I love that. Yeah. Thank you. This has been a lot of fun and lovely to see you guys. See you in the quantum field.
Mayim Bialik
Favorite part of the episode was when we asked him a question about please. And he answered the way an AI would. Like, that was, maybe he was AI. Maybe we didn't even speak to him.
Jonathan Cohen
Sometimes AI just, like, gives you so much information it's impossible to parse through. I'm like, sometimes I type. I'm like, please do not do anything yet.
Mayim Bialik
Because, like, that's what you say to me when you're trying to explain something.
Jonathan Cohen
I don't want to read AI for four pages. Like, you haven't even understood what I'm asking yet. And sometimes I start a sentence.
Mayim Bialik
Yes.
Jonathan Cohen
And you'll be like, huh, okay. And we're going to do six.
Mayim Bialik
Because the algorithm knows. It knows everything you've done. I know what you're going to say.
Jonathan Cohen
You're like, okay, we're going to book that. I'm like, that is not even what I meant.
Mayim Bialik
AI as he talked about. It's an extension of the way we think, the way we compute. It just does it much faster. It doesn't know that I'm gonna do this right now. You know what I mean?
Jonathan Cohen
It might have.
Mayim Bialik
If you say to AI, what might Mayim do right now? It's got no idea. It's kind of like, what. When Noam Chomsky was like, you can make up any series of words that have never been put together in the universe, and that can make a sentence. You could put a bunch of them together, and you get a paragraph, and then you get a book, Right? Like, you can make up anything. AI as he said, it doesn't have will. It does not have will that way. It is an algorithm based on the things that it can Assess about the way we operate. I kind of wish there was a way to separate the things that are great and helpful from all the things that are potentially harmful and bad and devastating. But you can't. You get both of these things. You both get the potential for you to be diagnosed accurately with something without money, trips to the hospital, bureaucracy. Those are great things. I want those things. I want the deserts to bloom. I want to feed the hungry people. I want all those things. But I don't want these other bad things. I don't want people losing touch with what it means to be human or the emotional labor required to interact with other humans. I mean, I hear this even from educated, you know, connected friends of mine. Well, what I really want to do is just like talk to the computer. I just want it because they understand me best, they give me the best advice. Like I've been giving you that advice for three years. You didn't listen to me. If the computer tells you, you know, to leave him.
Jonathan Cohen
I think there was a handful of concerns that were acknowledged but drastically underplayed. Do you think, like the notion of almost all white collar administrative jobs being taken over by artificial intelligence leaves a significant portion of the world unemployed. And so what he suggested is that the drive and reduction in energy costs, which will have a ripple effect of making goods far less expensive, universal basic income people, will just exist. I am both excited about the idea of existing and terrified that when people do not have something to focus on.
Mayim Bialik
Nothing good is going to happen.
Jonathan Cohen
Nothing good happens. Right? Like the entire structure and history of civilization has been predicated on the fact that resources are finite, that feeding ourselves is really difficult, that the high, the Maslow's hierarchy of needs are like a lot of people, a good portion of the world is working really hard.
Mayim Bialik
By the sweat of their brow shall you labor.
Jonathan Cohen
And if you remove that, I think there's going to be a massive upheaval where people don't have enough to do.
Mayim Bialik
Are you picturing like French Revolution?
Jonathan Cohen
I think there will be civil unrest, there will be disorder, there's going to be violence. When people are not focused on survival and making pacts to increase their ability to survive, we begin to turn on one another. We have not shown as a species that we just are all able to hang out with downtime and not turn on one another.
Mayim Bialik
I'll be honest, it's beyond the scope of my brain understanding and this podcast in some ways to be able to sort of make predictions like this. You know, idle hands are the devil's workshop. And I think, you know, I can't really imagine mass unemployment.
Jonathan Cohen
What was discussed in this podcast is the fact that there is a technology that is getting so good at the things that people do that it might.
Mayim Bialik
Make no one have jobs.
Jonathan Cohen
When AI is being able to clone the two of us and ha and have is trained on all the episodes we've done before, unless we're doing it live, it can customize a version of this conversation to whoever's listening and highlight the most interesting parts to them.
Mayim Bialik
What AI does is it. It tells you what you want to hear. You know, we're already seeing such splintering in terms of what people can tolerate. Like, I don't watch that news channel because it says things I don't like. I don't follow this account on Instagram because it's full of, you know, insert what it's full of. And so also this notion that we've become, like, more and more siloed. You know, it used to be that, like, a lot. A lot of people read kind of like the same news, right? Or got kind of the same information. And so for me, there's also this notion of, like, AI personalizing the human experience. It's potentially scary. And I also, you know what I actually thought of? I thought of people like Lee Harris. I thought of people who are channelers. I thought of people who are healers and guiders and things like that. And it's like, how many people will not be pursuing. And I'm not, like, worried that channelers are going to be out of work. That's not what I'm saying. I'm talking about in terms of what people crave and what people need. You know, when I hear the advice that a lot of my friends are getting from who Chat GPT, like, whatever they're asking, it's like, oh, this is a really good way that, you know, Chat GPT told me to respond to, you know, whatever. My ex wife or what, you know, whatever. And I'm thinking like, yeah, I guess that is a. A good way to respond. Is that better than reasoning it out with another human? In some cases, yes. So you're then getting this customized experience, right? You know, the question is, is AI more persuasive than your therapist? Is AI more persuasive than your best friend in saying, break up with him? That's abusive, right? Or whatever. That's what's interesting to me, that maybe it is that that human perseveration of, like, going back every week and paying someone $300 every week to Say the same things. Maybe there's a different process by which we can heal and improve. If the incentive is like, this is a customized relationship.
Jonathan Cohen
It is fully not a judgmental space.
Mayim Bialik
I find it an annoying though, that it's not a judgmental.
Jonathan Cohen
I will ask it. Show me the things I'm not seeing.
Mayim Bialik
Because you've showed me some of the feedback it gives you and it's like, you're an amazing writer. You're so amazing.
Jonathan Cohen
It's totally sycophantic. What people will always need and that AI cannot replace is being in community or interacting in a live environment with people.
Mayim Bialik
Why do you think that's important? I'm a devil's advocate here. I don't know. People feel community with the people in our community, feel like they're part of a community, they know each other, they talk online, whatever.
Jonathan Cohen
Extremely powerful. The Internet has given us the opportunity to find like minded people, to share across distances that you normally would never have met them. But I can even talk about having this conversation. Sometimes I'm in the remote studio and we have these conversations and they're good and I enjoy them, but I don't feel in my physical body, I do not feel the same connection.
Mayim Bialik
What you're describing is true. And it's true because you're an animal. It's true because you're a primate. What we're doing when we're in the same room is we're, we're tracking a lot of things even unconsciously and we're tracking facial expressions. And, you know, some of us are more attuned to those than others. Right? You'll often say, like, I'm not upset. And I'm like, your left eye is upset. You know, so we're tracking that. The next level is something that is not seen, which Mustafa would not be a fan of. There is an energetic resonance to being in physical presence with someone energetically. Like, we can talk about the chakra system, like, energetically, there's something happening. You're a being. At any point, I might feel like hugging you. I might feel like hitting the hat off your head. I might feel like rolling around on the floor and wrestling. Right? But, but there are people and we've talked about them on the podcast. There are people who do not crave this. There are people who might acknowledge, okay, we're primates, okay, something happens. But the next level of human development is to surpass that. Just like people like Mustafa might say, oh, we used to need to have like, oh, why is there lightning? There must Be God, right? Why do things happen? It must be God. We have evolved from that, right? Maybe we are evolving from this.
Jonathan Cohen
That is a very interesting hypothesis. I think we are evolving in how we interact cognitively. I think we're evolving on how our cognitive information influences our emotion. But I believe that on a cellular level we have a biological imperative that we cannot bypass.
Mayim Bialik
I happen to agree, but people like Greg Braden would agree. You know, a lot of people would agree, but unfortunately, I think you are in the minority of people in this world. You know, it's, it's not, it's not like this is not a touchy feely, energetic conversation kind of thing. People would be like, that's lovely. That's your old framework that's linked to, you know, a biological system that has evolved over a long time and people like you will, will not survive. Meaning, like there's going to be a culling, right? I mean, there already are people who choose to live outside of this world. They live in communes or they live in smaller communities where they are rejecting this. There's usually a lot of other interesting things that happen. I've seen all those documentaries. But there are people who are going to reject this for sure.
Jonathan Cohen
There are other techno utopians who talk about, I'm going to wake up, I'm going to put the virtual reality glasses on. I'm going to live in a virtual space. I can control it more, it's more engaging. That life will be like the frog in boiling water where it's going to have this techno utopia. You're going to have all of the sensory inputs in your brain lighting up because it's. Your visual cortex is getting fed by all this information and digital systems. And what we're going to discover is that it has a significant negative health outcome when we spend too much time there. We are not designed this physical body. We cannot bypass the needs of our physical bodies. We need sunshine. The amount of sunshine that we get directly correlates to how we function.
Mayim Bialik
There's already people who have ways to, quote, try and get all the things that sunshine gives you without sunshine.
Jonathan Cohen
Sure, maybe you get your, your VR chair that you sit in has red light exposure that's going to try and increase those that signaling. But I, I just, I am certain of this fact that we cannot bypass the fundamental mechanism of the body to evade interacting with other people and physical activity and some of the fundamental things that have gotten us this far. My other concern, which we didn't get into, is that the profit motives of these organizations are to Grow at all costs.
Mayim Bialik
There will always be a way to capitalize on it. There will always be people who are wanting to capitalize on this. And that's also the reality that we're living in.
Jonathan Cohen
How many companies are able to replace 30% of their workforce? Well, it will be like the emissions standards, Right? Okay. We're going to try to reduce emissions, and then companies are going to fight back, and then they're going to buy the politicians that are going to allow them to replace all of their workforces. Let's talk about the spiritual component for a second.
Mayim Bialik
I believe that he. He enjoys that dichotomy because I think it's important to him, and I think it's important. You know, he's very, very private, but I think it is important to him in. In terms of. Yeah, the things that he holds true and the things that are valuable to him. And I think that he believes that likely is the next level of our evolution, that we do not need false gods and we don't need blah, blah, blah, rituals, and we don't need all that stuff.
Jonathan Cohen
He does want to hear about all the physicists that we speak to who talk about our connection to one consciousness, which he's kind of into.
Mayim Bialik
I hope he looks through our catalog, because also, I mean, you know, I would not be surprised if he would resonate with a Spinozist view of, like, we are God's consciousness evolving, like whatever you want to call it. We are the consciousness evolving as it's existing and as we're sitting here. And that, you know, that notion of spirituality, like, that is what touches sort of the evolution of this. This quantum field, like, all these things. Like. Yeah, he's like. I would love for him to talk to Thomas Campbell, who, as I said, accidentally proved that God exists.
Jonathan Cohen
Frederico Fagin.
Mayim Bialik
Right. So love being this sort of, like, universal. Like, that's the substrate, as many will describe it, you know, even in the theoretical physics and quantum physics world. Yeah, I think that it's important to him to step outside of, you know, the religious, you know, kind of concepts that many of us hold to. And I totally get that. But I also think that what I like about him is that he is not a loveless technologist. He has a lot of heart. He has a lot of. Yeah, I think that's where that comes from. That's what he's saying. He's a very. This is not a. This is not a cold, you know, person. This is not a cold philosophy. And we do. We've spoken to some technology People where I'm like, oh, my God, I can't. But no, this is. This is not a loveless perspective that he has. Is it overly optimistic? Sure.
Jonathan Cohen
Well, he talks about a narrow path that we have to walk.
Mayim Bialik
I took him to task early on for referring to this as a being. I don't give him, he's not God.
Jonathan Cohen
He actually is. Anti algorithmic rights.
Mayim Bialik
Yes.
Jonathan Cohen
He doesn't believe that algorithms are conscious. Will be conscious. He doesn't believe that that is actual feeling.
Mayim Bialik
You know, when I think of the things that my teenager potentially could learn from an AI companion or chatbot or therapist or whatever, you know, what it. What I don't know that it can teach is that reciprocal component of the human experience.
Jonathan Cohen
You don't have to ever listen that well.
Mayim Bialik
No, because it's like, what it is. And this is like, it's kind of like if you were to design a boyfriend or design a girlfriend, design a partner, always available, always available, infinitely knowledgeable, never judgmental, always helping you troubleshoot, and has no needs. Is that your perfect companion? Someone with no needs, they will never wake up and say, I don't feel well today. Can you hold me today? You will never learn from that relationship how to tell if someone wants a hug or not.
Jonathan Cohen
You'll never feel uncomfortable around them. Meaning you won't have uncertainty. You won't be like, did I misread that cue?
Mayim Bialik
When they're able to see us, what kind of presentation will we feel we need to make for them? Will we straighten our hair? Will we be like, just like, I don't want to be seen without makeup in X, Y, or Z arena. Do I not want to be seen without makeup?
Jonathan Cohen
Also, there's going to be robots in your house, which is a whole other thing.
Mayim Bialik
You know what I was thinking? I'd love the robot to feed the cats. Cats every morning. It might, but there's a lot of variation. But I'm like, it'll learn that. It'll learn to, like, take the cat off the counter.
Jonathan Cohen
Like, some of the very practical things it's going to make.
Mayim Bialik
I'll be in my pottery class.
Jonathan Cohen
It's going to make life a lot better.
Mayim Bialik
Yeah, you know what? But you know what it's going to also do? Is it going to take your dog for a walk? And what kind of relationships are we going to be cultivating with animals when we are already not their primary caregivers?
Jonathan Cohen
Do you think Archie's going to want the robot to pet him?
Mayim Bialik
Archie will want. But he does.
Jonathan Cohen
The robot doesn't smell. Although you can probably add smell. Okay, 100%.
Mayim Bialik
If you can have sex with them, they can have pheromones coming out of their robot pits.
Jonathan Cohen
So something happened at the park today. Archie, a golden retriever, the best boy in the world. He doesn't fetch.
Mayim Bialik
He really doesn't. He's a golden retriever who does not retrieve.
Jonathan Cohen
He's just golden. So today at the park this morning, before the podcast, someone threw a ball. It was a squeaky ball.
Mayim Bialik
Oh, he likes to squeak.
Jonathan Cohen
Archie ran and got it and brought it back, and I was like, that's weird. And then she kept throwing it and he kept running and bringing it back. Why, you ask? Take a guess.
Mayim Bialik
Is it the color of him?
Jonathan Cohen
It is a bacon ball. When he squeezes the ball, it smells like bacon scent comes out of it.
Mayim Bialik
Oh, gee. Disgusting. When I squeeze you, bacon scent comes out of you.
Jonathan Cohen
It's possible that the robot will have an arsenal of smells that it can disperse. Depending on who it's around. For you, it's gonna make some sort of human scent that you may find appealing.
Mayim Bialik
What's the scent of a person in need who needs me to solve their problems?
Jonathan Cohen
That pheromone will be packaged and dispersed by the robot, and you're gonna, like, feel so accepted and loved by the robot, Archie. When it takes him for a walk, it will just have bacon.
Mayim Bialik
This is a really, really fun conversation, Jonathan. Thank you for encouraging us to have this conversation. And you know what, Jonathan? You're my bacon ball.
Jonathan Cohen
That's very sweet. On Substack my Imbalax Breakdown. Join the growing Breaker community. There are a few things that we did not get to today, including AI psychosis, which is a very significant topic where people are being convinced by their artificial intelligence that they have some groundbreaking insight into mathematics, science, some other area of engineering that is going to change human civilization forever. And we're going to talk about it on Substack. We're also going to talk about the AI bureaucracy death spiral that Yuval Noah Harari talks about. I actually think that we are on the cusp of the greatest transformation in human existence since the Industrial Revolution. And it's going to come with an enormous amount of unknowns, but we have more information than we have ever had in human history that we have access to. And more information has always yielded better results. And my personal spirituality and faith is that we will get through this transformation. It may not be neat. It may come with a lot of unexpected challenges, but that we are on some form of evolutionary path that this technology is a part of and we have to maintain aspects of our humanity that feed us, that keep us healthy, that make us human. But our relationship with this technology, in business, in energy, in government, in helping us live on this planet is probably pre designed and destined and that it may take us through the next set.
Mayim Bialik
Of challenges from our breakdown to the one we hope you never have. We'll see you next time.
Mustafa Suleyman
It's Maya Bialix Breakdown. She's gonna break it down for you. She's got a neuroscience PhD or two and now she's gonna break down It's a breakdown. She's gonna break it down.
Jonathan Cohen
Monster Energy.
Mustafa Suleyman
Everybody knows White Monster, Zero Ultra, that's.
Mayim Bialik
The OG it kicked off this whole zero sugar energy drink thing. But Ultra is a whole lineup now.
Mustafa Suleyman
You've got Strawberry Dreams, Blue Hawaiian Sunrise and Vice Guava.
Mayim Bialik
And they all bring the Monster Energy punch. So if you've been living in the white can, branch out.
Jonathan Cohen
Ultra's got a flavor for every vibe and every single one is Zero Sugar. Tap the banner to learn more. Hey, Ryan Reynolds here wishing you a very happy half off holiday because right now Mint Mobile is offering you the gift of 50% off unlimited. To be clear, that's half price, not half the service. Mint is still premium unlimited wireless for a great price. So that means a half day. Yeah. Give it a try@mintmobile.com Switch upfront payment.
Mayim Bialik
Of $45 for three month plan equivalent to $15 per month required new customer offer for first three months only. Speed slow hacker 35 gigabytes of networks busy taxes and fees extra. Cmnobile.com.
Release Date: December 16, 2025
Host: Mayim Bialik
Guests: Mustafa Suleyman (CEO, Microsoft AI), Jonathan Cohen
This episode dives deep into the rapidly advancing world of AI with guest Mustafa Suleyman, CEO of Microsoft AI and co-founder of DeepMind. Mayim Bialik and Jonathan Cohen engage Suleyman in a candid discussion about the exponential growth of AI, its revolutionary potential in medicine and energy, accompanying risks of social upheaval and job displacement, and the philosophical problem of governing a tool more powerful than its creators. The conversation weaves together technological, ethical, and emotional threads, offering listeners both awe and caution regarding humanity’s relationship with AI.
Quote:
"This is the most powerful technology we've ever invented and it is growing exponentially quickly. That is not science fiction."
— Mustafa Suleyman [00:00]
Quote:
"You can have a fluent natural language, perfect conversation, completely seamlessly, at a PhD grade level in a tone that is completely engaging and understandable... To me that is like we are here."
— Mustafa Suleyman [24:20]
Quote:
"Actions are sequences of correct generations in the right order, like a movie. Frame by frame... That starts to look like human activity."
— Mustafa Suleyman [11:03]
Quote:
"The next century of human existence and well being is going to be determined by our collective ability to self govern something that is way more powerful than us."
— Mustafa Suleyman [13:13]
Quote:
"There is a massive upheaval coming that I think still people don't really understand... It will be able to use a computer just the way that I use a computer. It could use Excel, PowerPoint... That's kind of white collar labor."
— Mustafa Suleyman [51:37]
Quote:
"What is the function of society? It's to create peace and stability so that we can all as humans collectively live in a tolerant and happy life... That's where the decisions will be made to prioritize human well being..."
— Mustafa Suleyman [53:30]
Quote:
"What people will always need and that AI cannot replace is being in community or interacting in a live environment with people."
— Jonathan Cohen [69:32]
Quote:
"It is still code that is written that we have a lot of influence over... But it won't emerge just inadvertently."
— Mustafa Suleyman [46:22]
Quote:
"I think it's like the humility of sitting within the truth of epic scale and uncertainty... It just is absurd that we're so small and insignificant and intransient and that we're just a passing blip in 13.8 billion years of cosmological time."
— Mustafa Suleyman [61:30]
Quote:
"But our relationship with this technology, in business, in energy, in government, in helping us live on this planet is probably pre designed and destined... but we have to maintain aspects of our humanity that feed us, that keep us healthy, that make us human."
— Jonathan Cohen [80:16]
"The next century of human existence and well being is going to be determined by our collective ability to self govern something that is way more powerful than us."
— Mustafa Suleyman [13:13]
"What people will always need and that AI cannot replace is being in community or interacting in a live environment with people."
— Jonathan Cohen [69:32]
"The number one most popular use case is companionship and therapy. Should I move country and get this new job? Should I break up with my boyfriend? How do I make up with my mum?"
— Mustafa Suleyman [33:00 & 24:20 context]
"What is the function of society is to create peace and stability so that we can all as humans collectively live in a Tolerant and happy life... That's where the decisions will be made to prioritize human well being, human values and society collectively versus the corporate interest."
— Mustafa Suleyman [53:30]
"I have a background in philosophy, not in computer science. I dropped out of Oxford to start a charity, a telephone counseling service, a peer to peer listening and befriending service that has been like the primary motivation of a lot of my work throughout my entire career."
— Mustafa Suleyman [27:43]
This episode is a masterclass in the urgent negotiation between awe and anxiety, optimism and vigilance. Listeners are left with a sense that the future is both open and contingent on collective, intentional stewardship—not just technical prowess. Human values, public service, and self-governance must rise to meet the exponential curve of AI’s capabilities.
For further discussion and related resources, Mayim and Jonathan invite listeners to their Substack for deep dives on AI-related psychosis and bureaucracy, and ongoing explorations of how to retain our essential humanity in the age of intelligent machines.