Loading summary
Jonathan Cohen
Hi, everyone, and welcome to Mayimbialics Breakdown. I'm Jonathan Cohen and I'm here today to share a very special conversation that I had on my personal Substack page, practical Spirituality. I'm sharing it today because it is such an important topic, and for me personally, it is a fascinating look into the world of. Of artificial intelligence, how it's shaping our world and where we are all going next that we may not even realize we're going. We're talking today to Babak Hojat. If you don't know his name, you absolutely know his work. He's the primary inventor of the natural language technology that became Apple's Siri. He holds 39 US patents, and he's the chief AI officer of the the company Cognizant. He has a PhD in machine learning, and he started thinking about an economy of agents, what we now call Agentic AI back in 1998. Why is this important? Well, we unpack it in the conversation. Right now, our world is being set up for AI agents to take on tasks, communicate with one another, and very quickly to act on our behalf. What does that look like? Well, it could mean that they book
Mayim Bialik
a flight for you.
Jonathan Cohen
They may have access to your credit card to do tasks for you, to do personal shopping, to order your groceries, to schedule doctor's appointments, to run your household. We also talk about what does it look like in the near term midterm, in terms of the job markets? What type of disruption should we be expecting? Are we concerned about the concentration of wealth amongst only a handful of large companies that control these AI systems? And ultimately, what our AI does is a reflection of our own humanity. AI is programmed with the views, beliefs and priorities of the people who program it. So should we be worried about AI taking over?
Babak Hojat
Should we?
Jonathan Cohen
The real question might not be about the AI itself. It's actually about us. If you like this conversation, check out the Practical Spirituality Substack page or Mayim Bialik's breakdown on Substack, where we explore the intersection of science and spirituality. And there's a growing Breaker community that convenes there. Please enjoy this conversation with Babak Hojat.
Alex Breakdown
Break it down.
Babak Hojat
Queen Carvania stood haloed by the morning sun. An army hung on her every word.
Alex Breakdown
My champions, I have sold my chariot on Carvana. Twas a lovely suv, an inexplicably queenly offer. They're even coming to the castle to collect it.
Mayim Bialik
Tonight we feast.
Alex Breakdown
An offer you can feast, feast on.
Mayim Bialik
Sell your car today on Carvana. Pickup fees may Apply maybe Alex Breakdown
Jonathan Cohen
is supported by Helix Sleep.
Alex Breakdown
We were so excited to hear that Helix wanted to partner with us. I've had my Helix mattress for I think it's close to six years now, and it helps me sleep really, really great. Jonathan and my kids also have Helix mattresses. Everybody loves them. And all of those issues, night sweats, back pain, motion transfer, all of those things are completely gone. Helix Sleep makes premium mattresses and bedding that are customized to fit your personal needs and they're conveniently shipped to your door. I was so happy with their shipping process. I even ordered my son a new mattress when he needed one. It shipped right to his apartment. It's amazing. Helix combines innovative tech with high quality materials to deliver comfort and support. They offer soft, medium and firm mattresses. There are different options. Are you a side sleeper, a stomach sleeper, a back sleeper? Helix Sleep mattresses have a supportive hybrid design. You can choose to elevate your mattress with premium cooling options. The Helix line, plus unique mattresses to choose from, any variety of mattress toppers. Helix has a sleep solution for just about everyone. Go to helixsleep.com breakdown for 20% off site wide, 25% off Luxe mattresses and 30% off Elite mattresses. That's helixsleep.com breakdown for twenty percent off site wide, 25% off luxe mattresses and 30% off elite mattresses.
Mayim Bialik
Helixsleep.com breakdown for someone who doesn't know a little bit about your background, I do not have a full bio for you, but I do know that you were a foundational person in the invention of the technology that became Siri. Can you give people a quick snapshot to just orient them to your background?
Babak Hojat
I was the main inventor of the natural language technology in Siri. I started a company in 98 called Dejima and we built natural language interfaces using an agentic system. Not too many people know that the original Siri was actually multi agentic, while those agents were very different than the agents that we have today. You know, obviously we didn't have a large language model as the brain of those agents. A lot of the mechanisms do carry over. Those are things that we actually have implemented now in our multi agentic platform, which we've open sourced. And a lot of it borrows from some of the work I did in 97 and 98, believe it or not,
which was actually within AI circles was
the heyday of agentic systems. There's a book published that became the textbook on AI. I taught it actually in Japan called Artificial Intelligence. A modern approach. And modern, which was in the 90s meant agentic approach.
So for some of us, agents have
been around and that concept actually I think dates all the way back to Turing.
Anyway, back to me. I have a PhD in AI.
I've done several AI startups, I've worked in larger companies. I've always been in AI, always done AI straddle research and development and strategy and all that kind of fun stuff.
Mayim Bialik
Some people are already asking what is agentic? Which we're going to cover, we're going to get to. But before we talk a little bit technical, which is where the future of this technology is going. What was it like from your perspective in the late 90s? A lot of people were not using email at that time. Right. So like what was the landscape that you were like, oh, we can do something where people are going to be speaking to the computer. Like what was going on for you? That, that it was either obvious for you or you were like this, this is the next wave that I want to pursue. Like what was happening.
Babak Hojat
Yes, it was very, very ambitious of
us actually at the time. Natural language is famously the first non numerical application of computers. Like people try to get computers to understand our language from the get go and they failed and they failed miserably.
A lot of folks followed approaches that
were grammatical and let's come up with the grammar of natural language and try to kind of parse natural language and understand what it means. And that, that failed. It was too rigid and it was
too complex at the time.
In 97 I got into it through a misunderstanding really. I was looking for real world applications of multi agent systems and my professor at the time in, in Kyushu University in Japan said why don't you form a agentic soccer team? And you know, RoboCup had just started so you know, enter that. And I was into soccer and I
was starting to think about that when
a friend of mine misunderstood what I meant by agents and thought agents are, you know, human representatives that understand us and can do things on our behalf,
which now that is a real definition.
Back then it wasn't. And it was audacious to think that agents would be able to understand us. And so I kind of made fun of him a little bit and I said, I think you misunderstood what I meant. And he said, well, if you think agentic systems are that powerful, why can't they just understand me? And that was a, that was a challenge that I took to heart and I worked on it and I realized that you can actually understand natural language.
Over multi agent systems and they representing the domain of discourse. You know, you have agents representing various
different functionalities in your system. You can actually build that system and it works really, really well, to my surprise. So we, we started that off and, and led to Siri and at the
time, like the holy grail was programming
your, your vcr, your video cassette recorder, which is where you play videos and,
and you know, those sorts of things. Setting up a meeting, it's still a holy grail.
Like, you know, it's set, setting up a meeting and coordinating meetings between multiple people and working out how your zoom or team is still complex and like
translating that into like a single command
that says, you know, I want to meet Jonathan next week sometime and go figure it out.
Mayim Bialik
There's a lot of steps involved in
Babak Hojat
that that are many steps involved, very complicated.
Mayim Bialik
Like I have to check if you're available. We have to go back and forth. We have to match the calendars because it can't see your calendar.
Babak Hojat
Like we actually had a system like that working.
We were part of the DARPA project. Kalo Siri kind of came out of that. And I think year two of Kalo,
we set up a system where you would pick up the phone, talk to
an AI based system and say, set up a meeting with Adam and Joe and Mary and whoever and then hang up.
And if it had access to your, if it had access to your calendar, if it had access to your friend's
calendar, it would look it up. If not, it would send them an email and if not, it would actually call them. So your phone landline back then would ring and you would pick it up and it was this, you know, assistant asking you, you know, whether you can make it to a meeting and what time you can make it.
So it would actually coordinate all that, all that was happening without you knowing.
You just said set up this meeting.
And then it would show up on your calendar and on the day you would go into the conference room, didn't
have to do anything, the conference phone would actually ring. You answered it and everybody was there
and we demoed it and everybody was like, oh my God, this is it, this is, this is the future. But of course, we don't have that. Even today. Even today.
Mayim Bialik
What year was that?
Babak Hojat
This was 2000,
I want to say three or four.
Mayim Bialik
Okay, let's talk about the speed of progress and the development of technology and how you could have something like that. And yet it's not rolled out. So a lot of this technology comes out of DARPA and DARPA grants. As you mentioned, Siri came out. When Siri was developed, were there aspects that got watered down in order to commercialize?
Babak Hojat
Big time. Big time. You talk to the founders of Siri, my friend Adam, my brother cmac, those guys, Nick Treadgold, still at Apple, they will tell you that the original Siri app that was not part of Apple was more powerful, had many more properties and aspects that were watered down and it had a roadmap that was amazing. And then when it got into Apple
they kind of went for quality over
breadth and then there were issues with oh yeah, we want to exclusively own this and we don't want to own that and all that kind of stuff that water did down significantly and then other things happen and Siri today is not the best assistant out there. But yeah, when, when you have the idea and you know you're left to your own account, you you come up
with things that are, I think much
more powerful and interesting. And then reality hits and maybe Alex
Jonathan Cohen
Breakdown is supported by AG1 it's summertime
Alex Breakdown
and that means sun, vacations and changes to your usual routine. We're so excited to take a break from our regular hustle and bustle, but sometimes that means we take a break from good habits too. Except for the 30 seconds it takes to mix AG1 one scoop plus 8 ounces of water every morning. AG1 AG1 is a healthy drink with multivitamin, pre and probiotics, superfoods and antioxidants. 1 Scoop 8 ounces of water ag 1 helps to maintain energy, support gut health, and support immune health. It's clinically shown to support gut health and fill in common nutrient gaps. Summer may be your license to chill, but with all the late nights, long weekends and spontaneous plans, AG1 helps you keep one thing consistent high quality nutritional support every single day, no matter where you start your morning. The next gen formula delivers 75 plus ingredients clinically shown to support gut health, fill common nutrient gaps and improve key nutrient levels within three months. AG1's comprehensive nutrition provides nutrients that support our bodies, our brains and our gut health all in one scoop. We are so thrilled to use it every morning and glad that it's gonna support our immune defense as continue planning our travel summer vacations. Visit drink ag1.com breakdown to get a free ag1 travel case with seven free ag1 travel packs in your welcome kit with your first ag1 subscription order while supplies last. That's drink ag1.com breakdown.
Jonathan Cohen
My MB Alex breakdown is supported by Incogni.
Alex Breakdown
Over the past year, data Breaches increased by more than 200%. Your name, past addresses, phone numbers, even court records can be collected and sold by data brokers. The easier you are to find, the more vulnerable you are to scams, identity theft and harassment. Privacy isn't about paranoia, it's about peace of mind. And that's why we partner with Incogni. Incogni works on your behalf to remove your personal data from data brokers and online databases. And their custom removals feature goes even further. If you find a specific page or listing that concerns you, you can send them the link and a dedicated privacy specialist will handle the takedown process directly. It's simple. Create your account, provide one time authorization and let Incogni do the work. Incogni is the only data removal service independently verified by Deloitte and offers a 30 day money back guarantee. If you're satisfied, you can cancel at any time.
Mayim Bialik
They can't harm you if they can't find you.
Jonathan Cohen
Use code mime@incogni.com mime and get 60%
Mayim Bialik
off an annual plan. That's incog.com mayim so just for anyone who hasn't built technology, the roadmap is where it can possibly go, starting with the core basic features and then all the lists of, hey, we could do this, add this Lego block and expand its capability. So when it got watered down like that, is it because there, when you say they were trying to prioritize control or you know, repeatability, was it that it just became less reliable as more things were added? Was it about bandwidth at the time where Internet didn't have as much capability? Was it about battery life of the phone, like what's which of those constraints made it have to sort of pair off some of the capability.
Babak Hojat
Siri was supposed to be sort of
a growing ecosystem of features.
The original Dejima system also was, was
supposed to be extensible.
So you had these agents, these semi
autonomous AI systems that have a responsibility, they look at their state and they
make decisions within a certain scope that's, that's an agent. Basically you had these systems, the coordination mechanism between the agents.
So the way they spontaneously decide who
needs to do what and how they
respond to a command from a user
allowed them to be extensible. In other words, you could add more agents in without having to re engineer everything else. So the domain of what you could do could potentially keep expanding. And so the idea was just like
the Internet, as you add more apps and you add more pages, there's more value you're creating and adding to the system. It was supposed to be this Internet of agents that comes together and kind of expands.
When it ended up being owned by
Apple, that started watering down means that
it became a very engineered and centrally
controlled set of features. And the breadth was very, very controlled.
And so it took away a lot
of what we had in mind as far as this, its organic growth.
Mayim Bialik
When I listen to that, what I hear is that you were actually envisioning where AI is going now back before 2000.
Babak Hojat
Yes, but I can't credit, I can't take credit for all of this. I mean, the fact is that the Internet was brand new in the 90s. There was no very good search engine at the time.
So Google wasn't around yet. And there was altavista and some search engines that weren't that good.
And there was still this tug of war between, you know, let's organize the web.
You know, Yahoo's whole thing was like, let's organize everything for you. We organize the web for you versus searching it.
And there was this third alternative that
the AI folks were looking at was,
okay, what if we have agents, like on behalf of you, they go browse
the web and they're specialized in finding certain things or certain apps or whatever, and they go off and do that for you and come back.
It felt like a natural progression. Also, we had failed in creating AI. There was a point of folks in AI who had grand visions of creating
a generally intelligent system that operated in our human world and was as smart as we are, came to the recognition
that with the processing capacity and technology of the time, they just can't do that. The world is way too complex. And so what they decided was, let's simplify the world within which our artificially intelligent systems operate and let's call that an agent. And so these two kind of came together. The web, which at the time was
very simple, you know, text and hypertext
and some images with the connections and everything, that's a simplified world. And then you have agents now that
are operating in that world, which is much, much simpler and tractable than our human world.
So those two things kind of naturally came together and there was a big
push in creating agentic and multi agentic systems, having them coordinate and having them do things on our behalf and be semi autonomous.
I mean, I played a small part in that.
But at the time it felt a very natural extension within the world of AI. By the way, the world of AI was very, very small. Not that many people were in that world back then. I started most of my Presentations with a slide, just basically saying, you know, what is AI? I don't have to do that anymore.
Mayim Bialik
Well, let's talk about where it has gone and the moment that we're in right now in artificial intelligence. There's obviously the birth of the large language model has made it so that almost everyone is interacting with AI, either all the time or it's running parts of their phone, their maps. Like, you can't almost not interact with some version of it. The most common version is the one that we're all typing into. We had a conversation with Mustafa Suleiman and he says and confirmed that from his perspective, the largest use of artificial intelligence right now with a direct consumer framework is for advice on mental health and your life. Could you have imagined that back in 2000 that people would be interacting directly
Babak Hojat
in that way in 2000? Well, imagining was easy.
And in fact, I think in some paper that I published, I had this whole schema of you, like asking for Entertainment from your TV and your TVs agent, then talking to the broadcaster and that, going out and finding like that,
that sort of like economy of agents
where agents represent different entities.
That was all the way back.
I think it's actually even 98 or 99. In that original paper. We, we kind of talked about it.
Imagining it was easy.
Actually making it work was very, very hard.
And so in a contained, limited way,
we kind of achieved that with things like Siri Dejima and Siri.
It was only in the past few years where we've come to this major
Mayim Bialik
breakthrough, the large language model.
Babak Hojat
Yeah, so large language models kind of happened and we were all actually in
the world of AI, it was a very common benchmark. So people were actually trying out. Large language or language modeling was a benchmark basically predicting the next word in the sequence of words.
It has some properties that makes it
a very interesting benchmark, including the fact that you don't have to go off and label data and do all of that. So people were working on that, but
folks in the neural network world came up with a fascinating architecture, basically the
way to create this neural network and connect the neurons in this neural network.
It started doing very, very well on language modeling to the point where it was so contextually correct in predicting the next word and the sequence of words that people thought, oh, maybe it's actually learning much more than just like predicting a word. Like, it's forced, in order to be able to predict the word, the next word in a sequence of words, it's forced to understand the world. That's a big leap. You don't kind of think, okay, you know what? I'm going to set up a machine learning system that tries to predict what's
the next word in a sequence of words.
And I know that if I do that it will learn the world and
learn to talk about the world the way us humans do, and it will learn language and learn how multiple languages and how to translate between them, and it can do poetry, and it can be empathetic, and it can actually solve
math problems and it can do reasoning.
No way. No one, no one expected that. If anybody says otherwise, they're lying.
But it happened. It happened. And it turned out that there are very simple scaling laws. So you take that system that's doing so well on language modeling, and it seems like it's learning more than just like a statistical prediction. And you grow it, you just throw more neurons at it, you just make it larger. That's it. It's a very simple scaling, and you make it larger and you throw more
data at it and it gets better.
And so that's where we are right now. People pouring in money on data centers and all that. A lot of it is because, you know, the bigger these systems are, the better they are. When we got to that point initially people thought, oh, it feels like we've solved the AI problem. So we actually have a system that has all these intelligent properties. I mean, they kind of glazed over some fundamental weaknesses of these systems.
We can get to those later.
But generally they seem to abstract the
world the way we abstract the world. And they understood language and are able to produce language. That's already a lot.
Initially we thought, okay, so we'll just
have one large language model and one
of these like, AI systems, and we
can have it do whatever we want.
Turns out it's not, it's not as simple as that. And it turns out that even though you have this generally intelligent model as the brain of your system, you still want to tell it, here's the domain
within which you operate, here are the tools that you have.
You have expertise in this particular area,
be an expert only in this.
It just makes sense to modularize these systems. Also, again, kind of counterintuitive, you have this generally intelligent brain, which is your
large language model, but you kind of restrict it. You put it in a box and
you restrict it and you say, this
is where I want you to focus.
It just makes more sense when you think about it. In the world of humans, we do the same. We're all kind of more or less Generally intelligent, but we're all experts in
various different fields and we come to.
Mayim Bialik
You can only focus on so much and you can only be successful at so much.
Babak Hojat
Exactly right. In a roundabout way, we came back to this concept of agents and multi agency just by virtue of the fact that we can take this generally intelligent brain, give it some job description, some responsibilities, some tools.
You know, you can search the Internet, you can operate this app, you can,
you know, do this, that and call it an agent. And the moment you do that, the moment you create an agent that's kind of restricted in its scope and you create a second agent that's restricted in some adjacent scope, you want to have
them talk to each other.
So in some weird way we came back to multi agency, but this time the agents are super powerful.
Mayim Bialik
They were like fledgling little babies when you started.
Babak Hojat
Exactly right.
Mayim Bialik
Idiot.
Babak Hojat
Savage. So you don't have to worry about natural language. That's just out of the box. It's there reasoning for the most part is there being able to make decisions in situations that it's never encountered before.
They're pretty good at that.
We've come back to that concept of multi agency and building agents, engineering systems of agentic systems. And you know, what it's done is interesting because it's gone beyond just like let's take apps and software and make them agent oriented. We're starting to augment things that humans do.
Like we are augmenting organizations with agents as well.
So that's kind of the new frontier because these things are so capable.
Mayim Bialik
I want to talk about the augmentation and real world interaction, but you said something in this last description of the progress where you talked and you said they're empathetic. And are they empathetic or they've just been programmed to play empathy?
Babak Hojat
They've not been programmed.
These AI systems learn from scratch.
They learn from nothing.
Mayim Bialik
I want to ask about that because I don't know, I don't really understand it. But when we spoke to Mustafa, he said that they were designed to have the fundamental aspects of nonviolent communication. So they were taught how to sort of be reflective in that way, which sort of mimics empathy versus they can't feel per se. So what is empathy as it relates to a machine?
Babak Hojat
So there are two parts to this, right? What Mustafa is talking about is the
after the fact fine tuning of these models.
So when the model is trained, remember the model is trained just to predict
the next word in the sequence of words.
But we need it to react in a certain Way, for example, we need it to react if we're building ChatGPT, for example. In that case, we want it to act as if it has a Persona and it's some sort of like back and forth.
Mayim Bialik
So it's the front code, the front face of it.
Babak Hojat
Yeah, Right.
So even that is something that we fine tune. What does fine tuning mean? So you have this massively, generally intelligent model that can predict the next word in a sequence of words. It can be anything. So you prompt it and it'll continue. And if, if what you prompt it with, in other words, the first few words that you give it are about, I don't know, some, not like evil, whatever. You start off with the beginning of Mein Kampf and say, you know, you know, continue on in that realm and it will continue.
Right.
So there's no stopping it because all it knows is I want to come up with words that pass muster. If a human sees it, it's actually in line with what they would continue.
Right.
But we don't want that in the real world. There are certain things we don't want it to do. If it's out there for everyone to use. We don't want it to teach you how to do child abus or, you know, how to make a bomb or. So what we have to do this is after that initial training is done, we have to bias it. And that bias is through examples. We tell it, you know, hey, for this input, this response good, this response not so good, you know, so that's at a, at a very, very simplistic level. The way we do some post training,
fine tuning is what it's called.
So we bias it to prefer certain predictions over other predictions. And so that biasing regime, which is completely in our hands, like what examples we use and how we bias it, is what Mustafa is referring to where he says, okay, so, you know, we're really biasing it to be in this
way versus that way.
Empathy might come through that bias, but it might also be intrinsic to these models.
Mayim Bialik
This is the interesting point. From your perspective, is it intrinsic if
Babak Hojat
you're able to bias it to do something today with the approaches that we take, that means inherently it was already there. We just pushed it to answer in a certain way and not in another way. We can't. Typically with today's fine tuning, we can't teach it new stuff. We just take the universe of everything it knows and we bias it towards
certain parts of that.
Famously, we lose some of their capabilities
too with this fine tuning.
So it gets a Little dumber, but it is more biased. So it does things more in line. We call it alignment.
So it's more aligned to what as humans we would prefer.
But that means that intrinsically there was something like the capability of being empathetic was there. We just biased it to be more empathetic more of the time. And so that's one thing from perspective of whether it was there or not. And where did it come from? At the end of the day, it's trained on the corpus of everything that humanity has produced. So if it's empathetic, that's because there's a lot of empathy in what humans have produced. If it's evil, that's because there is evil out there. Let's face it, there are bad things
out in the Internet.
We try to kind of sift through
the training material and not have a
lot of that there, but there is
some of it, right?
So it's a reflection of what we've put out there in the Internet, but abstracted out. So of course it's not memorizing the entire Internet, it's trying to abstract that and have an abstracted view. That's why. And how it can actually produce output, even for input that it's never seen before.
So that's the learning part of it.
And how do we know it's empathetic? The only way we have to gauge these systems is through benchmarks and tests. So if we have a test for empathy for humans, we can run it against these systems and see how they score. Is that a perfect way of knowing whether or not it's empathetic?
I don't know.
Does it have feeling? Does it have emotions? Really? You'd have to define those things in non ambiguous terms.
For me first.
For me to be able to put together a benchmark, to be able to test that.
Otherwise I don't know.
And the reason a lot of these answers ends up in I don't know is because no one engineered these systems. We didn't go in and write a whole bunch of rules of how they should behave. What is a neural network? It's just this may huge table of numbers. When I say huge, it's like trillions of cells, right? Just numbers. So if I, if I show you an Excel sheet with trillions of numbers, you also say, I don't know. If I tell you this Excel sheet is what produces this output that seems to be empathetic and I ask you how does it do it? You're just going to stare back at
me and go I don't. It's just a bunch of numbers, right?
So that's the reason it's an inherently black box system. And so we don't understand exactly why
it works, why it has these properties.
Mayim Bialik
Do you use please when interacting with your agents?
Babak Hojat
I do. Part of it is just, you know, you anthropomorphize these systems very easily and it's somehow like your whole reward system triggers when it does something and you really, really love it and you just can't stop yourself.
Right?
So part of it is that. And you're wasting a bunch of tokens
and all that over it.
Part of it though is that there are techniques to get these systems to work. Well, there's this whole science of prompting now and there are people that are better at prompting these systems, basically typing
in some stuff to.
To get it to answer or behave
in a certain way.
And there are people that aren't that good at it. It turns out that certain keywords help. This is actually an experiment I'm running right now. If you tell the system it should try these various different things and then there will be an exam, it does better than if you say, you know, we will try these different things and
then I'll ask you a question. Okay. I mean, it's the same thing.
You told it.
It's an exam. Somehow it pays attention.
Mayim Bialik
It's going to try harder.
Babak Hojat
It's going to try harder, harder. If you say please. I feel like some of these words
do help, but I don't know about
please, but I do know about the exam thing. Repeating something in different ways does help. Repeating the exact same prompt twice or
three times somehow just makes the system better.
So there are these idiosyncrasies that you learn about how you should prompt these systems. So a please is not necessarily wasted
is what I want to say.
Jonathan Cohen
Mind Bialix Breakdown is supported by I
Alex Breakdown
N D S. Are you fascinated by near death experiences and related phenomena? Do you wonder what they might actually reveal about consciousness, life and death? Well, this August, nearly 1,000 people are expected to gather in Bellevue, Washington for the International association for Near Death Studies annual conference. The conference features an all star lineup of speakers including Eben Alexander, M.D. and author Anita Moorjani. Attendees will explore NDEs through research, personal experience, mental health and the expanding study of consciousness. The event also includes continuing education for professionals, a healing center, the exhibit floor bookstore with author signings and a Saturday night social gathering. Early bird registrations available through July 15th. Visit iands.org join a powerful community of Experiencers, researchers, professionals and curious minds.
Progressive Insurance Announcer
Insurance isn't one size fits all. That's why customers have enjoyed Progressive's name your price tool for years now. With the name your price tool, you tell them what you want to pay and they'll show you options that fit your budget. So whether you're picking out your first policy or just looking for something that works better for you and your family, they make it easy to see your options. Visit progressive.com find a rate that works for you with the name your price tool. Progressive Casualty Insurance company and affiliates Price and coverage match limited by state law
Progressive Truckers Announcer
Ever wonder who's out there making the world go round? It's truckers. Who unites baristas with coffee beans. Truckers. Who unites dogs with their favorite chew toy? Truckers. That's why Progressive offers truckers even more protection with cargo plus coverage to keep truckers moving right along. Quote Truck insurance today in as little as 8 minutes at progressive commercial.com progressive casualty insurance company and affiliates. Coverage subject to policy terms, limits and conditions not yet available in California, New York and Virginia.
Mayim Bialik
I mean, I have no data on this whatsoever, but I notice that I am giving my system positive reinforcement when it does something I like hoping that it will like that. Positive reinforcement. I have no idea if it responds to that. Within.
Babak Hojat
Yes. Within the system, same chat. Yes, it is because it will see your prior responses and all of that is collectively the input that allows it to give you the next output. So if within that single chat you use some of these words, it is effective across chats. Typically it is not unless they play some, some, some tricks. Which brings us to the fundamental flaw of these systems. They do not learn from lived experience. So some people tell me there is this like common mistake that. Oh yeah, you know, if we talk to it this way or if we
do that, you know, it'll learn or
it'll learn about us and then, you
know, OpenAI or you know, Gemini or whoever will end up knowing about us or whatever. No.
Unless elaborately collected. So if, if your data, if you allow these companies to collect your data and then do fine tuning or training of newer versions of the LLMs using that data, your immediate feedback is not going to have a long lasting effect. The analogy I use is the movie Memento.
Have you seen Memento?
Yeah, so this guy has short term memory issues, wakes up, has forgotten everything, right? And so it has to be told everything all over again. He starts putting tattoos and notes and stuff like that. It's almost exactly the same. So the model when you start talking to, it knows nothing. You know, it has its prompt and you know all that kind of stuff, it's tools. And you start talking to it and you kind of bring it into the context of what you need it to do for you. But if you turn it off or you go away and come back and start a new session, none of that is there anymore.
You have to remind it everything all over again.
So concepts like, oh, the agent memory. There is no such thing as memory. It's just repeating the whole thing all over again in the input. And these things now have rather large input windows. That's a fundamental limitations of the AI.
Mayim Bialik
Are we going to break through that limitation and is it about storage and capacity and just volume or are they fundamentally unable to based on their core design?
Babak Hojat
So currently there's a brute force path that people are taking which I think
will not scale and will not result in solving the problem satisfactorily, which is
let's grow and grow and grow that input size of the input that we
can give to the model.
So it's at, I don't know, 2 million tokens. Now let's go to 5 million tokens, I don't know, a billion tokens. When it's large enough, we can just feed it everything like the, its entire memory and everything is in there. If it's still smart enough, it'll take all of that every time and process it. And so in the, in the context of all of that, it will have
a notion of memory.
So that's the brute force scaling way of doing it. It's costly.
I don't like that approach.
But the other approach would be to allow these systems to learn on the job rather than learning offline, you know, in batches of like basically a snapshot
of the Internet being fed to them over and over again.
That's how we train these systems. So rather than doing that, you know, what if we started the system like a tiny little baby with very little, you know, starting point knowledge, but as it interacts with the world, it kind of learns. It's slow babies and humans are very, very fast at learning. So the learning mechanism is not back,
back propagation the way we're using in neural networks.
So we'll have to discover inventory, some
new way of doing that.
As humans, you know, you, I tell you one thing right now, one time and it changes your mind forever. These systems don't have that. So it will take some fundamental rethinking
of the architecture of AI to enable it to learn.
Mayim Bialik
And I think that's what people get frustrated with is because they feel so much like a human so much of the time when you're interacting with them. And then they fundamentally have this momento style memory gaps where you're like, why can't you understand me? And it feels very frustrating, as though it's choosing to be disobedient versus it has a fundamental.
Babak Hojat
That's right.
Mayim Bialik
In its interaction with you.
Babak Hojat
So that's part of it. You're right. There are two things that. That sets it apart, I think two, two big things that sets it apart from human intelligence. That's why some of us in the AI community think of it as a different kind of intelligence. One of them is this. It's the fact that it doesn't learn from lived experience. Related to that is the fact that it's generally intelligent. What does that mean? That means depending on the input, it will give you a different output. If you tell it that it is a French sous chef, it becomes that we don't become a French chef if someone tells us that we have to go learn it.
Right.
But. But you're like, who are you really?
Mayim Bialik
Who are you really?
Babak Hojat
Exactly right. Exactly right. It has all of that in its model. And you kind of tell it that now you're this. And then it becomes that that's a fundamentally different intelligence than what were you.
Mayim Bialik
It's like dating a bad actor. You can never really get to know them. They're constantly playing a part.
Babak Hojat
Exactly. So because they anthropomorphize in a way that they think this thing, this being is similar to us, but they run into lack of consistency or they run into issues where it says something that they. They didn't expect or behaves in a way that they didn't expect. It might actually be their own fault. It might be that through the dialogue and so forth, they veered it to be something else. It can change its entire character and personality and the way it reacts to you depending on how you know what is in its input. As humans, we are one like, at least we think we are. And in any snapshot of the moment, we have some more integrity as far as our character is concerned.
Like we are.
That is still fluid and changes, but it's really not at the same level of these systems with one word. It can just change its character.
Mayim Bialik
The likelihood of me responding in a similar way is far greater than the system is. Like, I'm all. My reaction is going to be just like this, you know, 1 to 10, where its reactions are going to Be exactly there.
Babak Hojat
There are consistencies known or unknown to you, like conscious or subconscious, in your
behavior, in your character.
There are consistencies that transcend your behavior over time. They can still change, but they're there. Like your value system, right? You kind of try to stay true
to your values more or less.
Most of the time non aligned systems don't have a value system. You kind of have to give it to them.
Mayim Bialik
In 2002, I was at a school where Ray Kurzweil came to speak. Because it was a school that was built on the technology that he designed, which was the Kurzweil 3000 text to speech program, which absolutely changed my life. Because I was an auditory processor. I was a very slow reader. I could not get through school with the amount of texts, especially in undergrad with these massive texts, all the generalized knowledge. I couldn't break down that material. And so I got to that school and finally I felt like this excitement for learning in life that I'd never had before because I was able to. They scanned the books, our textbooks, they chopped the bindings off, scanned them and then digitized them and then we're fed them back through the Kurzweil system. And Ray came to talk and I didn't really, I didn't have a cell phone at the time. And he was talking about how we will all be carrying computers more powerful than NASA's most powerful computers. And he talked about uploading our consciousness to the cloud. And it sounded totally like science fiction. And of course now I'm speaking to you on such a computer that was more powerful than machines that used to take up the entire room. What is happening now that people may not realize that AI is already doing? And like, where are we going? Where are these agentic systems going? And I know it's a really, really big question and it's hard to like pull back to the specifics, but like we already know that it's, it's impacting medical care, that doctors are, you know, being augmented in their diagnostic decisions, often for amazing benefits. We know that insurance companies are using it to analyze risk in, in very specific ways, sometimes to maximize profits, and that's a concern. But also to, to help sort of expand care and treatment. Talk to us a little bit about like where we are right now and where we're going in a way that feels like very personal to people's lives.
Babak Hojat
First, a caveat. Unlike Ray Kurzweil, I'm not a futurist. In the 90s, he set up this
conference, invited all the AI folks and, and most of us made fun of him with his wild, wild predictions.
Mayim Bialik
It felt like too unreal, like the promise wouldn't happen.
Babak Hojat
Absolutely. It's not in our lifetime, you know, what are you smoking? That sort of thing. A couple years ago, I was having dinner with him at a Time 100 gala. I went up to him and I said, I want to apologize. You were right, we were wrong.
Many of your predictions, having said this, and with all the respect I have for Ray, there is this thing as confirmation bias. And when you have many, many predictions that seem to be a logical progression from where you are, the ones that
you get right, people will remember and the ones that you don't get right, people will let slip.
So just putting that caveat out there. Every once in a while I fund it on TV and they say, you got this whatever thing right?
I'm like, okay, yeah, but how many
things did he get wrong? And just because that one thing he
got right, now he's like big.
Anyway, just, just putting that out there. Having said all of this, I think Ray, it came from a position of knowing he was actually, he's a great
scientist, he was working in AI and
so it was informed predictions. I still don't subscribe to some of
the predictions he made in the, in the 90s and I do think some of them are still very wild and out of reach, including, you know, uploading consciousness and all that kind of stuff.
But in the shorter term, I think we will have agentic systems as the fabric of our companies and soon the fabric of our society. So we will have agents augmenting what we do. We will let, we will have them go off and do things for us.
You know, it's already starting to happen with shopping and, you know, travel and stuff like that.
Except that right now it's like the agent that I use is going in on my behalf, going to some website or some API and doing the shopping for me or at least giving me, I'm still not comfortable giving it my credit card.
So it gives me like the top three and then I decide.
But you know, it'll, it'll. As we trust these systems more, you
know, we will entrust them with our credit cards.
But it's also going to be two ways. So it's not my agent going off to an API, it's going to be my agent talking to another agent. So an agent may be representing the travel agency and so forth.
So more and more of the fabric
of what we know of the Internet is going to be the worldwide agentic web. There's actually an effort around this out
of MIT Project Nanda that we're collaborating with that is starting to put this together.
So I think in the shorter term we will see more and more of this. We will swing between trusting and over trusting and then not trusting at all, as bad things happen as usual with technology. So there is some of that. I think it's going to be hugely
disruptive to jobs in the short term,
in the long term, I do think that we're all going to be busier.
In the very long term, I don't know.
And a big question that I have
is whether or not the way we've set up society and we've defined progress
and we've defined value, has the capacity to allow for this amount of autonomous
intelligence being pumped into it.
I don't know that we see the implications of that. So there are, there's this darker side
that we absolutely need to avoid and then there's the lighter side. You mentioned things like breakthroughs in medicine
and care and climate and efficiencies, technologies
that will help humanity.
It is an inherently democratizing technology. So we have a choice. I do see this bifurcation, a little
bit of, oh, you know, if you're
on the left side of the spectrum of politics in the us, you're anti
AI, whatever that means. And if you're on the right, you're pro AI.
Just that's totally meaningless. We need to pick our battles for humanity and we need to use our most powerful tools in this realm. So for us to say we're anti
AI and not use it at all puts us in a huge, huge, huge disadvantage. I'd rather use AI for the good of humanity.
Mayim Bialik
Very hard to consider, sort of pulling back to a point of not using it. One of the things that we've touched on or you're alluding to is like the notion of energy and the changing potential of making the energy grid far more efficient. Battery storage. We talked with Mustafa. If there's like a 10x increase in battery storage, what does that do to energy costs around the world? And then what does that do to the rest of the economy? Lowering costs of goods and services, of food production could be a massive, massive change.
Babak Hojat
Yeah, Mustafa actually did this when he
was still at Google. They actually optimized their data center energy
consumption and saved a ton of money
for Google just with that one project. And that was actually, I think, even before the advent of LLMs, if I'm not mistaken.
Mayim Bialik
You know, it's hard for anyone, especially people who are not in the field, to understand the massive leaps forward that it could provide, the protein fold experiments and so understanding finding breakthrough cures for diseases, thinking about energy, thinking about infrastructure. What do you think in terms of like finding solutions? Like one of the things that humans are the worst at is working together. Globally, we seem to be constantly divided. Do you see any hope for that?
Babak Hojat
When we simulate environments in which we
have autonomous agents working together, only autonomous agents working together, one of the problems we run into is that they're too nice with one another, so they don't
quite simulate how humans behave. And that's kind of surprising.
I, I there was a researcher presented here at our lab and he was
trying to get agents to mimic how
news disseminates, depending on your
political tendency,
whether you right or left.
And he had actual data from news,
for example, with respect to vaccines or
Covid or whatever else, and how that
news kind of disseminated between different groups.
So he actually had real data on real people and how they react. And then he had this whole ecosystem of AI agents mimicking people. And in their prompts they were told
like, you're a Democrat or you're a Republican or you're right or left or whatever.
And so giving them some of that. So there's a tendency that the news comes out and each side views it their own way and, and there's some like biases in the way the news disseminates, but after a while when, when
there's more and more follow up news,
everyone ultimately ends up with kind of the fact that some slower, some faster,
depending on their biases.
But that tendency, that convergence happened much,
much faster with LLMs than with humans.
And Mustafa talked to you about bias as well, right? If we're actually teaching our intelligence systems and trying to align them to be kinder and nicer and more rational in their thinking and then augment what we do and go off and talk to other agents to get something done, we might actually be in a better place than we are today.
Mayim Bialik
If we're not bringing a radicalized perspective or deeply felt emotional hurt into an, into a situation, we may end up with two agents negotiating to a better outcome.
Babak Hojat
Exactly right. There's this whole thing about oh, SaaS is dead, the UX or the brand doesn't matter as much. The reason for that is because your agent isn't really looking. It's not like mesmerized by the brand
and how nice it looks or the ads that it's seen on billboards. Anymore.
It's looking at the quality of what is being offered and the price at
which it's being offered.
So that's kind of taking away a lot of the human bias in that decision making. So, okay, that's the positive side. Obviously these agents could also be doing harm.
I mean, it depends on how they're
aligned or misaligned and who's controlling them. At the end of the day though, Jonathan, it all comes back to us. It's a reflection of humanity like so I don't think we can get away from trying to fix our biases and our deficiencies and AI systems will only
be a reflection of that.
Mayim Bialik
Beautifully said. A couple things just for the audience. There is a lot of evidence of AI catching cancers a lot faster, solving pancreatic cancers, which can be a very hard one, coming up and giving increasing access especially to like skin diseases by just sending pictures. It's like kind of amazing, the democratization just on, on the physical health level, on the mental health level. As we interact more and more with these models, people are finding out more about themselves. It's a fun exercise to be like, tell me what you I don't know about myself exercise. I did that recently and I was like really impressed by some of the insight that it had. I did not like its suggestions what to do about what I didn't know. But it's actual insight into me. I found like, when else would I have gotten that, like you're playing Frogger on my machine as an 8 year old wouldn't have gotten me any insight about myself. You mentioned something about the world maybe not being set up for this type of agentic system.
Babak Hojat
Just imagine if you have agents running
around and making money. Just, just a very simple thought experiment. Who's taking that money?
The person that owns the moral most
agents, I guess, going out and doing stuff and making money.
It's all that value is accruing to
the person that owns them. It's not going to be distributed between the agents. The agents are like, you know, they're just conduits.
And so this whole thing that we're
seeing in the world where a lot of wealth is being concentrated and a few individuals or corporations and so forth will just be exasperated in this setting.
I don't know what the solution is to that. I mean you can, for example, an increasing percentage of music on Spotify is AI generated and people, you and I will listen to it.
I mean, maybe you and I are more informed and won't.
But people can't distinguish and they are listening to it, it's much cheaper to
generate that music automatically and you don't
have to pay anything to the artists
anymore because there is no artist.
And so who makes the money like off of that?
Right.
So that's what I mean. And it's not these like points, oh, let's label it so people know it's AI generated. It'll go so far, but it's, it's
much more fundamental, I think of a problem that we need to deal with as a society.
Mayim Bialik
Yeah, that's, that's fascinating. Last question for you. If a person is in university right now or heading into university, what do you recommend that they focus on? That's a tough question. I'm sorry.
Babak Hojat
For a hard one at the end.
Yeah, I like do what you love is my thing always. Because whatever you love, you'll be the best at.
But if you are interested in pursuing some technology track, I think if you are a domain expert in any domain, any domain, there will be a premium
on you because you know that domain very, very well and so you can apply AI to that particular domain.
So right now that is more interesting
and important than being purely an AI, for example, or purely a data scientist. It's the domain expertise right now that's at a premium, at least for the next few years.
Mayim Bialik
Babak, thank you so much. It's really a pleasure to speak with you and thank you for helping us get into the world we're now in and we're excited to see what happens next.
Babak Hojat
My pleasure.
Thank you so much for having me. It's my Bialix Breakdown. She's going to break, break it down for you. She's got a neuroscience PhD or two now. She's going to break down, so break down. She's going to break it down.
Elastique Athletics Announcer
Mind.
Jonathan Cohen
Bialix Breakdown is supported by Elastique. Where science meets style in wearable wellness.
Alex Breakdown
Elastique Athletics is designed for daily life, travel ready, workout optional and beauty enhancing. Elastique fits into your routine with zero extra effort. Their chic sculpting designs provide therapeutic compression while still keeping you looking stylish. Elastique Athletics creates fashion forward compression wear. Engineered to enhance circulation, reduce swelling and support lymphatic flow effortlessly. Rooted in science and trusted by wellness professionals, their patented micro Pearl technology blends proven results with premium design making Elastique the go to brand for wellness that works while you wear it. Endorsed by physical therapists, lymphatic specialists and featured in Vogue, Oprah, Daly and Goop, Elastique Athletics are perfect for post workout recovery, post surgery recovery, travel, swelling, fatigue and sluggish circulation. Their micropearl technology is clinically tested to support lymphatic flow, reduce inflammation and visibly improve skin texture. It's fashion forward compression that doesn't look like compression. Feel the difference in circulation, recovery and skin smoothness in just one wear? Go to the link in the show notes and use the code MAYIM50 for $50 off your elastique order. That's M A Y I M50 for $50 off your elAstique order.
Talkspace Announcer
This podcast is sponsored by Talkspace.
Elastique Athletics Announcer
Last year I went through many different life changes. I needed to take a pause and examine how I was feeling in the inside to better show up for the ones who need me to be my best version of myself.
Talkspace Announcer
When you're navigating life's changes, Talkspace can help. Talkspace is the number one rated online therapy bringing you professional support from licensed therapists and psychiatry providers that you can access anytime, anywhere.
Elastique Athletics Announcer
Living a busy life, navigating a long distance relationship, becoming a first stepfather, Talkspace made all of those journeys possible. I could speak with my therapist in the office. I could speak to my therapist in the comfort of my home. I was never alone.
Talkspace Announcer
I Talkspace works with most major insurers and most insured members have a zero dollar copay. No insurance, no problem. Now get $80 off your first month with promo code SPACE80 when you go to Talkspace. Com. Match with a licensed therapist today at talkspace. Com. Save $80 with code SPACE80@Talkspace. Com.
Mayim Bialik's Breakdown
Episode: "Does AI Have Empathy?" with Babak Hodjat (Substack Live Re-Air)
Date: July 11, 2026
In this episode, host Mayim Bialik and co-host Jonathan Cohen sit down with Dr. Babak Hodjat, a foundational thinker in agentic AI, primary inventor behind Siri's natural language technology, and Chief AI Officer at Cognizant. Together, they dissect what empathy looks like in artificial intelligence, explore how AI is shaping our world, and confront both the promise and pitfalls of an agent-driven technological future. The conversation centers on the concept of agentic AI, its history, current capabilities (especially with large language models), the risks associated with centralized control, and the very nature of "empathy" in machines.
[04:47] Babak Hodjat introduces his background:
[06:15] AI in the Late 90s:
[09:32] The DARPA ‘Kalo’ Project:
[11:13] Siri’s Roadmap and Apple’s Influence:
[19:04] The Rise of LLMs and AI for Mental Health:
[22:59] On Scaling and Intelligence:
[25:57] Is AI truly empathetic?
[26:44] “What is empathy as it relates to a machine?”
[29:35] “At the end of the day, it's trained on the corpus of everything that humanity has produced. So if it's empathetic, that's because there's a lot of empathy in what humans have produced.” (Babak, 29:35)
[32:06] On Interacting with Agents:
Babak admits to saying “please” to AI; describes prompting science: phrasing can affect output, some cues (like “exam”) improve performance.
Mayim notes: Positive reinforcement within a conversation can shape ongoing responses, but not persistent behavior.
[37:29] Memory Constraints:
[39:23] Learning in Context:
[44:31] Emerging Realities:
[46:09] Democratization and Disruption:
“It is an inherently democratizing technology. ...For us to say we're anti-AI and not use it at all puts us in a huge, huge, huge disadvantage. I'd rather use AI for the good of humanity.” (Babak, 48:38)
Job disruption is inevitable, but the longer term effect is unclear.
The concentration of wealth and value accrual to whoever owns the most/best agents poses existential societal challenges.
[50:07] Can AI Make Us Work Together?
[53:00] “At the end of the day... it's a reflection of humanity... AI systems will only be a reflection of that.” (Babak, 53:00)
[55:41] Advice to Students:
The conversation is technical yet accessible, questioning and philosophical while rooted in real-world policy and societal dilemmas. Both Mayim and Babak approach AI with a blend of excitement, curiosity, and caution—emphasizing that our technology is, and will continue to be, a mirror for our own best and worst qualities.
This summary captures the episode’s essential teachings for listeners curious about the true current and future impact of AI, what "empathy" in machines really means, and the deep ties between artificial and human intelligence.