Loading summary
Transcript50 lines
- [00:02]
A
Hi, I'm Jim o', Shaughnessy, and welcome to Infinite Loops. Sometimes we get caught up in what feel like infinite loops when trying to figure things out. Markets go up and down, research is presented and then refuted, and we find ourselves right back where we started. The goal of this podcast is to learn how we can reset our thinking on issues that hopefully leaves us with a better understanding as to why we think the way we think and how we might be able to change that to avoid going in infinite loops of thought. We hope to offer our listeners a fresh perspective on a variety of issues and look at them through a multifaceted lens, including history, philosophy, art, science, linguistics, and yes, also through quantitative analysis. And through these discussions, help you not only become a better investor, but also become a more nuanced thinker. With each episode, we hope to bring you along with us as we learn together. Thanks for joining us. Now, please enjoy this episode of Infinite Loops.
- [01:14]
B
Well, hello everybody. It's Jim o' Shaughnessy with yet another Infinite Loops. I have been looking forward to today's guest. Well, maybe before I even had this podcast, because his book, why Greatness Can't Be Planned, just hit me dead center because I'm like, that's what I think. My guest is Ken Stanley, who has decades of work showing that complex creative domains, from biology to technology, often show that ambitious objectives can actually blind us to the stepping stones that make breakthroughs possible. Ken, welcome. And my first question is, are we deterministic thinkers living in a probabilistic world?
- [02:01]
C
Well, thank you. That's a good start. Thank you for having me. So are we deterministic thinkers in a probabilistic world? That is a deep philosophical question. I think for practical purposes, I would not think of us as deterministic, but maybe you're getting at a deeper point, so maybe I should let you elaborate the question.
- [02:22]
B
Yeah, yeah. I say often we are deterministic thinkers living in a probabilistic world, and often hilarity or tragedy ensue. And I guess by that I mean I've always kind of naturally been a nonlinear, kind of experimental guy, and I caught a lot of hell for it. When I was like a teenager, I used to go to Tower Records and like, buy dozens of CDs at random just to see what I was missing. And I would go home and my parents would say, what are you doing? And they were non plussed, to say the least. I very much have guided most of my life by the kind of stepping stone path that you embrace and do Such a great job of explaining to people. And I often think that we let objectives, or, you know, we must achieve A, B and C. We let those blind us to all of the other letters in the Alphabet.
- [03:28]
C
Ah, yeah, I see where you're going. Yeah, I missed the opportunity there to connect. Yeah, I see what you mean. Now when you say we're deterministic thinkers, it's true that at least culturally, I think we do tend to try to make the world deterministic in our thinking. And we set objectives as just a matter of routine. And we think that kind of a tidy laying out of objectives over time is going to get us to where we want to go. But the world doesn't actually work that way. And so it can lead to trouble. And that is kind of a theme of a lot of the work that I've done. And so I think we're aligned on that point. Yeah, that is kind of how the.
- [04:05]
B
World is another thing that has always kind of worried me, and maybe that's not the right term, but desire for certainty to me seems to be like one of the biggest bugs in human os and it leads us to vote for the candidate who proclaims things are A, B and C and has a very clear, easy to understand platform. Whatever. I mean, CEO, politician, all of the above. And your work, you bring receipts, you've changed a lot of this to code like neat and all of your other work, hyper neat, et cetera. If you wouldn't mind, for listeners and viewers who aren't very familiar with your work, let's start there. Let's start with your early work and then we'll get to the newest work that I'm really intrigued by.
- [05:02]
C
Sure, yeah. And by the way, I totally agree with what you're saying about certainty, or it's just actually, I think it comes out in certitude. Online you see so much certitude, and that is, to me, frustrating that, like, people can't express uncertainty. Everything has to be definitely the way things are, and this is definitely the correct opinion. It's probably not great for public discourse. So, okay, just to transition to my own work then. Where do I come from and where does it all begin? I was originally interested in AI, but in a particular aspect of AI. I mean, this goes back to basically like age 8, something like 8 years old. I was always interested in AI, but the particular aspect of AI I was interested in was I was hoping that the computer would do something surprising. That was always what interested me. Like early on, around age 8, I would write code in BASIC and I would get the computer to have a conversation with me. It definitely wasn't chatgpt, but it would say things like, hey, what's your name? And I'd say Ken. And they say, hi, Ken. And I would press myself for a short time that I could do that. But what really started to annoy me was just that I knew what it was going to say and I wish it would say something interesting. And that kind of grew into an interest in what kinds of processes lead to unpredictable, interesting types of innovation over time. And it's both like from the perspective of how do humans over time innovate and invent things that are not necessarily predictable, but also how do you things like humans get invented over the evolutionary process that produced us or biological evolution? And so by the time I got to grad school, the thing that I was zeroing in on was how do, how does a process like evolution succeed in creating what appears to be increasing complexity over eons? And of course, not every evolutionary lineage necessarily is increasing in complexity, but so many lineages, including our own, have astronomical increases, like up to the 100 trillion connections in the human brain. And I was trying to understand algorithmically, because I'm in computer science, I'm not a biologist, I wanted to understand algorithmically, how can a process like that actually happen inside of a computer? Because at that time I believed that it's probably the best way to get to human like AI is to understand the process that generates things like us, rather than trying to reverse engineer how we work. That was sort of how I saw things. I thought reverse engineering 100 trillion component machine is probably really, really hard, but just trying to recapitulate something like evolution, which looks relatively more simple to explain, might be easier to get off the ground faster. And so that's what led to inventing this thing called neuroevolution of augmenting topologies, or need, which is basically just an algorithm that through an evolutionary algorithm would evolve neural networks, which are the same things we have today in large language models, but much smaller back then, but could evolve them increasing complexity. So over generations of this evolutionary process in the computer, the neural networks would get more and more complex. And the neat algorithm was an attempt to abstract that kind of a process into the computer. And it could indeed evolve increasingly complex artificial neural networks. So that's sort of where I got started. That was my PhD dissertation was on these increasingly complex networks. There's a long story from there to get to today or through how did we end up having a book which is sort of an anti objective manifesto. But maybe I should pause there since we got to the beginning at least.
- [08:44]
B
Yeah, I think what's super cool to me about Neat to more fully explain it for everyone listening and watching is you trained it for people to focus on what caught their eye. Right. And stop me if I'm, if I'm butchering the explanation here, but out of just that focus of what caught their eye, really incredible images like skulls, like a variety of things appear. If I'm remembering correctly, I played around with it quite extensively and I just was so fascinated and I personally saw, I'm sure you're familiar with the Game of Life. That was, I think that was in the 70s, right. And I saw a clear connection there. I also, I don't know if you're familiar with the work of Howard Bloom, who wrote the book the God Problem. If not, you might like to read it because he basically spends the entire book trying to answer your question. How he of course assumes a godless cosmos. Right. That's his stipulation one. And he's like, okay, if you grant me just for sake of argument that there is no watchmaker, how on earth did the cosmos do what it did? And the parallels to your work I find, you know, extremely fascinating because he's of a very similar mindset to you. He also does. He's kind of wacky, which is one of the reasons I love him. But he studies nature. Bees, ants, termites and you know, after reading his the Lucifer Principle and the God Problem and a couple others, Global Brain. His thesis is, is pretty simple. It's without exploration, without the what he called bohemian bees, none of it would work. And the idea that it me was like, I wonder if that's one of the reasons why we went through what we now call the Dark Ages. I wonder if when the Catholic Church became the most powerful institution on the planet and really didn't take kindly to heretics and bohemians and burned them at the stake while we got a thousand years of darkness, how would you react?
- [11:10]
C
Yeah, it's true that there's a connection between this fundamental question of how can things like us exist if nothing is really in charge? Deciding how the process should work and the kinds of algorithmic principles that I'm interested in, they're kind of trying to answer the same question. The lack of supervised guidance in evolution is really interesting because evolution looks like a creative genius in some ways, but it's not a person. It doesn't have a mind or initiative of Its own. But it's creating things that even today defy engineering and our ability to produce. And so explaining that is very important, I think, from an algorithmic perspective. Like what kind of algorithm is this? And you're, you're observing. Are you mentioning the, the pictures that you saw with. With Neat and. Yeah, and I just wanted to, To. To make that connection that, that is, that is also relevant to this. But also that's a few.
- [12:06]
B
That.
- [12:06]
C
That happened a little bit after neat. A couple of years after neat, when that started to happen, that NEAT originally was not about pictures. It was just using these evolved neural networks to do usually reinforcement learning tasks like get some kind of robotic system to have some behavior that you want. And it was, it was a couple years later that people started to have this idea that you could take these evolving neural networks, which are increasing in complexity, and have them generate an image and you could be the one to decide which ones should breed and create the next generation. So it introduces humans in the loop. This actually wasn't my idea. And it goes back to evolutionary art, which is like a whole area that precedes me by many years. But people's idea basically was let's combine evolutionary art with neat. And they started doing that in standalone apps which are not. Which are little known today. Hardly anyone knows that these existed. But they were called NEAT based genetic art apps.
- [13:02]
B
Yeah, that's what I was. You're right, my bad for. Yeah, I should have made that more specific.
- [13:09]
C
Yeah, so. So I started playing with those. I mean, I was, I was amazed by them in some way because like, it was NEAT was my idea, but the idea of generating art with it was not my idea. And it was so cool. It was something I hadn't thought of doing with it because one of the things about it is that because these neural networks are increasing in complexity, you can actually see the increases in complexity visually through the evolutionary process with the art. So it's like it gives you kind of an intuitive lens down to what's going on inside. How is complexity increasing over time by seeing the images on the surface. And so for me, it was like very educational. And many people maybe saw it more like a toy. Like it's a way of getting some pretty image or something or just exploring spaces of possibilities. But I felt like I was learning something really deep when I was playing with it. And it led us to have an idea which was initially initiated by Jimmy Secherton, who was a student at the time, who is in my research group at the University of Central Florida. And he said, you know, maybe we should, maybe we should actually create a crowdsourced version of this, like not just a standalone app, but like put it on the web for everybody. And then, like, if you evolved something cool, I could see it online and I could continue reading it from there. And I thought that was just an amazing idea. Like, it's so interesting because it means the evolutionary process goes basically forever. And maybe we could see something analogous, like, like very, very, very different and very, very less grandiose than say, evolution on Earth, but in some ways an analogy to evolution on Earth, which is this continual, divergent process of exploration that never ends and increases in complexity. And it would just be image space. But it sounded really amazing. I mean, it's never been done before. So that's what led us to create this pick breeder system, which is the system that most people are familiar with. This kind of neat based, neat based genetic art through was the pick breeder. So we put together pick breeder and put it out on the web. And indeed many people it turned into a couple thousand people, probably, which isn't huge by any modern standard, but it was enough to get this large evolutionary kind of tree of life to grow inside the system on the Internet. And we saw an unbelievable flowering of discoveries. And you might think, well, why is it unbelievable? What's so surprising about this? And the reason it's surprising is because the space that you're in, which is basically just a certain kind of special neural network that we call the cppn, it was a kind of neural network space. The vast majority of things that it could draw as images are just total garbage, like 99.9999% of the space. And this relates back to this kind of question that you framed around this, from the last question you asked of how can there be all this complexity in the universe without any kind of guidance, when, you know, most things just like random constellations of particles are just garbage? It's just space waste. And so where does all this interesting stuff come from? And pick reader sort of begs this question too, because, like you're seeing over and over again astonishingly meaningful discoveries like a butterfly or a skull or something that looks like the planet Jupiter or a car in a space where those are like this, this infinitesimal, tiny part of what's possible. And you have to explain, and it makes us want to explain even though there are humans in the loop. And that's a big difference from evolution. But even with that, how could they possibly have consistently found these unbelievably unlikely needles in a haystack over and over and over again. There's got to be some reason for that. And so that led to, I think, a lot of insights about how systems like this really work.
- [16:54]
B
And then specifically, let's keep going on that. So let's go on to the insights and then what, the additional hypotheses and theses you came up with.
- [17:06]
C
Yeah, so there was a really. There were. There was a really cool insight. Actually, recently there's been another insight. There's actually two really deep insights. But. But the more famous one that's, that's been around for a while is this insight about objectives. And so it's happened because, you know, after the. After Pick Breeder was around for a couple of years, you know, it's worth noting that, like, we didn't really have a hypothesis. Like, what's the scientific hypothesis? Like, a lot of people think the scientific method is you have a hypothesis, then you do an experiment. This didn't work that way. This is more like, let's just do the experiment, then we'll figure out what the hypothesis should be. Because I was sure that, like, if you just crowdsource the whole world in this complexifying space, something interesting will happen. I wasn't exactly sure what, but I was sure we would learn from it. Part of the reason is because, like, a real challenge with evolution on Earth is that you have to go into the fossil record to actually know anything about what actually happened. It's like digging in the dirt. Enormous amounts of effort is involved and not everything in the chain is even findable. And so, like, there's an. There's a poverty of information to really reconstruct the entire chain of events. But what's really cool about Pick Breeder is that we do know everything. There's no digging in the dirt. Everything, every single step of every single choice been recorded. And so that made me think we're going to be able to extract like a really deep lesson here. I don't know what it is, but we will. And indeed that's what happened. And it happened in a way that I didn't expect. But basically what happened was I was playing with Pick Breeder myself and I saw an alien face. It looked like E.T. from that movie E.T. the 80s movie, if anybody knows. It looked a lot to me like E.T. and I thought. And someone else had bred this face. So it wasn't me, but it was on the site. So I thought, oh, this would be fun because I can get more aliens because that's kind of how it works. Like, once somebody finds something, you can get variations of it. So I was like, let's get variations of ET And I was playing this game. But then this really weird thing happened, which is that his eyes, they started to descend, like down, down the face. And I suddenly noticed it looked like wheels. It's like he has a really kind of flat face or thin. And so when the eyes went to the bottom, it looked kind of like a car with wheels underneath. And it struck me that I was in car space now, no longer in alien face space. And so after that, I could steer it to something that looked pretty, pretty well like a car. And you may think, well, great, good for you. You found a car. Like, what's so exciting about this? But actually, to me, it was a huge epiphany. Life altering, actually. It turns out I maybe didn't know at the time would be life altering, but it was, it was huge because I started to become obsessed with the observation that I wasn't trying to get a car. I hadn't been thinking about cars. And it occurred to me that if I had been, if I had wanted to get a car, I would not have chosen that alien face. I would have thought, there's no way that's going to become a car because it's a face. But it turned out I did need it. And the only reason I get it is because I wasn't trying to get a car. So I was thinking, how could this be? Because it seemed to defy a lot of lessons I'd learned in engineering and computer science, that the way you actually accomplish things in this world is that you set a goal and then you move towards it deliberately. And this is like a really deep cultural thing. It's not just in computer science, but it's like across our culture. In fact, I would say it's the world culture. It's not just like Western culture, it's the whole world is like this now. And I was thinking, here's a case where the only way to achieve this thing would be to not be trying to do it. And so I thought, okay, let's see. Now I'm curious, like, how often does this occur in Pick Reader? Like in the history of all the images that have been discovered. You know, we've got butterflies and skulls and planets and other animals and faces, and there's all kinds of stuff there. So. So we said, okay, let's go back and look at the history. And it turns out that almost every single time, this is the story like you might. You would think, I mean, I would probably thought that this is some kind of like lottery win, like where it's like extremely lucky. Like this would never happen again, like a huge coincidence. But actually it's always what happens is that somebody finds something that does not resemble the ultimate discovery, but then the person who makes the ultimate discovery branches from that serendipitous discovery and realizes that this leads to something else and then is opportunistic and gets that other thing. And so it's not an exception, it's a rule. Like, that the only way to find things in pick breeder is to not be looking for them. And so that kind of generalized this observation that this is actually a general principle. So then I became obsessed with this after we saw that, because I was like, this must mean something deeper than just pick reader. What does this mean? Because it violates everything I've ever been taught and it seems to be a principle. And I started imagining weird things. I was thinking, imagine trying to learn how to race a car, because a lot of neuroevolution or evolving neural networks with NEAT was involved. Stuff like trying to teach cars to go around simulated racetracks and stuff like that. So I was thinking, what if instead of trying to get it to go around the whole track, that's the objective, we just imagine that we just say, keep trying to do new things. So it's like you crash into one wall, but you say, don't do that again. So it crashes into another wall. But I was thinking if you just kept playing that game, it would eventually drive around the track. Even though you never told it to drive around the track, you never rewarded it for going farther. It's just that in the process of trying to find interesting new stuff, it's inevitable that eventually you have to learn something about the world. Because eventually all the silly things to do that are just trivial to find would be exhausted. And then you're going to be forced eventually to find something interesting. And I think that's sort of a description in a way of what's happening in pick breeders. Like, people were finding things like circles and lines and curves and things that are not very interesting, but as they increase in complexity over time, they're just trying to look for anything more interesting. And then when they find something, it becomes a stepping stone. And then more interesting things can be discovered from there. Just like the alien face leads to the car. And so after several months, probably obsessing over this, I started to think there's an algorithmic basis, like we could actually describe this process. And we ultimately called it novelty search. I did that work with Joel Lehman. It's actually, in fact his like, first day of grad school. I remember I was, is like a few months after this revelation, and I just like poured this whole point onto him. Like, I just overwhelmed the poor guy. He's like, it's his first day. And I was like, you don't need objectives. Like, we could just do amazing things, like just looking for novelty. And like, this is so exciting. And so he, he, he was, he was very nice and kind of like grabbed onto this point and see if you can actually implement this as an algorithm. And it turns out it was, it turned into the novelty search algorithm, which was, which was impactful within its field. And in some ways, though, I view it as a validation of a deeper point philosophically rather than just like an algorithm that has utility. It's more important, I think, for the deeper point it makes, which is that novelty search often discovers a better solution to something than the alternative version, which would be trying to solve the problem, which is so paradoxical. And so some people think that, oh, well, you know, what are you. You're saying basically that the best way to solve your problem is to put novelty search on it? But that's not my point. Because novelty search, clearly, without any clear, distinct objective, cannot be guaranteed to solve any particular problem. It has no particular goal. Rather, I think the lesson is that it's extremely embarrassing and concerning that often it does solve the problem better than something that actually knows what it's trying to solve. And it should make us all very concerned about the actual downside of being too obsessed with pursuing a singular objective.
- [24:53]
B
Again, philosophically, I'm a huge fan of Taoism and the Tao Te Ching. And if you've read any about the philosophy, there's a principle called Wu wei, which is actionless activity. And it parallels quite nicely with what you're talking about here, the challenge. So I'm in business, right? And business loves its org tables, and people fight like hell to be somewhere special on that list. So I ran into a lot of troubles with trying to encourage this type of thinking. A lot of my earlier employees would look at me like I had three heads, like, what are you talking about? You're crazy. Why would we just randomly put things together? And so I came up through asset management and quantitative analysis, and literally I was fascinated in a similar way with just throwing algorithmic factors together and seeing what emerged. And just like you said, 99% of it was bullshit. It was just like nothing. But the 1% that wasn't was astounding. And it's like, I would have never, ever thought of that. And right now, for example, I'm fascinated by smart swarms. I think that with the interconnectivity that we now have globally, with the diversity of minds that are on that network, a lot of this stuff is now happening just naturally. But if you took a lot of people who were playing with smart swarms and everything else and you told them what you just said, they would also kind of look at you like, oh, no, no, I have objectives. And it seems like a real cultural thing that. That is going to require quite a fight to overcome.
- [27:00]
C
Yeah, yeah, yeah. And that's. That is something that I. I started to see the cultural connection over time after the novelty search algorithm. So if you can imagine, like, at first, because, like, the way I saw myself in my job is just like, to do AI, I wasn't thinking about a cultural angle on this. I was just thinking, like, this is a very interesting algorithmic insight for the field of AI, that you don't always have to have objectives, and actually sometimes it's better not to. And I was giving a lot of talks about that because it is contrarian. So I think people started inviting me a lot to give talks because contrarian views are kind of entertaining. And so I was giving a lot of these talks, and I did gradually start to appreciate that, interestingly, this is not just about AI. People would ask questions like, well, I have objectives at my company. Like, you know, does this. Should I think about that differently? Which is a really strange question, like, at an. At an AI conference, you know, which is usually, like, about the algorithms. And eventually I was actually invited to speak to the Rhode Island School of Design to a bunch of artists, because someone who was at that school attended a computer science conference and said, hey, I think these artists would find this interesting. And it was there that I really came to understand that the cultural connection is actually pretty important. And we should do something about that because we understand the message. I mean, we're basically the messenger, myself and Joel. And so that's what led to thinking we should write a book, because I didn't know any other way to get the word out that this is worth discussing, that the very rigid, objective culture that we live inside has enormous downsides and flaws. It's not to say we should never have an objective. That would be a perversion of the point, but just that, like, we need to understand that sometimes it's not the best way to do things and some resources should go to non objective pursuits. And so I could, I could appreciate that it's very hard to make this argument, you know, so stories like when you say it's like hard to convince people, like this is kind of philosophically like a way I want to approach the business, at least in part, but everybody thinks I'm crazy. Like that story comes over and over and over again. People constantly feel like they're living inside of a culture where even if they think, well, I think that way, but no one else can accept this. And so nothing ever happens to change things. And so I think the book was an attempt to try to empower people to at least have a conversation about this. And it was a very difficult thing to attempt, I think, for myself and Joel, having only ever written to academic audiences in a narrow niche. But we said, okay, let's at least just try this. So. And it's been somewhat successful since here I am on your show, so I'm getting a chance to talk about this. And I think that the cultural part of it is. I mean, it's a very unusual story in the field of AI for there to be an algorithmic insight which leads to social critique. I don't actually know of other stories like this. It could be the only. I don't want to claim it's the only. Maybe I'm wrong, but it's very unusual. But it's been a great pleasure to be able to have some kind of cultural impact also, because it's not something I was expecting. But that sort of goes with the meta story. It wasn't my goal. And here I am now talking in kind of a social critic form. And so now I've had many years to discuss this with people and I think I just wanted to key in on one other point you made when you talked about the difficulty of communicating this, which is the word random that constantly comes up when people worry about this point. That sort of initial reaction is like, you're telling me that I should just act randomly and this is actually going to do something better than like planning it out and doing things, because I have a goal. And I just want to make the point that a very deep insight here is that it is not random to pursue things because they're interesting. If you think that I'm saying because you pursue novelty and interestingness that you're acting randomly, then you don't understand what randomness is, because what is interesting, which is ultimately what I'm arguing to pursue, just do something because it's interesting. Like we did pick Breeder because we thought it was interesting. We don't have an exact hypothesis or objective, but we thought something really interesting would come out of this. It's like it opens up a new playground of possibilities and low hanging fruit. And so the point though is that when I make that, that, that, that, that identification of something being interesting, I'm using my entire life experience, all of my intellect to make that designation of interesting. It's not like, oh, I just spun a wheel and it just pointed to one thing and that's what I decided to do that day. It's like everything I know goes into it. In fact, if you think about it, there's more information informing those kinds of decisions than inform objective decisions. Because when you're talking about in a far off objective, you know very little about that situation that's in the future, in a fog, like I don't know the context, how we got there, what are the stepping stones that lead there. But I do know everything about the past. I know everything that I've ever experienced very well and how it helps to tune my interestingness compass towards pointing in a certain direction. And so it is the complete opposite of random. It's taking advantage of the intuitive understanding of the world that people have built up over decades, which is something that we deny ourselves in our society. Like every time somebody, if somebody goes to their boss and says, well, this would be really interesting, let's try this, they're going to get shut down. Who's going to fund or, you know, put resources behind that. It's like, what's the goal? How do we measure progress? It's too risky. That sounds random to me. So we are denying ourselves the opportunity, I think, to use the most valuable resource that we've developed. We invested 20, 30 years of education into a person and created the unique intuitions that that person has about what's interesting in the world and it's anything but random.
- [32:52]
B
That is such an important point and one of the things in my own career that I noticed. And again, so quant, which means rule based, which means algorithmic. But one of the things that I developed over my career was what I call imbued or saturated intuition. It is exactly the point you are making. What happened was this lifetime of experience, of learning, of seeing all the things that worked and didn't work that does feed you in your intuition. And so I found myself in the somewhat uncomfortable position of saying to clients, well, I have an intuition about this and they would look at me like, you can't have intuitions.
- [33:46]
C
Right? Right.
- [33:48]
B
But that is where all of kind of the gold ended up coming from, right? Like, huh, I wonder if we do. Like, for example, I started a company in 1999 which was meant to be the first online investment advisor where it was called Netfolio. And what you could do is you could take a little quiz, you could tell your likes and dislikes and then it would give you a quantitative portfolio. But one that was malleable, that, like, say you don't like smoking. My mom died of emphysema, so I'm very anti smoking. And Philip Morris was the top of the list. You just kick it off and then another stock fills it up. But at the same time, the pushback that I got was, well, wait a minute, doesn't that negate all of your backtests on your algorithmic models? And I was like, well, not really, because directionally it's still going to be the same underlying criteria. And don't get too caught up on the fact that, you know, Philip Morris is being swapped for something else. They have the same underlying characteristics. And that was the other problem that I found myself facing a lot. People get so stuck on labels, they get so stuck on names that it got to the point where even my own staff was like, oh, we can't buy that. And I always noticed it was because they were focused on the name or the label. And I seriously considered taking all the names and ticker symbols out of our system and just giving them numbers because it would allow people to not have that built in bias. And we all have built in biases and often find what we're looking for because we're biased toward finding that. And. But the thing that I just find absolutely fascinating about your work and like a lot of what we're doing at my current firm, which Honestly Ventures, actually fits in really nice with your work. I mentioned to you before we started recording that because we have the on prem AI and it knows everything about me. I asked it right before we got on was, hey, what do Ken and I have in common? And you know, the number of pages to it was pretty extraordinary. And one of them was, and this is the large language model saying this to me, so I'm not making this claim about myself because it sounds a little grandiose, but it said, you institutionalize serendipity and you do that through your fellowships where you're looking for those bohemian bees. And you're like, well, this is kind of interesting. Again, your term, we give those to what our team finds interesting. And when other people who don't think like that look at our grants, they're like, I'm not seeing a lot of rhyme or reason here. And my answer always is, that's kind of the point. And the other thing that drives me. I'm sure you're a fan of Claude Shannon and information theory and like, how it's the novel. I mean, right. His. His whole argument was information equals being novel. And. And I remember when I was reading a book about him, by now my now colleague Jimmy Soni, who is the editor in chief of our Infinite Books division, and there was this great quote from Shannon saying basically, like, a poem can be incredibly information rich. A political speech has zero information.
- [37:36]
C
Yeah, you know, it's. That word serendipity is just completely aligned with the themes in the book. I mean, it's really about serendipity, but it's kind of about, I would say, the idea that you actually can mechanize serendipity, which is super counterintuitive to a lot of people. It seems almost like wrong. Like that can't be true. But, you know, like, because everybody also, again, associates the word random with serendipity. It's like random, good things happening. But the thing is that you have to. One thing that might lead to some caution about that is if you look at the Wikipedia page on serendipity, but. And if you actually look at the list of serendipitous discoveries, because they have this long list, they're always made by people who have a really good track record, which is very strange. If it's random, like, what. What help would it be to have a good track record if serendipity is random? Like, if it's random, the best serendipitous discoverer would be somebody like some lunatic on the street just jumping and hitting walls or something like that. And something cool might happen. But that's not the kind of people you see in this list. And it shows that there's a lot more to serendipity than just randomness. And it's actually, it's a form of opportunism, but it's also a form of collecting opportunities. I usually call it stepping stones. And so the more stepping stones you collect, the more possible jumping off points you have when the opportunity presents itself. But you don't yet know what opportunity you're looking for. But it allows you to be opportunistic. And so like novelty search, in a way, it's algorithmitized. Serendipity and of course it doesn't guarantee a particular result. So it's more like. The point is that there's a way to organize things such that something interesting will happen. I just can't say what it is. But it's going to be much more interesting than if you only insist that everything you do has to be driven by objectives. You're probably going to be finding much less interesting things. If you want objectives that are guaranteed to be safe, I guess nothing's guaranteed. But as close as you can get, you won't do anything interesting. I mean, that's the trade off. You might be safe though. And by the way, I'm not trying to make any kind of moral judgment. I'm not saying that being safe is morally wrong. Everybody has a right to take the risks they want to take. And in some sense I think we're talking about risk here like that. Obviously, in order to maximize the opportunity for serendipity, you need to take some risks. And you're not obligated to take risks. You can play it safe. But the one thing that I can guarantee is that if you don't pursue things that interest you, you won't do anything interesting. That's just how it works now. It's just that also you might not succeed. So you know, there are different risk tolerances. And like I think people, you know, depending on their tolerance might build up a cushion behind themselves before taking their risks, but other people are willing to take risks right away. And so it just depends on the person. But ultimately serendipity is something that you can increase the probability of happening, but you just have to recognize you don't know where you're going.
- [40:43]
B
Yeah. And I think your idea about it being risk based is spot on. I think that it's always really fascinated me that we have the distributions that we have. It seems to me that a fairly large majority of we humans are risk averse, right. And rule followers and doing everything to maximize safety. And it's a bit like AI, right? If you maximize the objective function for safety, well, you're probably not going to find anything interesting, right? You might be safe. I don't know about that by the way. I think that's. You can argue that. You can argue that maximizing the objective function for safety does not make you safe. But the like. I have a young friend, George Mack is his name, and he's got a thesis which he calls increasing your surface area for luck. And it, and it fits beautifully with your way of looking at the world. And he is able to articulate it in a fashion where people who haven't thought really deeply about this go, oh, yeah. And so his way of doing it is to set up a dichotomy. And he says, if you have two opportunities for this evening, go with the one that maximizes your surface area of luck. And so then he gives an example. You could lie on the couch and watch Netflix, or, hey, you got invited to this art event in Manhattan, and which one are you going to choose? Well, if you're trying to increase the surface area of luck, you're always going to choose going to the art event over watching Netflix. I teased him and said, yeah, but, well, what if you're watching something on Netflix and you just suddenly think, I never thought of that. And he laughed, of course. But it's kind of something that we've been trying to create an operating system for. Basically, never turn search off, maximize for novelty, pay for novelty, gate it with kind of minimal criteria. Remember the good forks. You've got to always. That's your stepping stones. You've always got to bank the stepping stones so that you have a plethora of jumping off points. It's not. Your point is very well taken. We're not giving people fellowships to go throw themselves against walls in the city, but we do have a relative minimum amount of criteria that we will then be willing to pay for novelty. And when we find it, we keep it. And then we sort of, from a business point of view, commit. After a quorum seems to be like, okay, this seems to really be working. And then we lean into that, and the challenge goes back to what we started, our conversation. It seems to me that part of our human operating system, this desire for what is ultimately, in my opinion, an illusion of certainty, really, really mucks up the works when you're trying to get people to operate this way. And so another thing that we did was say, okay, look what I'd like at my company, I'm selling this to my teammates. What I'd like you to do is, okay, if you just budget, budget 30% of your time for just following what really, really interests you. And I've had some good success with that. But overcoming this sort of inertial. Because it almost. I had one fellow, we didn't end up hiring him. Very good guy, but he had come out of the military, and he looked at me like, I am coming out of a command and control structure that is going to make it very difficult for me. And then I made the argument to him, well, what do you Think destroyed all the old communist societies. It was the command economies, the four year plan, the five year plan. And guess what? It didn't work. And it's one of the reasons why I believe free markets are much more modeled on this idea. Right. Like a command economy is never going to build an iPhone, in my opinion. A command economy is never going to come up with a Rubik's Cube or a pet rock or you know, fill in the blank and tell me a little bit more about what, what you're working on right now because I'm find that also very, very fascinating with the idea that, you know, you can, you can really scale the AI to create some pretty interesting innovative things.
- [45:50]
C
Sure, yeah. I mean man, you just, you just hit on so many interesting topics there. I'm just thinking there's a lot of things that could be said. I, I, I just want to touch on a. Because they brought some couple things to mind like the issue of, in our book we called it a security blanket, like wanting to feel like everything is certain, but it's actually not. It's the problem. You can create objectives and they make you feel like you know where you're going and also make you feel like you're going to get there because you have a measure that tells you you're moving in the right direction. But the world usually doesn't work that way unless it's a very simple problem. And so like the particular issue that makes the world not work that way is deception. And deception means that it looks like you're going in the right direction, but you're actually not. Or it looks like you're going in the wrong direction, but you're actually going in the right direction. And deception is just completely rife throughout complex spaces. That's the way that reality is structured. And this is so like to give a concrete example which shows that we don't know where Stepping stones. If you think about vacuum tubes leading to computers, the first computers were built on vacuum tubes. But the question is, were the people who worked on vacuum tubes before that thinking about building a computer? And the answer is no. And actually it's an interesting thought experiment. If you went back to the year 1850 or something and got a bunch of brilliant scientists working on vacuum tubes in a room and told them ditch this boring stuff, just build a computer that would be much more interesting than this tube. Who even needs this? Well, we would have no computers or vacuum tubes is what's interesting about that. And the reason is because the world is deceptive. It's not clear that a vacuum tube is important for computation. So the only really way to get the vacuum tube registered into the world is to not care about computers, which is totally counterintuitive, which is why it does make sense inside of a company or the way that you described your own organization to allow people to follow interests because they need to be able to find those deceptive stepping stones. And, and sometimes they're really deceptive, like you said, like in the case where it could be that the things that lead to safety may appear unsafe and so, and vice versa, like things that are appearing to be safe, like actually might make the world less safe. This is like, this is the decept, the paradox of deception, or I, some, I sometimes call it the objective paradox, which is the reason that these kinds of endeavors, like how to make the world safe in some totally airtight way that goes on for perpetuity is almost impossible. You can't actually do that. And so it is actually dangerous to pursue that as an objective, which is just counter to it and unsatisfying and strips off the security blanket. Because the whole thing is we want the security blanket to feel like what we're doing is going to get us what we want, which is just eternal safety, for example, from AI. But if the world is deceptive, we could be actually hurting ourselves. And it's grappling with that complexity that's like, just unfortunately like the way that we have to operate, like, which means there does need to be some room to do things that aren't on the face of it, clearly safe. And so, you know, part of the reason, like to understand that is that like, things evolve over time, like society evolves and so checks and balances that once kept things in check could eventually turn into something that actually hurts you. And so you can't just have any static view of what does it mean to be in a safe world. Everything has to evolve. That's why institutions evolve and the government evolves and things like that as society evolves. And in some ways the most safe institution is probably one that's able to evolve because we need to change as everything in the world changes. But it all goes back to deception. And so I totally agree with this kind of philosophical view of things that like, we can't just constantly try to feel safe, it won't protect us. We just have to deal with the reality that the world is deceptive. And this is why non objective thinking is really important. And so then that doesn't necessarily segue that naturally to the question, what am I doing now, but I'll try to go to that because that's really the question that you're asking. I just wanted to acknowledge that part of it. Yeah.
- [50:13]
B
But before you go there, there's a great example from finance, right. And that is in the short term, United States treasury bills are the safest investment you can make. In the long term, they are the riskiest. If you look at the returns to treasury bills versus bonds versus stocks over very long periods of time, Treasuries in the very short term are very safe. That is correct. Over the long term, a dollar invested back in the late 1920s, inflation adjusted, grows to about a buck 80 in treasury bills, grows to about 300 and odd dollars in stocks. So the higher variance investment, which is riskier. Of course it is, but it's. I always use that as an example because what you just said is absolutely true. Trying to. And like, I don't know if you're a fan of David Deutsch, but his book the Beginning of Infinity, he makes this case beautifully. He builds a beautiful scaffolding for if you try to be at, you know, through precautionary principle and just let's lock everything down, that is the least safe thing you can do. Life is a verb, it's not a noun.
- [51:39]
C
Yeah, yeah, yeah. And people always bring up David Deutsch. And I'm really embarrassed to say I still haven't read the book. I have to because everybody says, hey, you must have read David Deutsch, so I should do that.
- [51:49]
B
You should. I think you really. And I would recommend starting with the Beginning of Infinity because what's beautiful about it is he really builds a very robust intellectual framework for what we're talking about right now. He gives it reasons like he has a great quote in there, I'm going to butcher it. But it's like, hey, what were the smartest people talking about in 1900? What were their opinions on quantum physics and the Internet? And his answer was they didn't have opinions on quantum physics and the Internet because it hadn't been invented.
- [52:24]
C
Right, right, right. Yeah, yeah. I mean, it's, I mean this, this security blanket issue is a very serious problem in soc, is that everything is saturated with this need to make everything mechanized so that we can guarantee that we know where we're going, which is all just security blankets thrown on top of everything. And it's just so naive and unrealistic and it's thwarting innovation and actually making the world more dangerous. And I look at it because I was a professor For a long time, the pain point where it often bothered me was in applying for scientific funding because always the National Science foundation or other agencies that can fund research, they want to know what your deliverables are going to be. They ask for like, the impact and like, what's going to happen. And it's like, I just want to be like, I don't know what the impacts are yet. Like, by forcing me to tell you and know what's going to happen, I can't tell you the most interesting ideas I have. And I know they're not going to get funded because I don't know where they're going to lead. And yet, like, the entire, like, funding industry is built on this premise that you can just tell the people where you're going. And it just seems to me it's really irritating and frustrating to me. It's like I'm okay with some amount of grants doing that. Okay, let's have some safe areas where people just do things that are modest that we know we're going to be able to get something out of. But I mean, come on, this is supposed to be about innovation. Like, ultimately some amount of resources should be, should be devoted to things where we don't know where we're going. That has to be the case. But it's just this security blanket culture that just completely saturates everything. And so. So, yeah, I'm hoping the book does a little bit to nudge the pendulum in the other direction.
- [54:04]
B
Well, it certainly did in our case. I mean, one of the reasons behind the fellowship and grant program was because we wanted to do exactly that. I could not more vehemently agree with you about the funding issue, particularly in the sciences, to the point where one of our objectives as we build out our own AI system here at OSV is I want a portion of it to devote it to just developing and publishing automatically to an accessible database for everyone to have access to null hypotheses. Right, because it's like Sherlock Holmes. Right, The Hounds of Baskerville. The only reason that he figured out that they knew the intruder was the dog, didn't bark and via negativia. It just doesn't seem to be in our cognitive firmware. It's just like there's so much richness there and we just avoid it. And your point about the safe funding? I think it has significantly retarded advancements not only in science, but across the board. It's gotten institutionalized, it's gotten group think. There's an omniculture that covers that. And you look around and you think, oh, my God, look at all the advancements in innovation that we made, like, 50 years ago. And specifically in physics and the deeper sciences the last 50 years. Bupkis.
- [55:47]
C
Yeah. But, you know, I think there's an interesting. An interesting thing to think about in what you were saying because you mentioned the firmware. And so, because this. This question is, is it kind of deep in our firmware that we kind of have a desire and need to live this way, or is it just a cultural artifact? And, you know, sometimes I think about children because I think you don't see it in their firmware. Like, you bring a little toddler to the playground, like, they're not going to say, what are my goals for today? Like, I'm going to learn how to climb that monkey bar. That's what I like. And then I'll be better at monkey bars next time. Like, they don't think objectively at all. It's just like, they see a playground. It's just endless opportunities, and that's, like, really fun. And so maybe it seems like to me that it's been beaten out of us culturally because, like, as soon as you start, like, the first grade, then you're basically saturated with goals. Like, this is what you should do. This is what you need to accomplish. And you're taught through reinforcement that, like, if you do the thing that you were told to do because it was your goal, you will be rewarded. And reward after reward after reward over decades. I mean, you just learn that that's how the world works. Because I remember in high school, I remember thinking I had a lot of. I thought, at least to myself, I have a lot of ideas. Like, I would write down ideas when I would have them, but I actually thought that it's not that useful to have ideas. Like, I explicitly thought that. I was like, it doesn't really help you to have ideas because, like, what. How would that help me, like, get. Get A's in school or nobody really cares. It's more like for fun. But it was an absurd thought. Like, that you could grow up thinking that is absolutely crazy. It occurred to me later, like, somewhere in grad school that it actually might be useful to have ideas now because, like, you know, I'm supposed to have a PhD thesis. And that really made me feel good. I was like, wow, like, finally, it might actually be good for me to have an idea. But the fact that it could take, like, 24 years before somebody thinks actually ideas might actually be good just shows there is Some kind of social pathology that is really hurting things. People should not lose that playground mentality completely over the course of life. And the fact we beat it out of them is the opposite of what education should be doing.
- [58:00]
B
Totally agree. Robert Anton Wilson, who was way ahead of his time, called it the installation of the correct answer machine in young minds. And I have six grandchildren and they range from, you know, a little over 1 to 11. And watching the younger ones, I. It's just so obvious to me that you. Your point is well taken. It is not in innate part of our firmware. It's cultural. We, you know, we literally, it's this. I don't want to get on the soapbox because I feel very passionately about this, but like, literally, we beat the creativity, the discovery, all of that which children naturally have. That's the original firmware. And then we spend all of our time beating it out of them. And of course, and it's one of the reasons why I think that the current. I have a thesis called the Great Reshuffle, which is basically that I started, I don't know, 2015, and with the advent of machine learning, with the advent of connectivity, et cetera, that everything was going to get reshuffled. And one of the. It's. We're in the middle of it now. And what. And one of the reasons that I think that you see the established elites of today squawking as loudly as they are squawking is because these new ideas and these, all of that is coming from a much smaller part of society. But guess what? They're going to topple. It's like the whole accreditation thing. I have deep respect for people who have PhDs. Absolutely. And so I hate this binary, oh, you don't have to go to school and all that. Well, yeah, you do for a lot of very serious things. But. But what happens is we tip over into being just slaves to credentialism. And I think that's a mistake. Right. It's like I mentioned to you, our CTO is very young. He doesn't have a PhD, but his proof of work is absolutely extraordinary. You can, if you're a little more open minded, you can find these things that don't have to go up that traditional ladder. I think that's a. We're breaking with that past. But the culture. Culture takes a while to catch up. It's much slower. Cumulative cultural evolution is a lot slower than I think both you and I would like it to be.
- [60:45]
C
Yeah, yeah. I mean, it's almost like I Mean, I think risk mitigation won out over innovation or something like risk mitigation seems to be so popular, even though it's not talked about as if it's possible popular, but it's like it just overwhelms everything. And it's. I mean, people are taught implicitly through school that like, you do things to mitigate risks ultimately, like make sure that you turn out fine and you have, you can protect your family and things. Obviously these aren't bad things, but like, there's this other aspect of the world that like, it's just not really being fostered, which is less objective. You know, it goes back to like the original insights in Pick Breeder. Like, ultimately this has to do with sometimes doing things without having an objective. And by the way, objective is connected to the word metric, because once you have an objective, then you can measure something. So now you have a metric. And so often objectives are expressed through metrics. And these are the grades and the credentials and all those things. It's an attempt to make everything objective so that we just know what's going to happen, where we're going, who's the best person. Everything's being measured objectively. But the problem is objectives don't get you everywhere, especially in innovative systems. So it's true, like selecting a really great CTO with extremely innovative mindset. Like, you can't just look to the credential or some objective measure. It's actually, it's very subtle and implicit. Like what, what actually would make like a real innovator. And so, so, so I think it's. It is, it is. These are, these are really important social challenges to, to overcome just the way culture has evolved. And actually I just want to give one anecdotal story because it just reminds me of this like the. And this really came up when a long time ago when I was trying to start a company and I was a professor at the time, and the person from the university side whose job it was to shepherd the deal because they want to make sure about compliance and things like that was a compliance officer. And this made things unbelievably hard because the only incentive there is just that it complies with everything. And so there's no like, you know, enthusiasm for just how amazing this could be. It's all just compliance, compliance, compliance. And it made almost impossible to get this to actually happen, even though the whole thing had so much opportunity for everybody involved. And I just like think, you know, this is like the whole world is like a one compliance officer Facing you in front of everything before you can actually get to doing anything interesting just to mitigate risk. It's like that's the only thing we're worried about is risk.
- [63:12]
B
And of course we have suffocated a lot of innovation just through the explosion of regulations and rules and laws and everything else. Again, when you say compliance to a guy who made his bones in finance markets, it is the most regulated of many. Not the most, but one of the most most regulated of all industries. And you know, I, I was lucky because I had my own company, I could. Yes, of course we had a compliance officer, but it was not. You're not running things. His name was Ray. Ray. You're not running things. You're here to make sure that no one does anything illegal. Absolutely. But the culture of compliance is. Oh man. I was briefly at Bear Stearns and they were pretty good about it, but you know, when you saw them coming, it's like, okay, here's. Or I went to their offices. I would always joke as I was entering, I'm entering where ideas go to die.
- [64:24]
C
Yeah, yeah. I mean, and I'm not against complying with rules. I mean I'm pretty much. I'm a rule following type person. But I mean it's kind of like the, it's just trying to reduce every single little piece of risk that could exist in the world that is just.
- [64:38]
B
Going crazy and it leads to stasis, which is that.
- [64:41]
C
Yeah, yeah. I mean, so something bad might happen. Like sometimes. Like that's okay. It's not, not always okay. But like every possible failure and misuse of a dollar, it's like sometimes it's just okay. Like that's, that's the cost of like taking risks. So we shouldn't, we shouldn't be so completely averse to doing things that are interesting. So anyway, yeah, it's. I guess we share the discouragement with that stuff. I don't know if I should.
- [65:08]
B
Yeah, yeah. I would love to get on to fractured entanglement representation hypothesis.
- [65:15]
C
Ah, okay. Yeah. That does follow well from all of this because it's the second lesson kind of which is much less known except for that paper that we very recently put out about this fractured entangled representation hypothesis. It's a lesser known thing, but I think it's equally deep and profound, which is that we observed early on in Pick Breeder this other really fascinating thing which is that the underlying representations of the images because remember it was evolved images that were produced by neural networks that the representation of those images was quite Amazing. And if you're not familiar with neural networks, you might, it might not be clear. What does it mean to have an amazing representation? We're talking about the, the way that the image is actually built inside the network, node by node, neuron by neuron, all the way from the bottom to the top. There's a way it's done. And actually we have ways of visualizing, because of the nature of these images, how it's being done. So what are the intermediate images, or you could call them like masks that are used to build up the image. It's very easy for us to see those. And by looking at and visualizing those, we saw that it was incredible. It was like things like. And what I mean by incredible is things like it had separated out the mouth of the skull in such a way that there was a single weight inside the network, means one parameter, basically, that if you change the number on that parameter, you could open and close the mouth. And so it's not just a picture of a skull. It looks like a skull on the surface, but it's actually the underlying mechanics of what it means to be a skull. It's like it's deeper than just a picture. It actually understands what a skull is at some level, or at least some of the components are represented in this way. And in some ways it's like astonishing because it seems like you'd have to be an engineer to think of how would I organize the representation of a skull so that there's a single knob I can pull that would move the mouth open and close, closed. It seems like a human must be involved in this, but it isn't like that. Of course, humans are involved in picking the intermediate stepping stones, but they didn't design the underlying representation. Nobody designed it. That's what's so strange about it. It's just emergent and yet it has this really organized feel, which is as if it was designed. And so that was just an interesting observation. And one thing that occurred to us was that it may be that actually we had noticed that if you run neat, which is also what's in Pick breeder, we talked about NEAT at the beginning to solve a problem, say like to get a robot to go through a maze, if it does solve it. And then if you also run novelty search, which remember is kind of modeled on the non objective way PIP reader works and it solves it. So we have a case here where both algorithm solving it like the novelty version of NEAT and the objective driven version of need, we kept finding that like the the version that solves it with novelty would be three times more compact, which is a very interesting observation. We're not sure exactly why would this be, but like when you try to solve the problem when it's not done objectively. So I guess I shouldn't say you're trying to solve the problem when you're not trying to solve it, but as a side effect of just exploring, you actually do accidentally solve it. Your representation is way more compact than if you actually are trying to solve the problem. And then if you couple that with the observation in PIP reader of these beautiful representations, it's intriguing. So then we should ask ourselves, like, well, much of machine learning as a field is about setting an objective and then using gradient descent or back propagation on a neural network, which means moving towards an objective on purpose deliberately. And much of the field tries to do it that way, like stochastic gradient descent. Maybe those resultant underlying representations are actually pretty bad. And so we thought to, let's see what happens if we try to get the usual conventional way of learning the SGD or stochastic gradient descent to output PIP reader images and just see what it looks like inside. And indeed, it was just terrible. It's really terrible. It's just like a giant mishmash of meaningless blobs which somehow all come together to make the skull, for example. But it doesn't look like how you would decompose a skull. And that's what we called fractured entangled representation. It's fractured. The words have a certain meaning, like fractured, in the sense that things that should be unified together, like the left and right side of a face, are actually broken apart inside so that they're not connected. So it means, like, you could mess up the left side and the right side would do nothing. And so they're not connected the way you would expect them to be because that's what symmetry is. There's a connection there. And so in the fer fractured entangled representation, we'd have this kind of fracture that we could see it explicitly. And it's also entangled, which means that things that shouldn't be involved with each other are. So it's like if you change the size of the eye, like the background changes or something like that. These things shouldn't be entangled at all, but they are. So there's fracture and entanglement all throughout the representation. And then a neat. In the PIP Reader version, which wasn't objectively discovered, it's the opposite beautiful decomposition. Like you could actually understand how it built this thing Just by eyeballing it, like you don't need to be an expert in the field. It's just obvious that it was decomposed into meaningful parts. And so this paper, and we call that unified factored representation sort of the opposite of fractured and entangled. And so this paper just shows this like it shows the contrast visually and says, what does it mean? Like, what does it mean that the way you got to the solution changes the underlying nature of the solution. See, this is about, what this is about is deceptive appearances. It's like both look just as good, like both produce a beautiful skull, the same skull, but like underneath the hood, one is kind of an imposter. It's like a complete piece of junk and the other one is beautiful. And so what does that mean? Like, there's many possible implications. Like one possible implication is that what you could do with that skull going forward is very different. You know, so like to imagine new skulls or new faces or things like that is much easier if the representation is unified and factored than if it's fractured and entangled. And we showed this in the paper that like you can, you can do what we call weight sweeps and see that like it's easy to get new kinds of images that mean something if you have the UFR version, the good version, it's the opposite with the other one. And so that's one really deep point is that like the continued use of these things is impacted, which is really important in the world of LLMs now for large models because what does it say about their potential creativity if they're characterized by fer or fracture and entanglement? We don't know. It's not as easy to look inside these big neural networks and know, but this is a hint it might be like that. And so it sort of raises the question. And the second big question is why is the representation so much better when you find something open endedly without an objective versus when you find it with an objective? What's the reason for that? Because if we understood the reason for that, then we could algorithmically exploit that to make sure that the representation is good. And so I think everybody who's reading that paper is thinking about this now, what is this? How do we abstract this lesson in a way that we can actually formalize? But actually, I wanted to mention a third point because it's the cultural point, which is funny that this comes up again that we can have make a cultural point. But if you think about it, and this is something I've really been very recently thinking about this idea that the way that you got to where you are can matter more than where you are. It's not just about neural networks, that's also about life. Because it's like, who is the person you became even though you're successful as a result of the path you took? That might matter a lot for what happens in the future. And it's not even just about people. Like, it's even like companies. Like the path you took to become a successful company, to have high profit, whatever it is that you're looking for to be a unicorn, might mean that the way you are inside is still fer. So it's still fractured and entangled. And what that means basically is that you aren't flexible and adaptable to change in the world because you came to the solution in a very objective way. And even though you succeeded, you're paying a cost that's invisible right now. And I think that's really intriguing to think about this in the broader social human context than just in terms of algorithmic optimization, that it may have further implications there that the path you take actually matters a lot to who you became and who you actually want to be. Like, who are you on the inside? And so that's something that I could imagine it could be another book, but I'm not exactly planning to write a book right now. But it has kind of the feel of the original book. There's a lesson there that's really interesting.
- [74:27]
B
I am absolutely fascinated by that. I have thought about. I'm a journal keeper and I've kept journals since I was 18 and I'm 65, so I have the ability to look back. And I was looking for a journal, but it's down there buried under some stuff. But what I was going to show you was a graphic representation that I wrote when I was 23, basically what you just said. And it was me at that point and I. And I put all of these tree paths out and one of the notes that I made under it was these, these matter. These will go back and fall back in on themselves and the path that you end up taking is going to matter. It's going to matter. If you took it like the traditional way, I was oriented much more towards the non traditional way of doing things again. When I founded my first company when I was 28, it was an asset management company and I was telling a friend about it and he goes, oh cool, who's your backer? And I went, I don't have a background. And he just looked at me and he goes, jimmy, you're going to fail. And I was like, well, I think that I've discovered some pretty cool things. I'm going to write a book about it. And I think that that book is going to be my calling card. And he just, like, he was about 20 years older than me. He just shook his head and was like, oh, you poor, naive young man. There's. There's no way that that is going to work. But even the book, the first book that I wrote called Invest like the Best, which basically showed that you could back to the idea of people getting obsessed on labels and names. When I first got exposed to the stock market, everyone was talking about the CEO or the company. They were just talking about that particular thing. And I was like a teenager, and I was like, I think you should look at the underlying structure of these companies and see what unites them there. And that was what my first book was about. How you could clone any of your favorite money managers by putting the stocks that they own in their portfolios over time on a big database, sucking out what the variables were. So this manager loves stock companies that have high forecasted growth and low PEs, whatever the combination, and to abstract that knowledge and make it an algorithm. And. But then that gave me the idea, oh, hell's bells, there's no Baedeker guide to. Like everyone says, I like stocks with low pe. All right, show me how they perform. And I went looking, and there was some academic work by French and Fama, but only on price, the book. And that gave me the book that actually did make my career, Walt on Wall Street. And so I love that notion. I really think you should turn it into a book, because I think a. It also has a much broader cultural impact, as you yourself were implying.
- [77:44]
C
Yeah. Yeah, that's a great story. Yeah, it's true. I mean, it's. I hadn't thought about it as much over my life, but it is intriguing and it's very culturally relevant, like how much the path can matter even if you're successful, which just means you met the objective criteria that you were hoping to meet. So it's just another downside of objective thinking. And I was talking to another podcast interviewer about this, and, you know, he was. He often advises founders is what kind of his. His work. His normal work is. And he was saying, you know, like, a lot of founders, they. They get to their milestone, that they do what they were hoping to do, but they're getting divorced and they're depressed, and all their employees hate them, and it's like there's all this other stuff that comes. Which is like part of just being objective. It's like if you're just only objective and you pursue things in the most deliberate, determined way, you have to get to this point, and that's the only point you care about. Like, there's all these casualties in the underlying. Well, in the neural net, we call it the representation, but here it's like the underlying fabric of your life. Just how it's interconnected that's just really. I think it's just very thought provoking, you know, that there's a way to get to a point that's more, that's, that's more virtuous than another. And it's not just about moral things. I mean, it relates to things like creativity, you know, because if you think about like the difference between somebody who became, who got like a great score on some college test, but got there by always following the textbook, always acing all the tests on the road, versus somebody who got there, also did well on that test, but got there through a completely different path of inventing things for themselves, exploring for themselves, maybe having contrarian opinions that they looked into on their own for their own purposes. Like, that person is coming in with a completely different representation of reality. And so the question is like, given these two people who both aced the test, which one is going to have a more interesting future career? And it's probably path dependent. I mean, obviously I think it's probably the more creative path, but even if it wasn't, it still shows path dependency. It's like how you got there is going to affect what you're going to do with that success in the future, what kind of person you're going to be. And there's just endless things to think about there because I think it can kind of diffuse a little bit of objective obsession in the feeling that the only thing that matters is the final metric of where you've gotten. It sort of helps to show why you don't have to feel like that, because I think that's a very stressful way of looking at the world. It's like, this is the only measure of my success to understand that you're not just successful just because you met the metric. There's a lot more to it than that. And actually some of that other stuff is more important. And even if you don't meet the metric, the other stuff could still be good. And so, like, life is much more complicated than that.
- [80:35]
B
Yeah, we have an informal heuristic that we are far more interested in the second of your two candidates, the one who got there in a circuitous or in a very non traditional path. Now, it doesn't always work like nothing always works, but we have found that it's worked pretty well for us when we're working with people. The ladder climber is what I call them. The ladder climber. Great. Good for you. God bless. We're much more interested in the one that is like, huh, I wonder if there's another way for me to get there, that ladder. Yeah. But I bet that there. I bet I could do a very clever thing. It's like the old Prussian general who was asked, how do you determine where you're going to send a soldier? And he had a matrix and the part of the matrix was lazy and clever was his best thing because he said, promote to the highest part of command. Promote and foolish and lazy. They were cannon fodder, but the clever and lazy because they will almost by definition figure out a way to do it more efficiently, more elegantly. Whatever you have. I cannot believe that you and I have been talking for nearly 90 minutes. My producer is just texting me. This has been absolutely fascinating. I hope you enjoyed it as well. I love your work. Everyone listening. Buy his book, read his paper. This is really fascinating stuff and you need to understand it because the world we're going into, I think is going to be. You're going to be a lot more successful. Whatever you want to be doing. If you understand the way Ken looks at the world. If you've ever listened to the podcast, you know that our last question here is always kind of a fun one because it's very different from your perspective, but that is, we're going to make you emperor of the world. You are the emperor of the world and you cannot put anyone in a re education camp. You cannot kill anyone. But what you can do is we're going to give you a magic microphone. You can say two things into it that will incept the entire population of the world. The next morning, whenever their next morning is, they're going to wake up and think, you know, that's really interesting. These two ideas I've just had, I'm going to pursue both of them. What are you going to incept into the world, Ken?
- [83:36]
C
And you said two words or.
- [83:38]
B
No, no, two ideas. They can, they can be. Yeah, two ideas.
- [83:43]
C
Okay, okay. And okay. Yeah. So I. So yeah, first I just want to say that this also was a really fast 90 minutes. I really enjoyed it. Thank you for this. Thank you for this opportunity. And so what do I want to incept into the world? Well, first, just that. Try to imagine what you would do if you had a day where you had no objectives and what would you do? And secondly, sort of going back to the. To the. To the second main insight that we talked about. I think it would be interesting. Well, actually. But I'm supposed to be commanding the world in some way. Is that right? So I need to.
- [84:18]
B
Well, think of you. Think of yourself as more of. You are the world whisperer.
- [84:25]
C
Okay.
- [84:26]
B
Yeah.
- [84:27]
C
Here's what I'll do. Here's what I'll do. All the universities and colleges you can no longer consider grades and admissions. And there's no more grant applications. You're not allowed to make people apply for funding. Figure out how to operate and how to get the right people into the university.
- [84:43]
B
I love both of those. Man, if that would actually happen. Just think of the Cambrian like experience, explosion of innovation and interesting ideas. Ken, this has been so much fun. Thank you for your time. Thank you for the book. I recommend it highly and really delighted to finally be able to have a chat with you.
- [85:08]
C
Likewise. Yeah. Thank you. This was great. I wish we had longer. It was a lot of fun.
- [85:18]
B
Sam.