C (17:05)
Yeah, so there was a really. There were. There was a really cool insight. Actually, recently there's been another insight. There's actually two really deep insights. But. But the more famous one that's, that's been around for a while is this insight about objectives. And so it's happened because, you know, after the. After Pick Breeder was around for a couple of years, you know, it's worth noting that, like, we didn't really have a hypothesis. Like, what's the scientific hypothesis? Like, a lot of people think the scientific method is you have a hypothesis, then you do an experiment. This didn't work that way. This is more like, let's just do the experiment, then we'll figure out what the hypothesis should be. Because I was sure that, like, if you just crowdsource the whole world in this complexifying space, something interesting will happen. I wasn't exactly sure what, but I was sure we would learn from it. Part of the reason is because, like, a real challenge with evolution on Earth is that you have to go into the fossil record to actually know anything about what actually happened. It's like digging in the dirt. Enormous amounts of effort is involved and not everything in the chain is even findable. And so, like, there's an. There's a poverty of information to really reconstruct the entire chain of events. But what's really cool about Pick Breeder is that we do know everything. There's no digging in the dirt. Everything, every single step of every single choice been recorded. And so that made me think we're going to be able to extract like a really deep lesson here. I don't know what it is, but we will. And indeed that's what happened. And it happened in a way that I didn't expect. But basically what happened was I was playing with Pick Breeder myself and I saw an alien face. It looked like E.T. from that movie E.T. the 80s movie, if anybody knows. It looked a lot to me like E.T. and I thought. And someone else had bred this face. So it wasn't me, but it was on the site. So I thought, oh, this would be fun because I can get more aliens because that's kind of how it works. Like, once somebody finds something, you can get variations of it. So I was like, let's get variations of ET And I was playing this game. But then this really weird thing happened, which is that his eyes, they started to descend, like down, down the face. And I suddenly noticed it looked like wheels. It's like he has a really kind of flat face or thin. And so when the eyes went to the bottom, it looked kind of like a car with wheels underneath. And it struck me that I was in car space now, no longer in alien face space. And so after that, I could steer it to something that looked pretty, pretty well like a car. And you may think, well, great, good for you. You found a car. Like, what's so exciting about this? But actually, to me, it was a huge epiphany. Life altering, actually. It turns out I maybe didn't know at the time would be life altering, but it was, it was huge because I started to become obsessed with the observation that I wasn't trying to get a car. I hadn't been thinking about cars. And it occurred to me that if I had been, if I had wanted to get a car, I would not have chosen that alien face. I would have thought, there's no way that's going to become a car because it's a face. But it turned out I did need it. And the only reason I get it is because I wasn't trying to get a car. So I was thinking, how could this be? Because it seemed to defy a lot of lessons I'd learned in engineering and computer science, that the way you actually accomplish things in this world is that you set a goal and then you move towards it deliberately. And this is like a really deep cultural thing. It's not just in computer science, but it's like across our culture. In fact, I would say it's the world culture. It's not just like Western culture, it's the whole world is like this now. And I was thinking, here's a case where the only way to achieve this thing would be to not be trying to do it. And so I thought, okay, let's see. Now I'm curious, like, how often does this occur in Pick Reader? Like in the history of all the images that have been discovered. You know, we've got butterflies and skulls and planets and other animals and faces, and there's all kinds of stuff there. So. So we said, okay, let's go back and look at the history. And it turns out that almost every single time, this is the story like you might. You would think, I mean, I would probably thought that this is some kind of like lottery win, like where it's like extremely lucky. Like this would never happen again, like a huge coincidence. But actually it's always what happens is that somebody finds something that does not resemble the ultimate discovery, but then the person who makes the ultimate discovery branches from that serendipitous discovery and realizes that this leads to something else and then is opportunistic and gets that other thing. And so it's not an exception, it's a rule. Like, that the only way to find things in pick breeder is to not be looking for them. And so that kind of generalized this observation that this is actually a general principle. So then I became obsessed with this after we saw that, because I was like, this must mean something deeper than just pick reader. What does this mean? Because it violates everything I've ever been taught and it seems to be a principle. And I started imagining weird things. I was thinking, imagine trying to learn how to race a car, because a lot of neuroevolution or evolving neural networks with NEAT was involved. Stuff like trying to teach cars to go around simulated racetracks and stuff like that. So I was thinking, what if instead of trying to get it to go around the whole track, that's the objective, we just imagine that we just say, keep trying to do new things. So it's like you crash into one wall, but you say, don't do that again. So it crashes into another wall. But I was thinking if you just kept playing that game, it would eventually drive around the track. Even though you never told it to drive around the track, you never rewarded it for going farther. It's just that in the process of trying to find interesting new stuff, it's inevitable that eventually you have to learn something about the world. Because eventually all the silly things to do that are just trivial to find would be exhausted. And then you're going to be forced eventually to find something interesting. And I think that's sort of a description in a way of what's happening in pick breeders. Like, people were finding things like circles and lines and curves and things that are not very interesting, but as they increase in complexity over time, they're just trying to look for anything more interesting. And then when they find something, it becomes a stepping stone. And then more interesting things can be discovered from there. Just like the alien face leads to the car. And so after several months, probably obsessing over this, I started to think there's an algorithmic basis, like we could actually describe this process. And we ultimately called it novelty search. I did that work with Joel Lehman. It's actually, in fact his like, first day of grad school. I remember I was, is like a few months after this revelation, and I just like poured this whole point onto him. Like, I just overwhelmed the poor guy. He's like, it's his first day. And I was like, you don't need objectives. Like, we could just do amazing things, like just looking for novelty. And like, this is so exciting. And so he, he, he was, he was very nice and kind of like grabbed onto this point and see if you can actually implement this as an algorithm. And it turns out it was, it turned into the novelty search algorithm, which was, which was impactful within its field. And in some ways, though, I view it as a validation of a deeper point philosophically rather than just like an algorithm that has utility. It's more important, I think, for the deeper point it makes, which is that novelty search often discovers a better solution to something than the alternative version, which would be trying to solve the problem, which is so paradoxical. And so some people think that, oh, well, you know, what are you. You're saying basically that the best way to solve your problem is to put novelty search on it? But that's not my point. Because novelty search, clearly, without any clear, distinct objective, cannot be guaranteed to solve any particular problem. It has no particular goal. Rather, I think the lesson is that it's extremely embarrassing and concerning that often it does solve the problem better than something that actually knows what it's trying to solve. And it should make us all very concerned about the actual downside of being too obsessed with pursuing a singular objective.