
Ken and Preston discuss the gap between AI and physical robotics, echoing Rodney Brooks' concerns while highlighting breakthroughs in tactile sensing and pragmatic engineering at Ambi Robotics.
Loading summary
Preston Pysh
You're listening to tip.
Hey everyone. Welcome to this Wednesday's release of Infinite Tech. Today we're talking AI and robotics and where there's still key areas of development that need some work. My guest is Ken Goldberg, a leading robotics researcher whose work bridges academic AI, real world automation and large scale commercial robotic systems. One of the things we discuss that's super interesting is the assumption that large language models automatically unlock physical intelligence. And this is an area where Ken is really well versed and does a great job explaining what that actually means. We cover what has improved, like mobility and automation and what's still painfully hard like dexterity sensing and real world manipulation. This is a grounded conversation about engineering reality versus expectation. And Ken is a true expert in this field, as you'll see in the conversation. So without further delay, I hope you guys enjoy this chat. Foreign.
You'Re listening to Infinite Tech by the Investors Podcast Network. Hosted by PrestonPysh. We explore Bitcoin, AI, robotics, longevity and other exponential technologies through a lens of abundance and sound money. Join us as we connect the breakthroughs shaping the next decade and beyond, empowering you to harness the future today. And now, here's your host, Preston Pysh.
Hey everyone, welcome to the show. I am here with Ken Goldberg and I am so excited to have this conversation because you are an expert in this field of robotics and AI and it's something that we talk about all the time on the show and it's just exciting to have somebody like yourself here today to talk about it. So welcome to the show, Ken.
Ken Goldberg
Thank you, Preston. I'm excited to talk to you too.
Preston Pysh
So before we started chat and you sent over an article that I think is very pertinent to kind of set the stage for probably most of the conversation we're having today. And it was an article that was in the New York Times and it's talking Rodney Brooks has, quote, unquote, said the field has lost its way. And for people that aren't familiar with Rodney Brooks, he's the former director of MIT's Computer Science and Artificial Intelligence. He's the Rhomba inventor and, you know, running that entire company and product line. And so for him to come out and say something like this, this is kind of a big deal. And I just really want to kind of capture your take on what is he talking about? The field has lost its way.
Ken Goldberg
Well, I think he's very, very respected individual. He's a good friend of mine and I agree with him very much. And I think he's provocative. He's put it in his own words. But. But I sent that to you because I think it's very relevant for us to start this conversation about what's real and what's hype and in robotics, and I have to be careful about the word hype, but I want to say there's a. Call it inflated expectations that are out there, and I understand where they come from. I think people are excited about technology. Everyone. I am too. We all grew up with science fiction and we love it and we love new things. And there has been some breakthroughs. I mean, there's no doubt that the advances in artificial intelligence, in particular deep learning and then generative AI with the transformer model have been transformative in the field, that AI systems are doing things that no one thought would be possible by now. And I will be the first to admit they're capable of creativity, they're immensely valuable. But people then take the next logical step and say, okay, these systems have solved language, so therefore they'll solve robotics too. And that is where I have a lot of concerns. I'm really. We can get into the details, but Rod and I agree that there is not at all obvious that. That what the advances in language in AI will extend to robotics.
Preston Pysh
What would you say is the number one thing that you're seeing that's just grossly out of touch with reality when it comes to the robotics piece being not as far along or it's not coming in? The talking point is in five years, we're going to have humanoid robots doing everything right. So, like, what are the big chunk pieces that people that aren't intimately familiar with the space that you see are missing on that particular topic?
Ken Goldberg
Okay, so let me tell you first of all, where some of the advances have been made. And one of them is in quadrupeds. That's walking dogs, basically, and bipeds as walking machines and navigation and I would call mobility. So the ability to get around with robots with legs has made immense progress. That's been very exciting. And there's no doubt about it, those machines are capable of doing backflips, as, you know, side flips, parkour, all kinds of things that I certainly can't do. Also, huge advances in drones. And so the past decade, we've seen drone technology take off from something that was very experimental, but it's been a number of advances that have made that possible. In both cases, a lot of it has to do with motors and the hardware, but also advances in simulation and the ability, for example, for drones is to stabilize themselves and then to be able to control very accurately the motors on the four or six rotors that are there. And the same is true for robots that have legs or quadrupeds or bipeds. So where these are big, undeniable and major advances. And if you just look at the field, you say, okay, all this is coming and now the next thing we're going to have home robot taking care of us. And, you know, this is around the corner according to Elon Musk. And I'm sure I'm going to get some pushback from some of your listeners are going to say, I don't know what I'm talking about. Okay, I've seen, I've had that happen from of very confident expert, quote, experts from Silicon Valley tell me that. But I've been working in this field for 45 years and I've studied very closely and I understand where the gaps remain for particular manipulation. And manipulation is being able to pick things up, you know, all kinds of things that just happen to be in your environment and then being able to manipulate them, you know, do things. That skill is very, very nuanced and tricky. And it's not clear that the current methods for doing AI is going to get us there.
Preston Pysh
I've heard in interviews, Elon in particular say that the hand, mimicking the hand and, you know, the tendons and being able to have that tactile ability is extremely difficult, is the way he has said it in interviews. But I think, you know, I suspect that when it really comes down to it, what you're seeing is a lot of demos online that you see like this video, somebody picks up a pen and the robot did it. But what's actually happening there behind the scenes, whether that was, you know, a programmed publicity stunt or something that the robot can just do quite well, seems to be, there seems to be a large gap there. So talk to us about where you see that gap and what it is in reality, in your humble opinion.
Ken Goldberg
Okay, so what I. And this is understandable, again, I don't want to say people are naive. I get where they're coming from. They see something and it looks human like. And so they attribute human like qualities to it and skills. I understand that. And by the way, when Elon says the hands are hard, we can produce. People are designing hands that look very much like human hands. That is, they have 22 degrees of freedom and they can move all these joints independently very quickly. And they look almost identical to human hands. So we can reproduce that. In fact, there's Like a hundred different hands that are being produced by different companies in China right now. Okay. So the advances in the hand itself are very sophisticated, but the control of the hands is where the challenge is. And this is where if you have this hand doing this, but then get it to actually tie your shoelace, that is where the challenge is. And this is because we have. There's so many nuances in the interactions that we have with these fingers, with the environment, that we are sensing the environment. We are exerting forces on the environment. And this is very subtle and very nuanced, and we perceive this through a variety of techniques. We have something like 15,000 sensors in our hand, in every hand. Yeah, I know. It's remarkable. We don't even think about it because it's subconscious. But then we also have sensors in our joints, every one of our joints. So we are able to perceive very subtle forces slip. And in particular, one very, very nuanced thing is deformation. So if you look at your fingertips, they've evolved in a really interesting way that those pads are extremely helpful. If you put on, let's say, thimbles on your finger like you're doing your sewing, that makes it much more difficult to do anything you can imagine or just actually a heavy glove.
Preston Pysh
Gloves. Yes, as well.
Ken Goldberg
Right. But we can do these things very, very subtly. We have learned this ability to interact with the forces of objects, that the objects are constantly being moved and deformed. So if you think of the shoelace. Right. That's the object that's being deformed. The fingertip is being deformed as well. This mutual deformation is something that's really nuanced and subtle, and we don't even know how to simulate it accurately. So we can't even simulate the forces and torques and deformations that are occurring. And then we don't have the sensing capab to perceive these nuances. Like, you can feel a shoelace if it's a little bit slipping out of your fingertip. No robot can do that. So what happens is that when you now have this hand and you actually try to execute something, sometimes it works, but a lot of times it doesn't work. And now you have the issue of reliability.
Preston Pysh
Yes.
Ken Goldberg
That is where we're seeing. And by the way, you can see robots all day long picking up stuff off a table and moving it somewhere. That's actually not so difficult if you just want to pick up especially a stuffed animal. By the way, stuffed animals are very easy because you almost can't go wrong. You Just put your gripper anywhere near them and close it and you'll pick up that thing. Okay. Those are like, you know, they're sitting ducks right there. No, this is super easy. Low hanging fruit, let's call it. And that makes it very easy to pick up and move things. But now when you want to start doing things like inserting things like it, repairing stuffed animal by opening it up and getting things and, you know, pulling out the stuffing or sewing it back up, this is totally different and much, much more difficult. Yeah.
Preston Pysh
Your example of a shoelace is really profound because until you, like, take a step back and just think, if I had to design or build a robot to tie a shoelace, I can't even imagine how incredibly difficult something like that would be because it is such a complex task. And I've never even thought about how difficult something like that is.
Ken Goldberg
Well, here's, here's what I know, because shoelace, we all do. We learn when we're young and we kind of do it without even thinking about it. It's a subconscious. Right. I can be on the phone, tie my shoelace. Don't even think. But think about this one. I don't know about you, but do you know how to tie a bow tie?
Preston Pysh
A tie, but not a bow tie?
Ken Goldberg
Yeah, bow tie. Okay. Because I thought you might, because you seem like a fashionable guy. I, I have tried it. It's very tricky. Yeah, it's very tricky business. And it's subtle. You have to be able to feel and pull in all these different directions.
Preston Pysh
Yeah, forget it.
Ken Goldberg
There's no robot that's going to be able to do that for a long time. I would love to have it happen, because that would be something. I would love to have a robot tie my bow tie. And here's another one that's very simple. It's just buttoning your shirt. Yeah, it's actually a little tricky for humans if you think about it, how you have to kind of fiddle with it a little bit to get a button on and off, especially a small button. So that's way beyond robotics. You'll never see a demo of a robot buttoning up a shirt. Well, we're actually working on it in my lab, but it's really hard. Wow.
Preston Pysh
Yeah, it's things that you just really take for granted now when you get into solving that problem. It seems like you mentioned this earlier, that it's almost a sensing issue that we need a lot of developments on the, whatever type of sensors you have in the fingertips or whatever you're using. For the manipulation is that the biggest hurdle right now is in just kind of replicating how our fingertips can have so much sensing capability.
Ken Goldberg
Okay, so that's one. But here's something that's somewhat encouraging for me at least, which is that if you look in the realm of robot surgery, and by the way, there's a lot of misconceptions about that. I give talks when people say, well, robot took out my. My nephew's appendix. And I'll say, that was not a robot that, sir. That was a surgeon using a robot as a tool.
Preston Pysh
Yeah.
Ken Goldberg
To do that operation. Right. So they call it a robot, but it's really a telerobot or more literally a puppet. A very, very important and very useful and expensive puppet. But it's a puppet. And so that's very important to understand. So surgeons can do remarkable tasks. They can sew, Sew up a wound. They can take out an appendix or a gallbladder with these tools. Now, they do not have tactile sensing, Actually, the very latest versions of it, they started to introduce some, but, but, but for many years they didn't. And surgeons are still able to do amazing things. So this is evidence that maybe we don't need to know how to do tactile sensing. It's just a hypothesis. But it says we have an existence proof that manipulation, dexterous, complex manipulation with very complex deformable surfaces. Right. I mean, is harder than tying a bow tie to take out an appendix, that you can do that without tactile sensing. Now, what's fascinating is the way surgeons seem to do it is essentially accommodating the lack of tactile and then using vision. Their eyes, they have cameras in there and they're watching what's happening and they're, they're seeing what happens and that they have a feedback loop based on vision, so they can see very small deformations of the tissues and they sort of. They infer what's going on. This is remarkable because we. This, I think, is the most exciting path to getting to manipulation, which is rather than trying to reproduce tactile. Which is extremely difficult for all kinds of reasons. But I think it's interesting and worth pursuing. But there's another path, which is to understand the visual tactile interactions. And that I think if we can do that, we might be able to get away with just using cameras.
Preston Pysh
Interesting. So this week or last week, I'm sorry, I saw an article that was talking to the difference between Elon's approach, particularly on the hands between him and what figure AI is doing where they put. Right here in the palm, they put a camera. To your point, they put a camera right here in the hand. And Elon is refusing to put a camera in the hand. And the person who posted this was saying this is akin to him not using lidar in the. The cars, because in the end it's going to come down to a cost thing and he wants to force his team to figure it out without additional sensors and for all intents and purposes, cost costs for manufacturing. And he's playing this longer game. Yeah. What are your thoughts on that?
Ken Goldberg
Well, that's a brilliant point, Preston. I'm really glad you made it. It's a very good. The analogy really works there. Elon is very, in some sense, you know, he's very confident. He's done amazing things, understandably, he should be confident, but sometimes that can blind you. So in this case, you know, his decision not to use LiDAR has really, I think, put a limitation on the Tesla driving systems, LiDAR. It can be very helpful for filling in the edge cases with certain conditions when vision cameras can be distorted or blinded by light flares or especially in rain. So LiDAR actually is a great addition there. And also the cost, I don't know, I think it will come down over time. I'm not in the car business, so I defer to his expertise there. But in the same way he has, you know, originally, you might remember when he first started Tesla, he wanted all the cars to be made in with robotic factories. And he had a decree, we will have no humans. You know, everything must be done by robots. And I remember engineers coming in from Tesla to my lab and saying, can you help us? We're trying to do this thing and we can't get it to work with a robot. And he was just, you know, unrelenting. And then finally he said, I was wrong. Yeah, he was wrong. Yeah, he said I, he was, I was mistaken. Humans are underrated. Do you remember that?
Preston Pysh
Yes. Yeah.
Ken Goldberg
So that was really interesting because it was one of the rare times he admitted. But it was also, it was a great example of the idea that you can't do everything right with robots. And even if, if you will it, you know, he can will things into existence. Right. By demanding this. It doesn't always work that way. And so the LiDAR story is very analogous. And I think you're right about the cameras. You know, having cameras in the hand makes a lot of sense. It's not how humans or animals work. Right. They don't have eyes in Their hands. But cameras are something we understand very well. We have very high quality cameras. They're very fast, they're very accurate, and they're really low in cost, comparatively. So I'm. For more cameras, you know, put a lot of cameras in there. Because the other issue is when you walk, it's one thing you have a camera on the head. You can sort of see what's around you. Right. Or drive, by the way, driving. I should have mentioned this earlier, but driving is much easier than manipulation. Because driving, you're just trying to avoid objects, avoid hitting anything. In manipulation, you must make contact with objects, you must manipulate them. Right. So it's very different.
Preston Pysh
To your point, this is really fascinating because, to your point, when you talk about this idea of, you know, if I'm holding a shoelace and the tip of my finger is indented or I can see the compression of that, I can feel it. I'm relying on that touch, like I'm tying my shoe. I'm relying on that sense of touch. But if you were going to try to build a sensor that can do that and you're kind of hitting a roadblock or can't find something that can provide that tactile feedback, I could look at a camera and say, okay, it went in by a half a millimeter. Therefore, it's about this much pressure, and you can substitute that sensing capability through an image or a video of being able to see it. So it's, it is kind of interesting that.
Ken Goldberg
Right.
Preston Pysh
We have figure going that path and. Yeah.
Ken Goldberg
Well, okay, so let me, let me add on to this. So you just made a very nice nuanced point. You said if you wanted just looking at your fingertip and you saw the shoelace pressing into it by looking at the shadow structures and others by a few, you could probably figure out that it was.
Preston Pysh
Yeah.
Ken Goldberg
Slipping away or it was firmly grasped. Absolutely. That's what surgeons do. And they, by the way, work with surgical thread, which is really thin, and they have to use a needle. It's very complicated. Right. But they're doing a lot of this with their eyes, with their intuition. Now, it's not just a matter of putting cameras around, because it doesn't. That doesn't solve it alone. You actually, now, you need to be able to understand that imagery, the video, and you need to interpret that. And that's also extremely difficult.
Preston Pysh
Yeah.
Ken Goldberg
Because humans have this incredible ability and we can't underestimate it. It's just amazing what humans can do.
Preston Pysh
Yeah. So from an inference standpoint, as far as like, if I hold the shoelace this way, I can also kind of just intuitively infer that if it was held 90 degrees from that, that it's going to have this same slipping sensation. And that's something that's really hard to train a robot on versus humans can just kind of like figure it out, like, very easily. Is that what you mean by that?
Ken Goldberg
That's what I mean. Yeah. And it's, here's the thing we have, we don't have good language for describing this. Right. You know, we're trying to. Because it's all intuitive for us.
Preston Pysh
Yeah.
Ken Goldberg
You know, I, I, if you asked me, tell me how to tie a shoelace, right. I'd be like, you know, it's not easy. Right. We don't have language. And that's part of the reason, by the way, this is the, the other issue and I'll come to is the data gap. The gap between the amount of data we have for language versus robots. Maybe this is a good time to.
Preston Pysh
Yeah, let's talk that. Yeah, let's talk this.
Ken Goldberg
Okay. All right. Well, there's a way of quantifying all this, and this is something that I call the robot data gap. And it is, it's the following, that if you put together all of the data that was used to train language models, now it's vast, but it's hard to wrap your head around. How much data is that? Well, my students and I were able to calculate that if you actually look at it. And actually there's another Kevin Black, who's a researcher at physical intelligence. Very, very smart guy. He had the first insight about this, and then we've been taking it a little further. But basically it's that if you added up all the hours it would take you to read a human, average human, to read all the text that's used, that's available to train the language models. Right. So it's all the books that are out there, it's all Wikipedia. It's everything that's on the Internet. If you add up all those tokens, if you will, and then to figure out, well, a human can read at the average speed of 238 words per minute, Right. You can do the math and you end up with 100,000 years. So you could sit down and read everything that's used be a hundred thousand years later, you'd be done, okay, now we don't have such data for robot manipulation. It doesn't exist. It's not like we can just find it on the Internet. The data is very different there. We want to start with vision images, and then end with control signals to the robots. This doesn't exist. So we have to start and basically generate this data. But what we're up against, Right, is it's a hundred thousand years. We're 100,000 years behind the language model. So, again, I'm sort of exaggerating and to make a point, which is certainly there's a number of ways to accelerate that, and I think we can eventually get there. By the way, I'm not saying this will never happen. Please don't get me wrong. I believe it will happen. But my big question is when. I think it's really important to be prepared for the reality. There's a lot of people say, hey, this makes sense. I want this. We should have this soon. And, you know, but remember, there's a lot of cases where people have talked about that in the past. Fusion energy, nuclear fusion. Right. Makes a lot of sense. Sort of. The technology is pretty obvious, but you have to contain this plasma. That seems like a technical issue. We can figure that out. Well, 50 years later, we're still working on it, and it's hard. It's a very. One of these very, very nuanced problems. Another one is curing cancer. When I was a kid, they used to say, we're going to have a war on cancer. Just like we got to the moon, 10 years, we'll solve cancer. We haven't solved it. So there are problems that are extremely difficult and they take much longer than anyone expects. Yeah, it seems like robotics is like that. We don't know. And listen, I'd be the first to celebrate if someone wakes up. I wake up and I read someone has solved it. Right. It could happen. Yeah. And then you'll look back on this podcast and say, Goldberg was completely wrong. No, it couldn't totally happen. But I want to be a voice to say, hey, it might not happen. And let's just think about that and be a little bit realistic, because I know how a lot of people are thinking that it's inevitable, it's going to happen. And any, you know, hopefully by next year, according to Elon and many of his followers. But they have to be ready for that maybe not to happen. And I'm worried about a backlash, that people will say, hey, this whole robotics thing is, you know, was, you know, hocus pocus. And, you know, we're going to move out of this field in droves.
Preston Pysh
I don't. And I don't want to put words in your mouth. So correct me if I'm stating this wrong. I don't think you're saying it's not going to happen. You're just really suspect on the timeline that everybody seems to be.
Ken Goldberg
Yeah, yeah, that's it. That's it exactly. And you know, that's where I line up with Rod Brooks, because for very similar reasons, we have experience. We both been working in this field for like 40. He's been working longer, slightly longer than me, 60, 50 years. But you know, we have a lot of experience with trying to solve these problems and they're, they're much more nuanced than they seem on the surface, especially because a child can pick things up and manipulate it.
Preston Pysh
Yeah, right.
Ken Goldberg
It seems obvious. Why can't robots? It's, it's very counterintuitive. But when you work with these things and you really see their limitations, you start to understand that this is a very, very complex problem.
Preston Pysh
Lets take a quick break and hear from today's sponsors. Have you ever been interested in mining bitcoin? As a miner myself, I've been using simple mining for the past few months and the experience has been nothing short of seamless. I mine with the pool of my choice and the bitcoin is sent directly to my wallet. Simple Mining, based in Cedar Falls, Iowa, offers a premium white glove service designed for everyone from individual enthusiasts to large scale miners. They've been in business for three and a half years and currently operate more than 10,000 bitcoin miners based in Iowa. Their electricity is over 65% renewable thanks to the abundance of wind energy. Not only do they simplify mining with their top notch hosting and on site repair services, but they also help you benefit financially by running your operations as a business. This approach offers significant tax advantages and enhances the profitability of your investment. Do you ever worry about the complexities of maintaining your mining equipment? They've got you covered for the first 12 months. All repairs are included at no extra cost. If you experience any downtime, they'll credit you for it. And if your miners aren't profitable at the moment, simply pause them with no penalties when you're ready to upgrade or adjust your setup. Their exclusive marketplace provides a seamless way to resell your equipment. Join me and many satisfied miners who have simplified their Bitcoin mining journey. Visit Simple Mining IO Preston to get started today. That's SimpleMining IO Preston to get started today with simple mining, they make it simple.
Sponsor/Announcer
Imagine scaling your business with technology that understands your customers literally. That's the story behind Alexa and AWS AI Every day, Alexa processes over 1 billion interactions across 17 languages, all while reducing customer friction by 40%. It's not just about making life easier. It's also about transforming customer engagement and generating new revenue streams. Behind the scenes, AWS AI powers more than 70 specialized models working together to create natural conversations, proving how enterprises can deploy AI at scale with confidence and security. Alexa's AI capabilities were battle tested across Amazon's massive operations, delivering real, measurable impact at scale. These same innovations now give other businesses a proven framework to boost efficiency, unlock new revenue streams and gain a lasting market edge. Discover the Alexa story@aws.com AI R story that's aws.com AI R story the more.
Preston Pysh
Your Bitcoin holdings grow, the more complex your challenges become. What started as a simple self custody now involves family legacy planning, sophisticated security decisions and navigating situations where a single mistake could cost generations of wealth. Standard services weren't built for these high stakes realities. That's why long term investors choose Unchained Signature, a premium private client service for serious Bitcoin holders who want expert guidance, resilient custody and an enduring partnership. With Signature, you're paired with your own dedicated account manager, someone who understands your goals and helps you every step of the way. You get white glove onboarding, same day emergency support, personalized education, reduced trading fees, and priority access to exclusive events and features. Unchained's collaborative custody model is designed to provide the same security posture as the world's biggest bitcoin custodians, but for those who prefer to hold their own keys. Learn more about unchained signature@ Unchained.com Preston use code PRESTON10 at checkout to get 10% off your first year. Bitcoin isn't just for life, it's for generations. All right, back to the show, Ken. If you were, you know, you're a program manager, you're kind of looking at all the different swim lanes to get there. The hand seems to be like one of the, you know, critical path, if you will, for getting there. Is there anything else that you would define as being on that critical path? Or is the hand so far out there as far as difficulty goes compared to everything else that that's really kind of the limiting factor.
Ken Goldberg
Okay, great question. I would say it's, it's not only the, when you say hand, it's the manipulation ability. Yeah, right. Because by the way, I do have another thing to say here, another opinion, which is that we will get much more out of very simple grippers than we Will out of hands that look like human hands. Again, if you look at surgery, the tools that surgeons use to perform an appendectomy are very simple grippers like this, and they can do immensely complicated things. So I believe you don't need complex hands. So I'm not saying that's the path to go. I believe you can do simple grippers. In fact, my company, Ambiorobotics, uses an even simpler gripper, which is a suction cup. And you can do incredible things with them. So it's not necessarily the hardware, but it's the software. It's a control of this nuanced interaction that is very, very challenging. I think many of the other aspects are addressable. We have the ability to tell a robot, go pick up the orange, you know, the orange jumper off the table. We can solve that. Now, computer vision systems are good enough to know that a jumper is a sweater and there's an orange one and it'll pull that up, no problem. But it's being able to actually pick it up and maybe put it on you and then button it up for you. That's where it's difficult.
Preston Pysh
Yeah, yeah. I mean, maybe what we see in the interim is robots that go to market, humanoid robots that go to market, that have simplified the hands or have. But the range of activities or things that they can actually perform is very limited relative to a real human being in there and being able to do it. I don't know if that's how they go to market or not. I want to talk a little bit more about your company, Ambi. So this is really fascinating. So you guys have gone the market primarily focusing on logistics and warehouse type activities for robotics, is that correct?
Ken Goldberg
Correct. So this started about seven years ago. We had a breakthrough in robot grasping and that was just simply ability to pick things out of a bin. Okay, so it's not manipulating, you know, doing surgery, but it's just picking things out of a bin. That is a very old problem. It's been known as the bin picking problem. And people have been looking at that for decades. But we had it. We made an advance. And this was especially the work of Jeff Mahler, who was the PhD student of mine who was the lead researcher on this. And we can go into more details on the technical aspect of this. But the system was called Dexnet Dexterity Network and it was based on collecting data, lots of examples. And it was a somewhat. It was analogous in many ways to imagenet, which was a breakthrough for computer images. So we did something similar. We synthesized this data set, we added noise in a very specific way. But the system started working remarkably well. And so it could pick up almost any object that you put into a bin. It would just pull it out and you would throw in a whole pile of objects. We were digging around in our garages and closets and throwing everything we could into it. And it was consistently just being able to pull these things out. And so that was a very exciting moment for us. We got some publicity, it was in the New York Times and other places. And then we were approached by a number of companies and we decided to and form our own company.
Preston Pysh
That's awesome. I'm curious where you've seen just good old fashioned engineering matter more than additional data or larger models. And then to the converse of that. When did you have data actually really surprise you?
Ken Goldberg
Okay, good. Well, that was. Okay, great example. That was a case where data really did surprise us. We were able to generate 6 million example graphs over because we had collected 10,000 object models and then we could generate grasps on those models. And then we had all these and we trained a network to be able to learn essentially where to grasp an object. So that was a data driven approach. But I will tell you that when you take that and you have to move that into an experimental system or into a commercial system, then you need a huge amount of what I call good old fashioned engineering. And this is where you have to really sweat the details. You have to make sure that the, the sensors are calibrated correctly, that your robot arms are calibrated and accurate. You have to be able to do the computation to move the arms very quickly. You have to control the surfaces of the grippers, the suction cups, myriad of details like that, the lighting, the. We had a little scale underneath the system that would recognize when an object was removed from the bin. It was like a digital scale. It was just another piece of engineering that had to go in there. So lots of all that. That was just our demonstration system in the lab, experimental system. But then when we moved into ambirobotic and by the way, I should. I want to give credit also to the other students who are involved. Matt Mattle was another computer scientist working closely with Jeff Mahler. And then I also had two other PhD students from mechanical engineering and one of them, Steve McKinley and David Geely. Brilliant. All four of these guys, extremely, extremely brilliant engineering students. And so they really knew how to. They were very good friends. They remained good friends. They all worked very closely and spent a huge amount of time camping and hanging out together too. But they were perfectly complimentary because we had the computing skills and the mechanical skills and mechanical guys knew how to design machines that could work reliably over a great period of time. And that's when we moved into building the Ambi Sort system, which sorts packages for E commerce. And this was a little bit. We didn't go in with this plan, but what we saw very quickly was that E commerce was growing and we needed. There's a huge demand for sorting packages, right? It's just very challenging to get packages out to the customer fast. So we started using that technique, DexNet. We evolved it and made it, commercialized it, and then we could make it work very fast. And then all kinds of other elements had to come in. We had another gantry system that would drop it into, pick it out of bins, pick an object out of bin, had to be scanned for a zip code, figure out which bin to go into, then put it into the right bin. Avoid jamming the whole time. Make the system reliable, safe and easy to use. All this is what I call good old fashioned engineering. And so I become a big advocate for this because after all, this is a body of research and ideas and insights that have been developed over 400, 500 years in engineering. And still what we teach at Berkeley and all the major universities, we teach the engineering principles. And my point is, let's not forget about those. Those are still extremely valuable for engineering and getting, and for robots and getting them to actually work in practice. And anyone working in robotics, I think will acknowledge that. Although the public perception is, oh, it's just now, you know, we're using AI and that's solving everything. It's not, it's solving certain little pieces of it. And as I said, there's certain pieces that are very, very difficult that still remain very difficult. So this comes back to what I was saying earlier, Preston, about my fear, which is that because there's so much expectation around Humanoids right now that if the companies can't deliver on that ability, then there might be a big backlash. And that's going to hurt companies like Ambi who are not trying to do that. Ambi is trying to solve a real practical problem and do it efficiently and cost effectively. And actually, you know, basically something that's very valuable for every, everyone who shops at Amazon or any of the online companies, right? We've sorted 100 million packages so far. And I'm very proud of that because these machines as we're talking, are out there sorting packages and they're Very reliable. They're not featured in the videos about. There's no humanoids doing this.
Preston Pysh
Yeah.
Ken Goldberg
By the way. Although some have said that, you know, we'll have a humanoid doing that, but humanoid with hands. It's going to be a long time before that's even close to the efficiency of the systems that we have with suction cups.
Preston Pysh
Let's take a quick break and hear from today's sponsors.
Sponsor/Announcer
You know what sets the best businesses apart? It's how they leverage innovation to turn complexity into growth. That's exactly what Amazon Ads is doing. Powered by AWS AI Every day, Amazon Ads processes billions of real time decisions, optimizing ad performance across a $31 billion advertising ecosystem. The result is campaigns that run 30% faster and deliver measurable business impact at scale. And this is how Amazon itself drives growth. Their agentic AI transforms marketing from a resource heavy process into an intelligent autonomous system that maximizes our ROI and empowers marketers to focus on creativity and strategy. Amazon Ads is proving that AI driven advertising isn't just the future, it's the new competitive advantage. And better yet, every enterprise can apply the same innovation playbook that Amazon perfected in house. See the Amazon ads story@aws.com AI r story that's aws.com AI r story startups move fast and with AI, they're shipping even faster and attracting enterprise buyers sooner. But big deals bring even bigger security and compliance requirements. A SOC 2 isn't always enough. The right kind of security can make.
Preston Pysh
A deal or break it.
Sponsor/Announcer
But what founder or engineer can afford to take time away from building their company? Vanta's AI and automation make it easy to get big deals ready in days. And Vanta continuously monitors your compliance so future deals are never blocked. Plus, Vanta scales with you backed by support. That's there when you need it. Every step of the way. With AI changing regulations and buyers expectations, Vanta knows what's needed and when. And they've built the fastest, easiest path to help you get there. That's why serious startups get secure early. With Vanta, our listeners get $1,000 off@vanta.com billionaires. That's V A N T A.com billionaires for $1,000 off. It's the new year, which means that it's the best time to finally start the business you've been dreaming about. Just a couple years ago, I launched my own e commerce business and Shopify was exactly the tool I needed to get started. While many people continually push off their dreams until the Next year, I am here to tell you that now is the time to capitalize on the opportunities right in front of you. Shopify gives you everything you need to sell online and in person. Millions of entrepreneurs, including myself, have already made this leap from household names to first time business owners just getting started. Choose from hundreds of beautiful templates that you can customize and use their built in AI tools to write product descriptions or edit product photos. And as you grow, Shopify grows with you every step of the way. In 2026, stop waiting and start selling with Shopify. Sign up for your $1 per month trial and start selling today at shopify.com WSB. Go to shopify.com WSB that's shopify.com WSB Hear your first this new year with Shopify by your side.
Preston Pysh
All right, back to the show. After shipping robots that work every day in the warehouse, what's one belief that you held earlier in your academic career that you've had to revise based on that?
Ken Goldberg
Lots. I would tell you one of the things that you know is very interesting is that you think, okay, I have this great new, this technology, that's the breakthrough that really solves an important problem. Therefore I can rush out into commercial world and build a company around it. Well, it turns out that technology is only a very small core part. It enables, but then there's all these things that have to come around it that are equally if not more important. And actually when you go to the customers and you say, hey, we have this new AI thing, they're like, wait a second, I don't care about that. How much money is it going to save me? That's all they care about. And that's business. That's business. Both my grandfathers are business, were entrepreneurs and so was my father. So I grew up in these kind of environments and it's tough, it's tough out there. One grandfather was very successful in electronics and my other grandfather was in the housing business building homes. But my father struggled. He was a metallurgist and he had a company doing chrome plating and it was very, very difficult. And he was buffeted by things way behind his control. Like recession of the 70s actually really hurt his business very badly. So he struggled. So there's a lot of factors and it has to do with competition and timing. What I would also say in industry is that, and this is going to come back to the data aspect, which is that you can do things in a lab that you think are we've really explored the full range of a Problem. So let me give you this example. We were addressing the bin picking problem, remember? And we were dropping all kinds of objects in there. In fact, when people would come to the lab, they would visit and I'd say, well, where you have your car keys, drop them in here. I said, if the robot will pick it out, we'll keep the car. But it would always do that. It was no problem picking up someone's car keys. And we tried it on all kinds of things again, toys we made, 3D, printed, weirdly shaped objects, all kinds of things we could think of. We tried to basically consider everything. And we were just trying to push the envelope, right? Well, the envelope was the keyword because it turned out that one thing we didn't ever really experiment with was bags. Oh, and bags are extremely common in shipping. Yeah, you probably, you know, if you know this, if you receive bags from your. From E Commerce, from Amazon or others, you get bags of all kinds of forms. Now, bags, often plastic or paper. But the problem, the issue with bags is they're loose and so they have objects in them, but there's a lot of slack and they tend to fold in interesting ways. So we weren't testing those really in the lab. That wasn't something that we would have thought about too much. But that's so much more common in real shipping. So my point is, we had to adapt all of our systems to the reality of the consumer market, which in this case is bags. And that was something we didn't have a lot of data on. So we had to adapt our systems to work on data that on real bags. And real bags are very difficult to actually even simulate and model because they fold again. And by the way, the folding matters because if you go to pick up with a suction cup right on top of a fold, as you lift it, the fold will unfold and the suction will. You'll lose the suction and drop the object. Right. So we started collecting data as we started putting these robots to work. So as our customers were putting these systems into production at Ambi. Right. We also had an agreement that we would maintain these systems very at high performance levels because we were constantly monitoring them. So we have a dashboard at the central headquarters in Berkeley where the team keeps an eye on every machine that's in operation out there. And so what we do is we get data on every single pick operation, what happens, how long it takes, whether it dropped the object, whether it was classified correctly, all kinds of things like that. Right. And we use that so that we can Immediately tell when the performance, let's say the pics per hour performance, that's how it's often measured drops. We can spot that early and say, and we call the company and we say what's going on? Did something change? Did a camera get knocked? Is the suction cup getting worn? And so we're constantly on top of it. Part of it is that that's a source of big pride for us. We really customer focused and we want to make sure our machines work completely reliably. But the nice amazing side effect of this is that we've been able to collect data from all this real systems in real environments over the last four years. And we now have elapsed time, 22 years of robot data. So remember I talked about the 100,000 years?
Preston Pysh
Yeah, yeah.
Ken Goldberg
Now we have 22 years though start. Okay. But it's, it's real robot data. It's extremely valuable. It's a high quality, it's the gold standard for data. And so we're now using that to refine our systems and that make them better and more higher performing, more reliable, but also allowing us to now branch out into new related types of products. So we now have, we introduced a new product called Ambi Stack that stacks boxes very efficiently, very densely. And that's a new product that we sold out our first batch of these systems this year.
Preston Pysh
Amazing. On this idea of robot data or the covering this hundred thousand year gap that you're talking about for a company that would be trying to overcome this because the data just isn't there. Are they just having to construct a bunch of physical real world? Going back to the hand example, would they have to have a bunch of physical hands with just a bunch of physical objects to then just be doing this? Or is this something that you think we could simulate in a virtual environment to accelerate that speed or kind of a combo of both.
Ken Goldberg
Good. So for grasping, it turns out simulation is, it works pretty well because there you just need to know the geometry of the environment fairly accurately and then the geometry of the object and the gripper and then you, you can actually model that fairly well. Now grasping is just lifting an object off the table, okay. Out of a bin. That's very different than tying the shoe that we talked about earlier right there. It turns out that we can't simulate that so well, as I mentioned, we don't know how to model and simulate the deformations, the minute forces that are going on in the process of interacting with that object. So that's a challenge. This is a Little nuanced. And I know that your. Your audience might say, what is Goldberg talking about? He said this couldn't be solved. Now he says it can be solved. Well, it depends. There's certain categories of problems that can be solved address. And I think that picking objects out of a bin is something. We've made an enormous amount of progress in the last five years. So I'm very optimistic about that. I think we're going to get. We're getting faster, more reliable, and those systems are, you know, that's the cutting edge of robotics, and it's real. But then tying shoes and doing things around a home, by the way, or in a factory where you're actually trying to put together, you know, electronic parts or car bodies, or car installing upholstery and wiring inside a car. These are extremely difficult, by the way. And they're even in Detroit or anywhere in the world. There's still humans doing those jobs because they're very, very hard. So those are hard to simulate. And I do think everything's pointing toward this. Deformation is a key obstacle to doing it. And I've talked with people who are physicists and experts in deformation, and they agree this is a very, very hard problem if we don't even understand the physics of friction and deformation very well.
Preston Pysh
Interesting. You've said your views on AI creativity have changed. Walk us through some of the timeline and what's changed and just kind of your overall opinion today.
Ken Goldberg
Okay, well, on a very different note, I have been working as an artist as a. In parallel with my work as a. As a researcher and engineer. You know, I like to say my day job is teaching at Berkeley and, and running a lab there. But I have another passion, which is making art. And I've worked on this for almost the same amount of time, and I make installations and projects. We did a project called the Telegarden, where we had a robot that was controlled by people over the Internet. And the robot could tend to garden, a living garden. We put this online in 1995, which was the very early days of the Internet. And I'm very proud of that project because it stayed online for nine years, huh, 24 hours a day, people could come in and explore this garden and plant seeds and water them. So it was a very interesting. It was an artistic project, but it was also a engineering proof of concept, and it had to work reliably. And so, you know, it really pushed us. I sometimes say people think doing engineering is hard. Try art. It's really hard because you have to deal with the public, and they're going to interact and do all kinds of crazy things. So we had to really spend a lot of time designing that system. But I continue an interest in art, and I have a new show coming up. It's a joint project with my wife, Tiffany Schlain, who's an artist, and she and I are collaborating on a exhibition that's going to open in San Francisco in January 22nd.
Preston Pysh
Okay.
Ken Goldberg
All right. So this is a big passion of mine, and it's using technology, like AI and robots to ask questions about technology. And I'm very interested in this contrast between the digital and the natural world, when they seem very symmetric and similar, but there's very profound differences between them. So that's what I think about or I try to express in my artwork. And so your question about the creativity. So I always said AI won't be creative in the sense that you can ask IT questions, but it's not going to actually come up with original ideas. But I actually have shifted my view on that.
Preston Pysh
Yeah.
Ken Goldberg
And I give this example where I asked ChatGPT in the early days, hey, give me 100 uses for a guitar pick. And I just thought it would get, you know, it would start repeating the same thing over and over again. And it, you know, it started with a screwdriver to scrape ice off a windshield, things like that, which are all made sense. But then it started listing these, like, as fast as I could read them or faster. And then it came up with one that I was like, ah. It was a miniature sail for a toy boat. And when I saw that, I was like, oh, my God, that is a genius idea. And I would not have thought of it. And I, you know, immediately when you see something that's original and creative like that, you spot it and you say, ah, why didn't I think of that? Those are those rare ideas, and AI is capable of that now. And so it's very exciting.
Preston Pysh
Yeah, it is exciting.
Ken Goldberg
It's super exciting. So I'm not in. I'm not negative about AI at all. I love it. I use it. I advocate for it. My daughters, my wife, everyone uses it. And so I'm 100% for it. I do think it's going to help with robotics, but the question is, is it going to do everything that people are hoping? And that's. That's where I hope that this conversation, Preston, will put things into context for your audience.
Preston Pysh
So I don't know if you're going to like this question or not, but I'm going to Throw it over. Because I'm curious what you would think of this. So figure AI recently sold their humanoid robot to put into the home. And there was a lot of pushback from, you know, at least the comments that I saw online that this was just a giant marketing scheme or maybe they're trying to raise their next round. I don't know. But for the audience, I'll just kind of frame it. It's a humanoid robot. All the demos that I've seen to date are extremely suspect as to its ability to, like, actually do anything in the home. When you dig into it more, they were using, you're putting this thing in your house. And then I guess that it has this ability to, like, go back to a human that would actually be manipulating the robot inside the house, which I think has all sorts of security, privacy issues and everything else. Right. But the reason I bring this up is because I don't know if he's. I'm pretty sure he's the founder and CEO of the company. He was suggesting that in order for AI to really start to accelerate its learning, that it needs to start being embodied into the physical form and to put itself into a challenging learning environment. And what he means by some of this, and Ken, correct me if I'm wrong in the way that I'm describing it, but what he's getting at is there's all these ambiguous situations that happen in the household with respect to social dynamics, the way that the family would interact and what they would ask of the robot, like, hey, go get me a cup of water. And then the person who's asking for it always likes it half full, or they like it warm or they like it cold or whatever. And so that learning that the robot would be forced to kind of undergo from a social dynamic would assist in its ability to get smarter collectively. Because I'm sure all this information is then going back up into the mothership and getting networked. But his argument is the point of my question, which is, do you also agree that for AI to kind of take this next step or this next quantum leap from where it is today, that it really needs to be able to immerse itself and basically partition itself into the physical form?
Ken Goldberg
Well, I think that is helpful. And certainly understanding the dynamics of human interaction, especially in a home, is the social dynamics are very, very subtle and as you said, very, very important. Just understanding tone of voice, gestures. Like my daughter will say, you know, does this.
Preston Pysh
Right.
Ken Goldberg
Which is, don't bother me, teenager.
Preston Pysh
Okay. Or just rolls her eyes. Right. Like that oh, yeah.
Ken Goldberg
The rolls rise. Oh, yeah, yeah.
Preston Pysh
The subtle body language is super complex when you think.
Ken Goldberg
Super complex.
Preston Pysh
Yeah.
Ken Goldberg
We pick up on it in a myriad of ways we don't even recognize. Right. Like I can pick up if one thing I always notice is when I'm teaching, I can pick up if students are starting to lose interest or get tired or bored.
Preston Pysh
Right.
Ken Goldberg
Yeah. I just feel it, you know, I look around, but I'm always watching. That's why it's too tricky to teach online. But all these things are very nuanced. Body language can tell you a lot of what's going on. And just interpreting what's the dog doing? And what's the dog, you know, how's the dog feeling? Right. There's a lot of nuance there. So all that is you're gonna, you have to be in real homes to be able to do that. And I think that's actually, that makes sense. I'm not opposed to having, let's say a humanoid in a home that might be helpful for doing certain things like maybe fetching water or being able to pick up things around the house. Remember grasping? I said, that is actually something I think robots can do. So if you said, hey, pick up all the things that are on the floor, we would all like that. We have a Roomba. You mentioned earlier the vacuum cleaners. But the next step is to be able to actually pick things up and put them away. Yeah. And that I think we can get there. I do. I actually think that's going to come. That can happen in the next decade. And it's very valuable because, by the way, if you're a senior citizen, you really want things off the floor. And if you're a young parent, you have a lot of kids. You have kids. Or if you have a teenager, there's like, can you clean your room? You know, great to have a robot go in and just clean off the, Pick up all the clothes. We call that the teenagers problem. By the way, we have a paper which is how to get a robot to efficiently pick up clothes. And it's not the obvious thing because if you just program a robot and go in and pick up one sock, take it to the bin, to pick up the next stock, take it to the bin, you actually need to be able to pick up lots of socks together. And so how do you do that? That's called multi object grasping. It's a very complex and nuanced topic. And so we're studying that in the lab. So just coming back to your bigger point, I Think that robots will do something useful in the house? I think that's possible. They could be useful for security also, maybe in some form of companionship somewhere down the road or as you get older. And I can appreciate this more and more that I might want to have a robot that might help me, you know, shower or get changed or help me get out of bed in the morning. I think that would be nice. I'd rather have that than a stranger in my house. Let me put it that way. Right.
Preston Pysh
I just not relate, just not one that's network back to some other person on the controls.
Ken Goldberg
Yeah, right. I mean, well, that the privacy issues are huge. And that's something also a lot of engineers don't appreciate that. I faced this at Berkeley a few years ago where I was talking about privacy and I made an art project about privacy. And we had cameras, surveillance cameras. We did a whole installation about this. And some of my friends were like, I don't care about privacy. I have nothing to hide. I said, oh, really? I said, okay, can I see all the letters of recommendation you wrote for the last 10 years? Oh, no, I'm not going to share those. I said, okay, how about all the research proposals that you're working on? Oh, no. Yeah, right. So all kinds of stuff that you don't want to share. It's not that you're hiding, you know, it's not even doing something criminal or embarrassing. But you just. There's a lot of stuff you don't care to share because it's important and it's confidential. So same as in your home, you know, you don't just. It's not that I'm gonna, you know, it's gonna catch me naked, but in the morning, you know, I have bad hair day. And I don't necessarily want that to be transmitted widely. So it's all kinds of things like that. So I'm not opposed to humanoid robot. I think it's going to be interesting to see what happens in the next few years, that we will probably start to see these. It'll be very interesting to see that roll out from figure. And Berndt is very. He's a very compelling businessman like Elon, you know, he has a lot of optimism, a lot of confidence, and he's definitely building something that's working to some degree. So it'll be interesting to see. And, you know, I'm not a naysayer. I'm not saying that all this is going to fail. I just say that be patient. Yeah, it's going to take longer The. The real science fiction stuff is going to take longer than we think.
Preston Pysh
Last question I got for you, Ken. What's the most exciting or surprising thing that you've seen in the lab or just in the space in general, that you almost gasped when you saw it in the past? Call it year.
Ken Goldberg
Okay, so actually I have a good answer for that. You know, I'm so proud of Ambi for being able to sort packages around the clock at a very high speeds. Right. But I recently saw a company called Dyna Dyna Robotics.
Preston Pysh
Okay.
Ken Goldberg
And I'm friends with the founders, so I'm maybe slightly biased, but I have to tell you, they demonstrated folding napkins with a robot.
Preston Pysh
Okay.
Ken Goldberg
And they did it for 24 hours. So they just had the camera set up and they had. Now this is, by the way, just two grippers.
Preston Pysh
Two grippers. Okay.
Ken Goldberg
Right. No head, but it has cameras, but there are two grippers basically holding a stack of napkins over and over again. And they did it for 24 hours and they showed you the whole process. Now that, to me, as a roboticist is a big deal because they were able to do it fairly fast, reliably. The napkins were, you know, often get tangled up and it would figure out how to untangle them and keep going. And the folds were actually pretty nice. So that's impressive. And then I got to see a live demo of the new version of that, which can now fold shirts. And it worked really well. I saw this in a. They had a booth in a conference in Korea in September, and it was folding shirts as it just round the clock. And it was fantastic. Even you could bring your own T shirt and it would fold it. So that, to me, that's very exciting that that shows. And again, it's a specific task. I do think we're going to make progress there. And by the way, everyone wants to have something fold their clothes.
Preston Pysh
That's for sure. That is for sure. I'm so bad. I know I'm so bad. I got one of those little folding.
Ken Goldberg
Oh, you do?
Preston Pysh
Yes, I do. Because I'm so bad at folding it. But when I use that, I'll actually, you know, do it. Okay.
Ken Goldberg
You have a folding board. Okay.
Preston Pysh
Yes, I do. And I'm sure that you're going to.
Ken Goldberg
Be a great customer for this, but you have high standards because you want the things just right. And that's where it gets tricky. But the Dyna Robotics guys, it's Jason and Lyndon, who are the leaders of this company, they really are pulling something off. And I think it's very interesting to keep an eye on and a lot of the other robotics companies are now trying to emulate that, which is to show one task, one special task, doing it very reliably, making coffee or folding boxes. That's really exciting. And I think that is actually going to be important rather than trying to do general robotic do everything in a home, which is I think going to take a long, long time. But if you get it to do certain tasks like folding laundry or maybe making coffee, certain things like that, that's a way sort of bottom up from certain tasks, learn other tasks rather than top down. I think that's going to be a path to getting progress. But again, it's going to take longer than most people think.
Preston Pysh
Ken, I can't thank you enough for making time. Your expertise is just off the charts and I know the audience is going to love this. If you have anything else you want to highlight or point people towards that we can put in the show notes, you know, just let us know what that is.
Ken Goldberg
Okay, I'll send you some links because I have a bunch of things online I can link to with that. Follow up on this in various ways and no, I think it's great. Thanks for doing this. I'm really glad you're also going to connect with my good friend Rich Wallace.
Preston Pysh
Yes, yes.
Ken Goldberg
Because he is fascinating. You know, he's a very, very original thinker and very, I would say very much an unsung hero around chatbots. People don't know. He was really a pioneer in doing this very early and he still has a lot of great, really interesting insights and ideas, so you'll appreciate.
Preston Pysh
Amazing. All right, well Ken, thank you so much for making time and coming on the show.
Ken Goldberg
My pleasure.
Preston Pysh
Preston, thanks for listening to tip. Follow Infinite Tech on your favorite podcast app and visit theinvestorspodcast.com for show notes and educational resources. This podcast is for informational and entertainment purposes only and does not provide financial, investment, tax or legal advice. The content is impersonal and does not consider your objectives, financial situation or needs. Investing involves risk, including possible loss of principal and past performance is not a guarantee of future results. Listeners should do their own research and consult a qualified professional before making any financial decisions. Nothing on this show is a recommendation or solicitation to buy or sell any security or other financial product. Hosts, guests and the investors Podcast network may hold positions in securities discussed and may change those positions at any time without notice. References to any third party products, services or advertisers do not constitute endorsements and the Investors Podcast Network is not responsible for any claims made by them. Copyright by the Investors Podcast Network. All rights reserved.
This episode explores the real progress and persistent challenges in robotics and AI with Ken Goldberg, a leading authority whose expertise bridges academic innovation and large-scale commercial deployment. The conversation confronts the public perception that humanoid robots are just around the corner and demystifies the engineering realities, especially in manipulation and “physical intelligence.”
“This is a grounded conversation about engineering reality versus expectation. And Ken is a true expert in this field.” – Preston Pysh (01:25)
Notable Quote:
“People take the next logical step and say, okay, these systems have solved language, so therefore they'll solve robotics too. And that is where I have a lot of concerns.”
— Ken Goldberg (03:07)
Memorable Analogy:
“If you put on thimbles on your finger... that makes it much more difficult to do anything... or just actually a heavy glove... We can do these things very, very subtly.”
— Ken Goldberg (08:45)
Notable Quote:
“LiDAR actually is a great addition there. And... he [Elon] was, I was mistaken. Humans are underrated.”
— Ken Goldberg (15:32–16:54)
Notable Quote:
“My big question is when. I think it's really important to be prepared for the reality.”
— Ken Goldberg (22:01)
Notable Quote:
“I always said AI won’t be creative... but I actually have shifted my view on that.”
— Ken Goldberg (50:18)
Memorable Quote:
“Rather than trying to do general robotic do everything in a home, which I think is going to take a long, long time... if you get it to do certain tasks like folding laundry... that's a way—sort of bottom up...I think that's going to be a path to getting progress.”
— Ken Goldberg (60:36)
On Reality vs. Hype:
“It seems obvious. Why can't robots? It's very counterintuitive. But when you work with these things... you start to understand that this is a very, very complex problem.”
— Ken Goldberg (24:21)
On Innovation:
“You think, okay, I have this great new technology, that's the breakthrough... turns out that technology is only a very small core part. It enables, but then there's all these things that have to come around it that are equally if not more important.”
— Ken Goldberg (40:33)
On Creativity:
“And then it came up with one that I was like, ah. It was a miniature sail for a toy boat. And when I saw that, I was like, oh my God, that is a genius idea... AI is capable of that now.”
— Ken Goldberg (51:06)
Further Reading / Resources:
Links to Ken Goldberg’s work, Ambi Robotics, and Dyna Robotics will be included in the show notes as referenced by Ken (61:11).