Transcript
A (0:00)
Jeremy, welcome to Network City podcast. And we've been. We've been friends or friendly online, I think, for a while. You are the. The founder of Fast AI, which is this incredible course that's online. We both taught large online courses, so we kind of have talked about that. You're the founder of Answer AI. Before that, I think you were at kaggle. Right. And you're Australian. You have an interest in biomedicine. And I think we're also into, I mean, peace and trade, broadly, internationalism and so on. Give me the spiel. Did I nail everything? Or give me Jeremy on Jeremy.
B (0:34)
Yeah. No, pretty much. I mean, I say maybe Fast AI. Most people know us for the course because that's how most people interact with us, but that was only one quarter of it. So Fast AI was all about trying to avoid a kind of massive centralization of power and inequality due to what my wife and I saw in 2012 as likely to be a rapid growth of AI. And so we wanted to.
A (0:57)
So similar to OpenAI's mission, in theory.
B (0:59)
Except we actually were open. Yeah.
A (1:02)
At least that was through their initial mission.
B (1:03)
Yeah. So we basically decided to get AI into the hands of as many people as possible, including people with few resources. And so we did a lot of research to figure out how to make AI more accessible, because at that time, only five labs in the world. And yeah, the techniques to actually use AI in practice were not published. They were of like, little arcane piece. Yeah. So my wife Rachel actually asked earlier when he was presenting in like 2012 or something about some of his work, and it's like, okay, so how did you actually do that bit? What weights did you use? You know what fine tuning method you use? He's like, oh, we don't publish any of that. That's our bag of tricks. So we were like, okay, this is not okay. Like, this is. This technology is going to change the world and it requires a bag of tricks that you have to go to Stanford to learn. So we figured out all the tricks and built a lot more tricks of our own. And then everybody then tried to make it all about money. So then Google eventually started creating TPUs and stuff instead of saying like, oh, you can't. I remember Jeff Dean saying, there's no point trying to do stuff with AI unless you're at Google because only we have Skill Compute. Yeah. And we beat them in a global competition to train imagenet.
A (2:22)
Kaggle.
B (2:23)
No, at that Fast AI. Oh, really?
