Transcript
Jaden (0:00)
We have some major news this week out of Anthropic that Connor and I are dying to tell you about. So there's a few things. One of the biggest things is that Claude's new LLM is beating OpenAI on certain benchmarks. GPT 4. This is actually very hard to do. It's kind of been interesting and something I've almost laughed about over the last year, that everyone that comes out with an AI model, they, like, put the benchmarks of themselves versus GPT 3.5, because no one even wants to compare themselves to GPT 4. We're now getting to a point where these models are getting better than GPT4. Of course, OpenAI is probably going to launch GPT5 soon, so, you know, like, you know, hold your horses. But this is amazing. Claude is doing it. Claude's an amazing model. In addition to this, they announced something absolutely insane, which is a 2.5 or 2.75, $2.75 billion investment from Amazon. So, yeah, Connor, what have you been seeing here?
Connor (0:51)
Jaden, where do you even begin on this? Anthropic is having itself a week. You know, this past week it was bonkers. I mean, so first of all, Jaden, we were talking about it was kind of a weird, quiet week for a little while there. And then Amazon kind of comes out and tells the world that they're doing 2.75 billion into anthropic. And they might have been reading the tea leaves a little bit just because you and I and a lot of other people got access to Claude 3 whenever that was a couple weeks ago. And I'm hearing just, just from anecdotally, but certainly I'm experiencing Claude 3 is just so, so good. And. But here's the interesting thing, right? A lot of different places to take this because Amazon, this was its largest venture investment ever. And when you're talking about that with Amazon, like, that's pretty serious. And so just the implications of that for, like, what they're offering, like enterprise users and through Bedrock and through, you know, their cloud provider, all that kind of stuff, like, they're clearly, you know, making a really, really big bet in Anthropic. Of course, Google has also made a big bet frame Anthropic early on, I think. Again, I think Google is invested. I think it was like 300 million back when the valuation of Anthropic was very low. But the thing that I'm again, sort of like the most interested in, in a way, is this chatbot arena leaderboard. And Jaden, you Kind of hit the nail on the head, right? Like, it's. You see these things and everybody's kind of creeping ahead of everybody else. But ultimately, you know, it's interesting. It gives you a good benchmark. ChatGPT4 came out a year ago, guys, so obviously OpenAI is still, you know, kind of the OG on this. But my thing for this is when I saw Claude 3 up there, it was like one of these moments in the movie where it's like, wait, there's a new leader for the first time in 40 years? Or it just felt like that moment. And so when I saw that, it. That was interesting. But even maybe more interesting was, that's Opus, right? That's the paid version, which I pay for. But then there was also Haiku, which is their small. They have Opus Sama and Haiku, and. And Haiku was beating an old version of GPT4 as well. And when you think about the efficiency of all this, and Jaden, I know with AI Box, by the way, I love the new AI Box hat. Gotta get that merch out there. But something like, you know, for developers, when they see something like this, a small, really reliable model that's way more efficient and way cheaper, even that feels really exciting. No?
