Loading summary
Transcript1 lines
- [00:00]
Jordan
We have some big news out of Anthropic and that is that they are finally adding web search to their API for their AI chatbot. So essentially if you're using the API, meaning you're a developer or someone that's incorporating Claude's, you know, ChatGPT competitor anthropic chat shipping competitor Claude into your services, you now have the ability to add web results, meaning it has up to date real time data. This makes anyone using the service, it makes it so much better. I'm super excited. I want to break down the costs, what people's responses are, what the use cases are and why now. Because there's a couple other players that have been trying to do some similar things. We're going to get into all of that on the episode. Before we do, I wanted to mention that my startup AI Box, which is currently has Claude on there, is out of is has just launched and is currently in beta. So it has AI Box Playground, which essentially is a place where, where you can access all of the top models, including Claude, ChatGPT image models, audio models, all in the same chat for $20 a month. So instead of paying subscriptions to every platform, you can pay one subscription, get access to all of the models and chat with all of them in the same chat. So you can go check it out at AI Box AI if you have any ideas for new features. We are rolling stuff out rapidly, so check it out and let me know what you think of AI Box Playgrounds beta. And I hope it saves you some money and lets you access some new models you haven't tried or used before. Okay, let's get into what's going on with Anthropic. So they're rolling out the API, meaning I can now add this to AI Box, which I'm excited about, and it has web search enabled. I want to talk a little bit about what they said over on Twitter. If you're watching it on YouTube or Spotify, you can see some of the demos of what it's actually able to do. Otherwise I'll just explain it for everyone on Apple watching. Over on app tweeted out and said web search is now available in our API. Developers can augment Claude's comprehensive, you know, pretty impressive. And they, they are running through essentially asking it to, you know, it says someone's asking it for some help with a typescript thing. It's, it's code, right? Because Claude is used for a lot of code it goes through and it essentially shows that it has some search results. It says to Upgrade your app to TypeScript5.5, recommend the following update and it goes through exactly what it would recommend, but it had to go to a web search in order to respond to the user. So this is pretty exciting. It's getting significantly better now that it can actually go and search the web, especially when you have things that are updating. So the cool thing that I am finding here is that beyond just having, you know, CLAUDE do this, they're actually rolling this out into a bunch of their other tools. So Claude code, for example, which is what we use over AI box to help us write code for our platform, CLAUDE code, which literally replaced a handful of developers for us. One person can do the work of like three developers and probably one designer. They're now adding this there as well. So when we had code that might have just kind of been old and stale, when if something new comes out, cloud code can now actually go search the web and do it. So here's what they said that I thought was pretty cool. They said, with web search enabled, CLAUDE uses its own reasoning to determine whether a search would help inform a more accurate response. CLAUDE can also operate agentically and conduct multiple searches, using earlier results to inform subsequent queries. So this is kind of cool beyond just being able to, you know, go do a web search and be like, hey, look, like we can't find the best information, I bet, you know, we need to do a web search to get more up to date information. That's kind of what the reasoning model is now built in to do instead of just that it actually can act what they're saying, quote, unquote, agentically and say, look, we need to accomplish a series of tasks. We're going to do one web search for that, then we're going to do another web search based off of the information we gathered there to figure out the next step and so on. So they can go through like a handful of these web searches, which is really, really interesting. And some people argue, you know, not great, because they're worried that AI agents are going to take up way too much bandwidth on the Internet searching for things. But I mean, if it's getting someone some information, I'm really not too concerned. Okay, what did they say after that? They said every response using web search includes citations. This is particularly valuable for more sensitive use cases that require accuracy and accountability. You can further control responses by allowing or blocking specific domains. Get started with our docs so they walk through what this actually looks like. But the one thing that I thought was really interesting here was the Fact that they actually are allowing you to have block domains. They say specify domains that cannot be accessed by Anthropic web search tool. So if you only want it to be searching on specific domains, you can do that. But if you also are like, hey, like, you know, not safe for work websites, we don't ever want it to get anywhere near that. Or maybe, you know, we have a competitor and for our specific use case, you know, we're a water supply dongle company. And so anytime someone wants to buy something related to water supplies and they're asking a question about it, we don't want it to ever reference our competitor. We only want it to reference us. So you can say either only reference us or just don't reference our competitors. So there's a lot of really cool things, I think for safety, security, and then also for businesses and just making sure it's a competitive landscape where it's not touching their competitors. I think that's really cool. And I would also make a prediction that if you can build like, like I'm thinking if you can build tools like we've always been able to do, right? Like there's a lot of companies have built like mini apps that just help people do things and they don't necessarily generate revenue. But these little mini apps are like lead generation or other things. You can imagine how valuable this would be. Let's say you build a search engine for or like maybe like a search tool or maybe not. You don't even call it search engine or search tool. It's more just like an AI chatbot that's the best at helping you do music promotion, right? Like some random thing and you just SEO this thing to the top or you get this ranked to the top. People are. Everyone just references you. They know you're the best AI bot to do X, Y and Z. That's a, you know, that gives massage therapists advice or that gives music promoters advice or that gives club promoters advice or like whatever, like some sort of specific use case. There's like a tool that helps that specific type of people. You can imagine how valuable this would be to control and to make yours the number one, because you can essentially block it from accessing any of your competitors and you tip it in the scales of trying to promote your own business. So this is pretty cool. Like I mentioned, Anthropic is now bringing the same web search to Claude Code, which is really cool. Claude code is particularly interesting because it ties into your code base, so it knows the context of your entire code base. Beyond just, you know, like with chat, GPT and a lot of these other places, like people will copy and paste code and be like, hey, like I'm writing some code, it needs to do X, Y and Z. Can you help me to make it a little bit better? And you know, these code tools can write them a little bit of code. Cloud code is extra, extra powerful because it actually has access to your code base. It knows how you write code. For us in particular over AI Box. When we're redesigning a page, we're just like, hey, redesign this page, but make it look like all the other pages on our site with our same branding, color styles and it will kind of bring it over and it looks amazing. So I'm like super, super excited. Cloud Code is in beta. It's a research preview, but we are using it a ton, so I know a lot of other people are as well. Very, very powerful tool and we're super stoked that it's getting access to the Internet as well. So I think a lot of people are going to be excited about this. This is going to be shown off in a lot of different software and I think it's going to have a big implication on, you know, people that build tools and, and are able to block out their competitors essentially from being mentioned in any tools that they're creating. So very, very cool. Again, if you want to check out AI Box, AI Our Playground to test Claude or any other AI model, check it out, the links in the description. Thank you so much for tuning in and I will catch you next time.