← All TWiT.tv Shows (Audio)
All TWiT.tv Shows (Audio)
Hands-On Windows 156: Copilot Mode Arrives in Edge
00:14:18
A Glimpse Into Microsoft's AI-Powered Browsing
Loading summary
Transcript14 lines
- [00:00]
Paul Thurrott
Coming up next on Hands on Windows, we're going to take a look at Copilot mode in Microsoft Edge and whether it competes in any way with some of the new AI browsers that we're seeing.
- [00:10]
TWiT Announcer
Today's show is brought to you by Progressive Insurance. Do you ever think about switching insurance companies to see if you could save some cash? Progressive makes it easy to see if you could save when you bundle your home and auto policies. Try it@@progressive.com Progressive Casualty Insurance Company and affiliates. Potential savings will vary. Not available in all states. This episode brought to you by Red Canary. When cybersecurity threats hit fast, you need an MDR partner that moves faster. Red Canary delivers 24. 7 expert MDR support, total visibility and actionable insights. Plus it helps you detect four times more threats so you can stay ahead with without burning out. Red Canary clears the noise and has your back every hour, every incident. Get the backup you deserve. Visit redcanary.com difference to learn more.
- [01:05]
Amazon Music Announcer
From unsolved mysteries to unexplained phenomena, from comedy gold to relationship fails, Amazon Music's got the most ad free top podcasts included with prime. Because the only thing that should interrupt your listening is, well, nothing. Download the Amazon Music app today.
- [01:30]
TWiT Announcer
Podcasts you love from people you trust. This is twit.
- [01:40]
Paul Thurrott
Hello everybody and welcome back to Hands on Windows. I'm Paul Thurant and this week we're going to take a look at a new feature in Microsoft Edge called Copilot Mode. Now, we just did, I think, three episodes about Microsoft Edge fairly recently, pros, cons, different ways to configure it, and so forth. But now we've got this new thing coming. So this is Microsoft's early response to some of the first AI powered web browsers that we're seeing out in the world. Things like Neo and Neon actually, and Dia and Comet from Perplexity, et cetera, because it's from Microsoft. It's a slightly more conservative approach to AI in the browser, but I guess that's to be expected. So basically this new feature impacts two things. One is this new tab page that we're looking at here, which is the standard new tab page that I've kind of cut down some of the junk on. And then the other is the Copilot button up here and how that works, right? And so if you think about Microsoft Edge today and you want to use Copilot for some reason, this opens up into a sidebar, right, as you see here. So you will be offered Copilot Mode, the First time you upgrade Edge to a version that supports it, I've disabled it. So you can kind of see what that looks like. But the way to turn it on is just to go into settings, AI innovations, and then just turn it on. And when you do that, the new tab page changes. So this is the dark mode version of it. In light mode it's more of that kind of light tan copiloty kind of look and feel, but there you go. So this in its own way is actually already an improvement, right? Because the default new tab page in Microsoft Edge is pretty busy. I toned it down like I said. But I also typically use a third party extension as a new tab experience and when you enable this mode, it actually overwrites that. So it disabled that extension in my case and it will for you, whatever one you happen to be using. So there's this, and this is what it looks like. You know, you've got this kind of Copilot chat experience. It has a few suggestions here and then it has these quick links to sites that have used a lot. This is not particularly configurable. If you go up into settings here, you can turn it on and off. So either want that on or you want it off. There's no way to go into an individual one and say, well, I don't want this, or add a new one. You know, maybe that's something that changes over time. I think it's fair to say this is going to get a little more full featured and convoluted as we go, but this is what we've got right now. The other big change is the copilot button moved. So I know that doesn't sound like a huge change, but the overall experience is also different. So in addition to not being over here in the corner when you click it by default, actually we'll get this thing which is a kind of a quick action view or a quick link view. And it's not movable, you know, you can't drag it around, you can't resize it, you really can't do anything with it. And I kind of prefer the old side pane approach frankly, because it sits side by side with the page you're viewing. So if I were to go to my site, for example, and load an article because I might want to interact with it for whatever reason. Let me find one that's reasonable in length and let's see, maybe this one because it's an AI browser story. So when you bring up Copilot here, you know, one of the things you might want to do with this is, you know, create a summary of this page like we have here, which is fine. It works well enough. It's. It's okay. But it is also over the article itself. So if you prefer that old style, you can pin it. And that's what I had done before, actually. So if you like to have this side by side, and I do actually kind of prefer this, you can get that experience back. So that's good. I'm going to put it back the way it was, just to give you the default experience. But okay, so that's kind of interesting. Also some keyboard shortcuts involved here. So let's see if I can remember this correctly. In previous to copilot mode, it was control shift comma but now there's a new, simpler keyboard shortcut that will be easy to remember, which is just alt C. So it does the same thing. You don't see me typing the keyboard. Keyboard shortcut, but all plus C copilot. Right. That's kind of a simple one. And that brings that thing up in a simpler way. So as far as the UI change, whatever, it's still the same copilot experience. It's just in a different place, slightly different ui, et cetera, et cetera. It's fine. There's just a few other changes that are interesting and then there's some new functionality. And I think this is the area where it's really going to expand a lot. I don't want to suggest that this is innovative, but in the past when you did new tab in Edge, so Control T, if you started typing, you would be typing in the address bar. And by default now when you do new tab to this experience, you can see I'm typing in the chat box, right? And at first this was a little alarming to me, but actually you can just type Control L or probably Alt D to get back to it, right? Which is. Are the standard shortcuts for accessing that thing, you know, the address bar. So if you intend to use the address bar normally, like I might and just type, you know, website address like I just did, that still works, but you can also just do it from the chat box. So it's. It's a little smart in the sense that if I just type something like throt.com there it will go to the website, but if I type something that's clearly a query when you know this will already have happened by the time you see this video. But when will Apple announce new iPhones? This will actually launch a chat session. Right. And in this case they're summarizing information that comes from the web, et cetera, as they would a lot of Bing stuff in here. But you know, this works like, you know, like Copilot always has. So that's, that's fine.
- [07:43]
Amazon Music Announcer
Have you noticed that the way we use our phones is ironic? Phones are for connections, but we look at them more than we look at each other. That's ironic. So U.S. cellular created U.S. mode to help us reconnect. It helps us use phones a little less. Ironically, a phone company wanting people to use their phones less is ironic. Let's find US again with US mode from US Cellular. Visit uscellular.com builtforus to get started, lets.
- [08:09]
Paul Thurrott
Map out this week's amazing destinations and travel tips.
- [08:13]
Will (T-Mobile Customer)
Honestly Will, I didn't plan any trips, but I did switch to T Mobile with their new Family Freedom offer.
- [08:21]
TWiT Announcer
That's not the itinerary we're following.
- [08:23]
Will (T-Mobile Customer)
Well, I'm departing from AT&T and embarking on a new journey with T Mobile. They paid off my family's four phones up to $3200 and gave us four new phones on the house.
- [08:37]
Paul Thurrott
Bon voyage.
- [08:38]
T-Mobile Announcer
Introducing Family Freedom. Our lowest cost to switch our biggest family savings all on America's largest 5G network. Visit your local T Mobile location or learn more@t mobile.com FamilyFreedom up to $800 per line via virtual prepaid card typically takes 15 days. Free phones via 24 monthly bill credits with finance agreement eg Apple iPhone16128 gigabyte $829.99 Eligible trade in eg iPhone 11 Pro for well qualified credits end and balance due if you pay off early or cancel contact T Mobile.
- [09:05]
Paul Thurrott
But this is going to get more powerful, right? And so there are voice navigation features which I don't think are that great frankly. And before I click on this, just to warn you, you can use this to cause the browser to navigate around. So you could say things like select the address bar, go to this link or select the link, etc. So in my case that's not particularly useful. Obviously from an accessibility point of view that might be very useful. But to me this is more about kind of a hands free mode. So maybe you're cooking and you're maybe doing something with a recipe or you're just casually doing something and you have it over there on the side and you just want to talk to it. Right? I do think it's good for things like reading, you know, the summary thing. So instead of Typing, you know, or clicking on Give me a summary of this page. Say, hey, could you just give me a summary of this page or this PDF document or this web or video. It does that kind of thing, right? So it's a way to kind of access that. But the way that this starts to get more powerful and this is going to be fairly basic, but is if you're doing something like shopping. So maybe you're, I'm going to put this in dark mode so it doesn't kill anybody. Eyes here. So maybe I go to this, the Amazon site and I type in the name of a speaker and I bring that up and so here's the speaker and it costs whatever it costs, and that's what it is. And then I, you know, you're doing this type of, you know, research like you might do like I want to buy a new Mars speaker, but I'm really sure which one I want. And I'll just make this super simple because we're just trying to give an example here. But we have these two pages now that have each have some Sonos speaker in this case loaded. And then from that tab or any tab or from here from using this little interface or the main tab interface, I could actually reference these tabs and say, you know, can you compare the speaker? And then you do an ention. And so if you've used any Microsoft products like Teams or Outlook, you'll know that they do this kind of thing. And you could say, you know, like the Amazon. So whatever the name of it is, and it is totally not doing that. But what this will do typically is pull from the, the tabs that match what I typed there and then give you whatever you ask for, in this case a comparison. And so here you get like a nice chart of the two speakers. And so it's kind of grounding the query or the answer to the query in the tabs that I referenced. So it's a nice way to kind of hone it down. So instead of just saying, could you just do this thing? It's could you do this thing against those particular tabs, right? And so this is a really, really basic way of kind of interacting with a web page in an almost programmatic way, right? Rather than just loading it and saying, hey, what am I looking at? You say, hey, these things are loaded. Could you tell me more about it? And then it does what it does and you can go from there. It's a chat, right? And so you can keep going and ask it more questions or follow ups, etcetera. So that's kind of interesting. The other thing that this is supposed to do, and this is where I've actually failed, so I'm not going to bother doing this. In fact, there's a version of this where you do it with your voice. So it could fail twice. But you could also say, I want to. Maybe this is the speaker I want to buy. It's a little expensive. I'd like it to be less than $150. And so either typing a query or with your voice, using the Copilot voice feature, you could say create a shopping tracker and then it will try to go and do that. Now I'm probably not going to try to do this live because it's failed so badly on me before. One of the problems is it actually controls the browser and then go and clicks and fills in boxes and things like that, which is fine for now. I mean, eventually this will just happen on the back end. But a lot of those tracker sites have captchas, right? And so it can't get through the captchas. It asks you to get through the captchas, but it can tell it's really not a human. So there's no way through for this moment in time. This is something I'm sure they'll fix. It is AI after all. And of course, browsers, a lot of browsers, certainly Edge, have this kind of functionality built in. So this is really just a front end to something that's already there. But the thing that is happening behind the scenes here that's actually pretty exciting is there is this concept of what Microsoft calls actions, in this case, app actions. These could be things in Windows 11, right, where it's controlling features in individual apps. It could be things on the web like we're doing here in the browser, where it's going to control online services. And so right now it's at the screen scrape level in the sense that it's just controlling what you can see and what it knows about. But over time, as the web becomes more programmatic, that's going to become more powerful. So that's where it is now. So this is not particularly innovative. Like I said, it's not disruptive in any way. You can go back at any time. If I go back to Settings and just turn this off and I go to a new tab, I'm back to that old experience. You know, this is back where it was before. You get the sidebar instead of that little quick link experience. It's fine, you know, so it's still considered experimental. It's something you can toggle on and off. I feel like this is something that will eventually will just be the browser, but I also think that it's going to have to be a lot more powerful before it can really kind of go mainstream. So so it's something to check out and experiment with. It's something to pay attention to because I think it's going to improve over time pretty dramatically and then we'll see. And so if you've seen anything like DIA or Comment especially, those are much more powerful AI powered browsers than Edges right now. But Microsoft, they kind of know what they're doing with AI, so they'll probably get it there. So this will keep changing and it's like I said, it's just something to keep an eye on. So I hope you found this mildly interesting. It's still early days on Copilot mode for Microsoft Edge, but like I said, I do think it's going to get there. So thank you so much for watching this episode. We appreciate it. We encourage you to check out Club Twit. Become a member and you can get ad free versions of our videos and support our channels, support all the creators, support the company. You can learn more about that at TWiT TV Club TWiT and you can find a new episode of Hands On Windows every Thursday and you can learn more about that at Twit tv. How thank you. I'll see you next week.
- [15:42]
TWiT Announcer
Hey, thanks for tuning in to TWiT, your tech hub for intelligent, thoughtful conversations. If you want to take your experience to the next level and support what we do here at twit, say say goodbye to ads and say hello to Club Twit. With Club Twit you unlock all our shows ad free. You also get exclusive members only content. We do a lot of great programming just for the club members. You also get behind the scenes access with our Twit plus bonus feed and live video streams while we're recording. And don't forget the fantastic Members Only discord. It's where passionate tech fans like you and me hang out, swap ideas and connect directly with all of our hosts. It's my favorite social network. I think you'll like it too. Club Twit. It's not just a subscription, it's how you support what we do and become part of the Twit family. Your membership directly supports the network, helping us stay independent and keep making the shows you love. If you're ready to upgrade your tech podcast experience, head to Twit tv. Club Twit and join us today. Thanks for being here and I'll see you in the club.