Transcript
Joseph (0:04)
Hello and welcome to the 404 Media podcast where we bring you unparalleled access to hidden worlds, both online and IRL. 404 Media is a journalist founded company and needs your support. To subscribe, go to 404 Media Co as well as bonus content every single week. Subscribers also get access to additional episodes where we respond to their best comments. Gain access to that content@404Media co. I am your host, Joseph, and with me of 404 Media, co founders, Sam Cole.
Sam Cole (0:34)
Hello.
Joseph (0:35)
And Emmanuel Mayburg.
Emmanuel Mayburg (0:37)
Hello.
Joseph (0:38)
All right, we have a lot to get through and I'm mad about this story, so I want to jump straight into it. This is one I wrote and the headline is, someone put facial recognition tech onto Meta's smart glasses to instantly dox strangers.
Emmanuel Mayburg (0:58)
Joe, I'm going to ask you questions so you don't have to interview yourself. I appreciate technology. Exactly. And what does it do?
Joseph (1:05)
Yes. So somebody has taken the Meta Ray Ban glasses, which is they are Meta's wearable and they do all sorts of AR things as Meta. Facebook is trying to move more into that world. They do not perform facial recognition, but what somebody has done is basically tacked that capability on and just by looking at somebody, it is able to identify, there's a face, find out who that face belongs to somewhat accurately, then find their home address and their phone number and potentially information about their family members as well.
Emmanuel Mayburg (1:58)
And how does it do that? How does that all work?
Joseph (2:02)
Yes. So under the hood, it is basically a hodgepodge of different technologies sort of strung together. So you'll look at somebody's face and it will then contact the facial recognition service pimize. I think we're all familiar with it. We've covered it in various different contexts. For those who don't know, it's basically a facial recognition service that anybody can use and anybody can access. If you're familiar with Clearview AI, that is a very powerful facial recognition tool used primarily, I wouldn't say exclusively primarily by law enforcement, where the police officer will point a phone at the face or they upload a photo and that will grab the social media profiles that that person belongs to. Because it's built on this massive data set of scraped social media images and other parts of the web as well. Pimize is basically that less powerful, but basically that for anybody who wants to pay 10 bucks a month or whatever it is. So these glasses, they contact that, they then use LLMs to interpret the results generated from that. Because what pimize does is that when you scroll through the results, it shows all these similar faces and it also shows the URL where that face was found. So maybe you look at somebody's face, it then brings up, I don't know, their university profile on the university website or something. You click that, presumably it might have their name. These LLMs will then grab that once it's been scraped and provide sort of a summary of who this person is. Oh, they went to this school, maybe they got this award, all of that sort of thing, and then takes that name, the most important part, and it automatically sends that to a people search website, which I'm sure people have seen these. If you literally Google Find xyz, if you're trying to identify, I don't know, a long lost relative or something, there's all of these websites that sell access to that sort of data. And it then grabs results from that as well. And that can include the home address and the phone number. So it's not very elegant. It's not really, I suppose, highly sophisticated. It is using consumer off the shelf tools and capabilities. But I think that is entirely the pointer. It is entirely the point that the two people who were able to do this were two Harvard students. This was not a big tech company, this was not a surveillance firm. This was two people basically doing it in their own time. And what these two students did was they tested it on ordinary people out in the world and their friends and they got all sorts of different reactions. And here is a voice memo that one of them sent me. Just about some of the reactions they got when they were actually demoing this technology out.
