← Hard Fork
Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT
01:04:20
“We are on track to see what might be the three biggest I.P.O.s of all time.”
Loading summary
Transcript220 lines
- [00:00]
A
This podcast is supported by Atlassian Rovo AI that takes your team from AI novice to AI native. What if AI handled the busy work for you? Updating JIRA tickets, drafting campaign briefs in Confluence, writing project updates, all without you lifting a finger? Meet Rovo AI that works where your team already works, using your company's data and permissions to take action. Get started with rovo@rovo.com.
- [00:29]
B
i have to say, technology is not my friend this week.
- [00:33]
C
What's going on?
- [00:34]
B
Well, first of all, I now have a new piece of technology in my bedroom called a CPAP machine.
- [00:39]
C
You heard of these things? Yes.
- [00:42]
B
So, listen, if you're out there, you think you want a boyfriend like you do, but here's what's gonna happen. He's gonna notice during the night that it appears that you briefly stop breathing, and that's gonna terrify him. And next thing you know, you're gonna be at the doctor. Now, I sleep with a mask on, and when I breathe, I sound like Darth Vader. So that's thing one happening to me. I accidentally bricked my laptop with a bottle of water in my bag.
- [01:05]
C
Yeah.
- [01:05]
B
And then today I'm trying to get to the office for the podcast and my debit card that is attached to my public transit card expired. No big deal. For two days, I've been trying to navigate the city bureaucracy to just replace the credit card that is attached to my transit card. It won't work. So I have to order an Uber to the office, and it's says it's going to be six minutes. It was more like a casual 12. And I get in and it's one of these cars where the driver appears to have been smoking in it continuously since 1976. So that is sort of my tech stack over the past seven days. And that sounds horrible. I'm frustrated, Kevin.
- [01:45]
C
That sounds horrible. I'm so sorry for your loss.
- [01:47]
B
I need you to carry the show. I'm not in a good place and I need help. In therapy, they teach you have to learn to ask for help. And I'm asking for help. Yes.
- [01:57]
C
Yes. You know those, like, things with the footprints in the sand?
- [02:01]
B
Will you carry me? Yes.
- [02:03]
C
Today was the day that I carried you.
- [02:05]
B
Kevin Roose is my own personal Jesus.
- [02:07]
C
Yes. You're always saying it. Let's tape a show. Let's tape a show. I'm Kevin Roos, a tech columnist at the New York Times.
- [02:20]
B
I'm Casey Noon from Platformer, and this is Hard Fork. This week on the show SpaceX Anthropic and OpenAI are all heading to the public markets. But what do their IPOs mean then? Author Kevin Hartnett is here to talk about why some mathematicians are sounding the alarm about the use of AI in their field. And finally, some hat GPT. And that'll be math free. Gotta keep it balanced.
- [02:53]
C
Well, Casey, the big news this week is that the AI IPO race is heating up. It's hot IPO summer.
- [02:59]
B
It really does seem like it is going to be a hot IPO summer. Kevin, I am told that we are on track to see what might be the three biggest IPOs of all time.
- [03:08]
C
Yes. So SpaceX is getting ready to go public as soon as maybe next week. And then just this week, Anthropic filed a confidential S1 with the SEC, noting that it intends to go public. That is sort of the first step the process. And there are reports that OpenAI is going to file their S1 soon as well. This is obviously long awaited. People have been wondering when these giant private companies were going to go public. And now it seems like they're all racing to do it as quickly as they can and potentially beat each other to market.
- [03:42]
B
Yeah, and the consequences are really important and we're going to get into them. But before we do that, truly there has never been a better or more important time to do our disclosures.
- [03:51]
C
Yes. I work for the New York Times, which is pursuing OpenAI, Microsoft and perplexity,
- [03:56]
B
and my fiance works at Anthropic.
- [03:59]
C
Okay, so those are our extra special AI disclosures this week. Now, Kasey, let's talk about these IPOs.
- [04:04]
B
Let's do it.
- [04:05]
C
Maybe we should start with SpaceX. What is going on with the SpaceX IPO? What are we expecting and what does it mean?
- [04:11]
B
Yeah, so, you know, as you know, Kevin, SpaceX is just the furthest along right now. They seem like they're getting very close to the finish line. And they just have some staggeringly ambitious plans. They plan to sell their shares at $135 apiece, which would raise $75 billion. That would make it the largest IPO of all time. It would also value the company at between $1.75 and $2 trillion, which would sort of instantly make it among the very biggest companies in the world.
- [04:40]
C
Yeah, those are crazy numbers like that. Those are just numbers that we have not seen before in the history of capitalism. And we should also just remind people that when we say Space X, we are talking about sort of the combined Frankenstein Y.
- [04:54]
B
Remind us what is actually in SpaceX.
- [04:57]
C
So they make rockets, they Make Starlink. They also, as of fairly recently, own XAI and X, the social network. And so that is all sort of part of this Elon Musk conglomerate.
- [05:10]
B
What about Hobby Lobby? Do they. Is Hobby Lobby part of it as well?
- [05:14]
C
Not yet, but don't give their biz dev team any ideas.
- [05:16]
B
Okay, fair enough.
- [05:18]
C
We're going to do Hobby Lobby in space. So this giant conglomerate is being sort of positioned in the market as a way for people to invest in AI. Obviously, they do have an AI company inside of SpaceX. But I would say investors are also, I would say more excited about the space part of it, which is the most developed and they make stuff that people actually use.
- [05:40]
B
Yeah, I mean, look, there are two great businesses in here, right? One is a reusable rocket business that delivers satellite into space. It's very hard to build that kind of company. Right. So like SpaceX just has an incredible moat. There aren't that many competitors to it. We saw Blue Origin, one of its biggest competitors, lose a rocket on the launch pad, you know, just over the past week or so. So that is what makes that an incredible business. And then Starlink is just on fire, right? Like, they're using their ability to deliver satellites in a space to also create a really powerful global Internet access system that is just growing like wildfire. So there are two amazing businesses in there and then they also have two terrible businesses called X and x dot com. And it'll be really interesting to see what the interplay of the good businesses and the bad businesses are, you know, in the months to come.
- [06:34]
C
Yeah, sometimes you just got to take the good with the bad, and especially when they're all packaged with the same stock ticker.
- [06:40]
B
What's interesting is that you didn't have to take the good with the bad. You could have just had the good. Like, up until very recently, SpaceX was just space X and Starlink. Like, it was just a pure good business business. But then it seemed like Elon Musk decided he needed to kind of, you know, hide his losses somewhere and so they inherited the two worst companies he owns.
- [06:54]
C
Well, and what's interesting about that is that one of those companies, xai, appears to be pivoting. So they are now renting out compute that they originally built for themselves to Anthropic. Yes, Another one of these companies that's going to IPO this year. So they are positioning themselves as something like a space company with a kind of AI neo cloud business attached to it and a social network that is going to become the everything app. All of it is a little mysterious, but basically this is the long awaited time when all of Elon Musk's sort of Voltron like companies are going to sort of take a stab at going public together. So that is the SpaceX IPO. Now let's talk about anthropic. They have filed their confidential S1. They are also expected to go public at something over a trillion dollars. That is not what.
- [07:50]
B
Oh, I'm just shaking my head at the insanity of that, considering what their ARR was one year ago today. Yes.
- [07:57]
C
I mean this one's just wild to me. Like I was thinking the other day about the first time I ever visited this company was in 2023, so three years ago. And when I tell you that this company was not only ambivalent about making money, but seemed to actively resist the idea of making money, you're like a small group of like very earnest AI safety obsessed people who were like tinkering with and building models for unspecified purposes.
- [08:32]
B
I remember your story about it and it was just kind of about how glum and strange the office was, which you might expect for a bunch of very, you know, safety focused people who hadn't even decided whether they really wanted to start making a product yet.
- [08:45]
C
But boy howdy did they make a product and decide that they actually liked making money and wanted to make a lot of it. And now they're going to be one of the largest IPOs of all time. Just three years after I was hanging out with them in little like Jackson Square. Walk up office.
- [09:03]
B
No, and like, you know, like In January of 2025, this company has, you know, an annualized revenue run rate of about a billion dollars. And you know, recently they've said it's 50, you know, who knows what it's going to be by the ipo? But yeah, I mean that just is unprecedented growth in Silicon Valley.
- [09:21]
C
Yep. OpenAI we don't know anything about their upcoming IPO except that they have said that they plan to do it. They may file as soon as this week their paperwork with the SEC to start that process. People also expect this to be a big gigantic ipo. And so all of this taken together, I think there are a few threads to pull on here. One of which is what is this going to do to San Francisco here we have to call it two and a half companies because Space X has some headquarters and offices in other Texas and Southern California and other places. So two and a half companies going public in the same year, based in San Francisco, minting, you know, hundreds if not thousands of new millionaires, deca millionaires and centimillionaires and what that will do to the city's tech scene, to the local real estate market, et cetera, et cetera. What are your thoughts on that?
- [10:18]
B
I mean, my fear, Kevin, is that we are about to see a massive increase in inequality in a town that already had really significant inequality. Right. And I just worry that it's going to sort of feel even worse. And where I'm already starting to notice it is when I talk to my friends who have like really good jobs paying like maybe even mid six figures, they're looking at what they're reading about the folks who got in early at an OpenAI or an anthrop, and man, the comparison is not feeling good. And they're starting to wonder, what does this mean for me? Am I going to be able to lead the life that I wanted? And it just had me thinking a lot about how when I got to San Francisco in 2010, there was a sense of abundance here. There was a sense of anyone can do a startup and anyone can sort of have the life that they want. And it was true for many, many tens of thousands of people. And I feel like we're almost swinging back to this sort of scarcity mentality here, which is like, well, if you didn't make it in it of these two companies, you know, your future is in doubt. So I don't know how true that is, but I can tell you that that is the anxiety that I'm hearing.
- [11:25]
C
Totally. And it's, it's, obviously there's some, you know, it's hard to feel much sympathy for these people who are very well paid engineers and tech workers who are looking at their slightly richer peers and thinking, I got to get some of that. But I think this is a real, like status anxiety moment in San Francisco, in Silicon Valley, where even the people who sort of thought they had sort of made it in the world of tech are looking at these people who have joined these like, you know, insanely fast growing companies that are sort of wanting to get in on that somehow, but also like thinking it might be too late. Like people who I don't think were feeling precarious a year or two ago are now. And I think that's just a really interesting sort of social marker.
- [12:10]
B
Yeah. And like, you know, just to say again, like, I think what you want in a society is for opportunity to be spread broadly and for everyone to feel like they have a chance to lead the life that they want. And so when you move into a world where there is what essentially amounts to a handful of lottery winners, and those are the only people that truly get to live the lives that they want. Like, that just causes massive, you know, social instability and all sorts of other problems. So, yeah, I might. I have, like, a knot in the pit of my stomach about this.
- [12:41]
C
I do, too. And one thing that is making it slightly better is that I did see this coming. And I do get to crow about my correct prediction I made on our prediction episode back at the end of last year, which was that 2026 I predicted was the last year to buy a house in San Francisco, which now appears to be true. The real estate market is going nuts. Houses are going for, you know, many multiples of their asking price. There was a story this week. Did you see this one about the. The San Francisco homes that are on sale asking for anthropic or open air stock instead of cash?
- [13:19]
B
I mean, look, I think those people are smart. Like, there's a very real chance that that stock will appreciate in value, even f house. So I say shoot or shoot.
- [13:28]
C
Yes. So there are two other things about these IPOs that I want to discuss with you. One of them is the effect it's going to have on philanthropy, because one of the strange characteristics of these particular companies is that many of their employees, and I would say this especially applies to anthropic. But there's also a piece of this at OpenAI are committed to effective altruism and other sort of similar philanthropic movements that basically teach you that you should, if you want to make a maximum impact on the world, you should make a bunch of money and then give it away. And so nonprofits, philanthropies, donor advisory networks in and around San Francisco are now starting to ask, like, what if we just have this insurgence of new philanthropic capital coming from these IPOs? Our mutual friend Nan Ransohoff wrote a great post about this the other day, calling it the third wave of philanthropy, basically, where you have tens of billions or possibly hundreds of billions of dollars sort of flooding into these charitable movements and causes. How does that affect, like, what gets funded? Are there going to be new institutions that need to be built to sort of absorb all of this philanthropic capital? I think this is something that people outside San Francisco don't quite understand is, like, how much money is going to be flowing into these philanthropies over the next couple of years.
- [14:51]
B
Yeah. I also really love Nan's post and had a chance to talk with her about it in recently and it was just so fascinating to hear about the sheer volume of philanthropic capital that we're expecting to emerge as a result of these IPOs and how little infrastructure there is to absorb it. Something that I think some people might, might not know about Anthropic is that from their start, they have told people as they come on board, if you pledge like a percentage of your equity to philanthropy, we will actually match it. And so this is just a program that is, you know, dramatically amplifying the amount of philanthropic capital is about to become available. So.
- [15:31]
C
Well, it was not just matching.
- [15:32]
B
Yeah, so.
- [15:33]
C
So there are two things that Anthropic did that sort of speak to their, I don't know, historical ties to effective altruism and that sort of world of philanthropy. One is that all of the co founders pledged to give at least 80% of their wealth to charity. So right there off the top, we are talking about hundreds of billions of dollars potentially that are being earmarked for charity just by the eight co founders of Anthropic. Then you have this stock matching program which as you alluded to, not only offer to match employees who pledged a certain percentage of their stock to charity, share for share, but match them three to one in the case of some early employees. And that just is creating, like when you, when you actually lay out the numbers, as Nan did in her post, like it is just staggering the amount of money. Like we are going to see something bigger than the Gates foundation every year potentially for the next few years. And like it's going to go to some stuff that will seem to the outside world fairly weird. Right. The joke going around the sort of AI circles is this is going to be a great year for shrimp welfare, because shrimp welfare for arcane and reasons that are probably not worth going into here has become like a sort of half joking pet cause of the effect of altruists. But it's a great year to be a shrimp. It's probably also a great year to be working on global health and pandemic prevention, AI safety, other sort of cause areas that are very closely affiliated with effective altruism.
- [17:07]
B
Yeah, I mean, it makes me glad that we shredded the social safety net and did all that, like sort of reductions in pandemic preparedness. So now the San Francisco billionaires can step in and rebuild it hand by hand.
- [17:17]
C
Exactly. I want to bring up one other thing about these IPOs and ask for your opinion about it, which is that the thing that makes me nervous about these IPOs is not that, you know, they could go Sideways or people could lose money or these companies are very speculative. All of that is true. What worries me as the safety angle here because I am of the belief that these AI systems are getting more powerful, that those increased capabilities also bring increased risks. And I just know that many of these AI companies, OpenAI and Anthropic specifically, were started by people who were worried about safety and specifically worried about the ability of a for profit Corporation to develop AI safely. At OpenAI, you've had this sort of governance struggle that resulted in, among other things, Sam Altman being fired and rehired. At Anthropic, they have sort of made themselves a public benefit corporation to try to kind of lessen the influence of sort of shareholder capital and fiduciary duty on their ability to make decisions related to safety. But I think all of that just gets much harder in a world where these are publicly traded companies that, that, you know, big investors, index fund holders that, you know, retirees are invested in. It was already going to be hard to sort of slow down or maybe refuse to release something that was dangerous because of the, you know, enormous sums of money that these companies have raised. But it's going to be a lot harder when the public markets are also pressuring these companies to race and go as fast as they can.
- [18:55]
B
Does it matter that both OpenAI and Anthropic are structured as public benefit corporations and like sort of have, like are allowed to make social commitments, commitments that a sort of, you know, traditional, like SpaceX for example, will not be beholden to.
- [19:08]
C
I'm, I'm of a couple minds on this. I think it's probably better that they are public benefit corporations than not, because public benefit corporation is sort of this, you know, legal designation that allows you to take into account things like are we being socially responsible? It doesn't, you know, investors can't sue you as easily for sort of breaching your fiduciary duty if you do something that is counter to their interests as shareholders. But, but there are still corporations and they still exist at the pleasure of shareholders and there are certain concessions they can make to social issues and impact. But when it comes down to it, like when the rubber meets the road and one of these companies develops a model that is truly dangerous, they are going to now need to weigh not just what do we think the right thing to do is or what do our private investors think we should do or what do our employees think we should do, but they're also going to have the public markets breathing down their neck. They're Going to have activist investors and things like that. So I'm just nervous about the structure that is now going to grow up around these companies and just push them in the direction of acceleration.
- [20:18]
B
I think that's fair and I may be coping. But when I think about the possibility of a lab developing a really dangerous model and saying, well, due to, you know, shareholder pressure, we're just going to put it out there, you have to remember that like that shareholder pressure can work in the other way too. Because if you put out a model that can create a new bioweapon, you're probably going to get sued for securities fraud by a shareholder. That said, I trusted you to only release safe models. So I do think that there are going to be some positive pressures here that hopefully, you know, keep them from doing anything too silly. Yeah.
- [20:50]
C
How do you think this will impact the average person who's not an investor or a shareholder in these companies who may just, you know, want this stuff to be developed well and safely?
- [21:04]
B
I mean, I think on balance you're right that like, because these are corporations, we do have to worry that like capitalist pressure as will lead them to cutting corners and doing things that are unsafe. So that is I think the right concern to have and to keep your eye on it. On the other hand, like, I could also see an argument that when your company goes public, you are introducing more democratic oversight and governance into it. Right. These folks will now have to like report their earnings. They will have to give us information about their, their financials, they will have to make certain disclosures as you know, their, their, their products come out and as they company changes and you know, shareholders will be able to maybe vote on certain things. So you know, I think these are all good things because right now we have almost no levers whatsoever that people can pull other than trying to prevent a data center from being built in their backyard. So maybe these give folks some new ones.
- [21:59]
C
Yeah, and I think there's been a lot of hand wringing over these, these indexes and these exchanges that have changed their rules like the NASDAQ 100 and the S and P have already or are considering loosening their rul. These so called seasoning periods. Basically. It used to be if you were a brand new public company that had just IPO'd, you could not be included on these major stock indexes because they sort of wanted to see like whether you were stable enough to like become part of the basket of blue chips that people invest in when they buy an index fund. Now partially because of these looming IPOs, those rules have been relaxed so that these companies are not going to have to wait three months or six months or a year anymore to be included on these exchanges. Some people have said, well, that sounds bad. And we're exposing retail investors to these like, volatile and risky stocks. I'm not that worried about it. I think, like, investors want exposure to these companies. I know several people in San Francisco who have been sort of like devising these crazy, like, harebrained schemes to get pre IPO stock in one of these companies. And, um, I think that letting the public benefit from the upside of the AI boom, I think is going to do more help than harm. But I could be wrong. If all of this goes up in a conflagration and people lose their shirts, I mean.
- [23:20]
B
Yeah, yes, absolutely. You know, Kevin and I are not financial advisors.
- [23:26]
C
You know, I am actually a certified financial advisor.
- [23:29]
B
I am not a financial advisor. But I do think that if, you know, you're a retail investor and you believe in this stuff, you should have the ability to like, make that bet. Because we live in a country where you can bet on bitcoin in an exchange traded fund, you can go on a prediction market as a member of the military and bet on an operation that you're a part of. So in a world where those are restrictions on, you know, sort of financial gambling, if you want to buy a share of OpenAI, I say Godspeed.
- [23:57]
C
Yeah. I think that part of the icky feeling that people are having about the AI industry now is that so much wealth is being concentrated in so few private companies.
- [24:05]
B
Yes.
- [24:06]
C
And so few hands. And so in a optimistic scenario where these IPOs go off without a hitch and these companies, you know, keep growing at hyperscale, I think maybe having the benefits shared a little more broadly through things like index funds could be good for people's feelings. Like, oh, there's something for me in this.
- [24:24]
B
I'm going to go further and saying it's not just good. I'm going to say it is necessary. Like, like, we cannot have a very small handful of companies that are growing this quickly, that are concentrating wealth and power that much into so few hands. It has to be shared more broadly than that. And while an IPO is a very small step in that direction, I do think it is a necessary one.
- [24:46]
C
Okay, well, that is enough about the
- [24:48]
B
IPOs for this week.
- [24:49]
C
We will continue to cover these IPOs and everything that comes out of them, including possible space data centers. I don't know. I'm excited to learn more about Those I will say when it comes to Starlink, I was not a believer. And then I went on my first Starlink equipped airplane last week and Casey, this is gonna be the biggest company in the world.
- [25:11]
B
It's very good.
- [25:12]
C
When people get a taste of 200 plus megabits in the air on a plane, you're never going back.
- [25:20]
B
Yeah, you can like actually watch YouTube if you have Starlink on your plane.
- [25:23]
C
You can watch so many YouTube videos.
- [25:25]
B
And the deal that they struck, I'm told is they struck the deal where at least with United States they're like, we'll put Starlink on your plane and you know we will charge United for that but you can't charge your passengers. Y so everyone's experience of Starlink is it is a free miracle that's being delivered to me in my airplane seat, which is not a bad marketing strategy.
- [25:42]
C
Not a bad marketing strategy. When we come back, author Kevin Hartnett tells us what the heck is going on with AI and math.
- [26:26]
A
This podcast is supported by Atlassian Rovo AI that takes your team from AI not novice to AI native. What if AI handled the busy work for you? Updating JIRA tickets, drafting campaign briefs and Confluence writing project updates, all without you lifting a finger. Meet Rovo AI that works where your team already works, using your company's data and permissions to take action. Get started with rovo@rovo.com the thing about
- [26:55]
D
AI for business, it may not automatically fit the way your business works. At IBM we've seen this firsthand. But by embedding AI across hr, IT and procurement processes, we've reduced costs by millions, slashed repetitive tasks, and freed thousands of hours for strategic work. Now we're helping companies get smarter by putting AI where it actually pays off, deep in the work that moves the business. Let's create smarter business.
- [27:23]
A
IBM marketers have always had to build your brand or drive sales. With YouTube you can do both. It's where the most trusted creators and powerful AI converge to create and convert demand for your brand. That's why YouTube drives higher long term return on ad spend versus TV, paid, social or streaming. There's no more choosing between brand or results. With one platform, you get both. Learn more at g co business YouTube.
- [27:56]
C
Well, Casey, get out your TI83 graphing calculator because today we're going to talk about math.
- [28:01]
B
Can I play Snake on it or do we actually have to talk?
- [28:03]
C
No, we have to talk because today we are going to talk about what is going on with AI and math. Now this is a subject that we have talked about before on this show, but there's actually been a lot happening just over the past couple of weeks. So two weeks ago, on May 20, OpenAI announced that one of their models had reached this big mathematical milestone. Basically it had disproved this long standing geometry conjecture by identifying a new way of thinking about this famous math problem, one of these Erdos problems that basically no human mathematician had considered before. That was considered a very big deal in the world of mathematics. And at the same time there is also this backlash brewing in mathematics to the use of AI. Just this week, a group of mathematicians has have been passing around and signing something called the Leiden Declaration, which is basically an open letter about the use of AI in mathematics from people who are concerned that maybe they're sort of eroding the human foundations of this academic mathematical discipline.
- [29:08]
B
Yeah. And when I asked a mathematician why, they said Y equals mx plus B.
- [29:14]
C
Okay, very good.
- [29:15]
B
That of course is the classic slope intercept formula for a straight line.
- [29:20]
C
Which model did you use to look that up?
- [29:22]
B
I'll tell you later.
- [29:23]
C
So we just thought it was a really good idea to check in on the state of AI and math. And to help us make sense of what is going on right now, we have turned to one of the best guests I can imagine for this subject. Kevin Hartnett is a journalist. He has covered math and computer science for many publications, including most recently as a senior reporter for Quanta magazine. He's also the author of a book that comes out next next week called the Proof in the Code, which is sort of about this formal math language called Lean and how it's transforming math and AI. Today he works as the editorial lead at Cursor, the AI coding platform. And I just thought he would have a really good view of this situation. Also, we just like to bring on people named Kevin because they tend to be really smart. Okay, let's bring in Kevin Hartnett. Kevin Hartnett, welcome to Hard Fork.
- [30:20]
E
Thanks Kevin. Great to be here.
- [30:22]
C
Well, Kevin, we've brought you here today to talk to you about AI and math. You just wrote a book called the Proof in the Code, which is, I'll just say it, the most interesting book I've ever read about math.
- [30:35]
E
It's a short, I won't ask the follow up question.
- [30:40]
B
It narrowly edged out One Fish, Two Fish, Red Flesh, Blue Fish.
- [30:46]
C
So when we last checked on the field of mathematics and AI, it was last summer and three of the big AI labs, Google, DeepMind, OpenAI and Harmonic, had all reported that their math models had achieved A gold medal score at the International Math Olympiad. That was something that, you know, people had been saying for years would be impossible for or would take many, many decades for computers to be able to do. But their AI models did it last summer. What has been happen in the field of AI and math since then?
- [31:19]
E
Yeah, I mean, virtually everything. So like the IMO had been a benchmark for a long time. In my book there's a whole chapter about the previous year's IMO, the 2024 IMO, where Google DeepMind got a silver medal score. And that was kind of considered a small watershed. And then as you said, last year, three labs got this gold medal level score, which had really been the kind of the benchmark that had been set out. At that point, AI was still just doing essentially high school math, the hardest high school math in the world world, but still does high school math. And I think for people who never went beyond high school math, it's hard to really appreciate how far that is from the frontier of research math, like forever far. That's like barely even wading into the field. It's like 0% of the way to the frontier. So it was a proof of concept maybe, but it certainly didn't mean much in terms of can these models actually do research?
- [32:06]
B
That's very hard for me to hear. As someone who is not that good at high school math, I have to say I. I'm feeling a little defensive, but I get what I believe you. It's just making me defensive.
- [32:16]
C
Why were the labs so focused on the IMO and on math in general? Was it because that was just like a very hard challenge that they liked, or was it because they thought that being able to do math at a high level would enable their models to do other important things?
- [32:33]
E
Well, it's definitely both. I think the challenge, this IMO Grand Challenge, which was the name that a researcher at Microsoft Research gave to to it was that was really about like, can we just like create models that can do amazing math research? It was just really kind of research for research's sake. At a certain point, the labs and these startups you mentioned adopted that challenge themselves and their motivations were a little different. And there's this very much this belief that if you can teach a model to reason about math problems and solve math problems, it will be much better at other things. And I always think about this statement like my high school math teacher would give when people would ask, like, why are we learning this? What's the point of this? It's like they would either say, so you can balance your check, or to teach you how to think. Right. There's, like, one or the other. And to teach you how to think is really the point here. It's like, if you can reason through a math problem, think logically, then you can apply that type of skill to all of the parts of your life. And I think the labs believe that if you can teach a model to reason through math problems, it's going to be able to do all these other things that are much more probably commercially valuable. Well, as well.
- [33:35]
B
So I'm having a flashback to when we first started to talk about AI and math. And the knock on these models was that they were actually quite terrible at it. Right. And that if you would try to get them to do basic addition or multiplication, they would utterly fail. So, Kevin, sketch out for us a little bit what the labs did to sort of navigate through that problem and get to a place where they could kind of credibly try to advance the frontier of the science.
- [34:00]
E
Right, right.
- [34:00]
B
When.
- [34:01]
E
When ChatGPT came out in November 2022, mathematicians were like, passing around all these like, ha, ha, ha, look at this stupid model, telling me that there are only finitely many primes when we all know there are infinitely many primes and like, two plus two is five. Basically. I mean, I think essentially the models got better. There's definitely an element of reinforcement learning on math problems that make these models better, like RL on math. But I think it is, like, just like the general improvement in these models that we all experience kind of in a lot of ways we use them, has led to these kind of incredible reasoning tasks that they've become capable at.
- [34:34]
B
So let's talk about one of the areas where it seems like we've seen some creativity in math with AI lately, which are these Erdos problems. Kevin, can you tell us who this Erdos was and why he left us with so many problems? Problems, yes.
- [34:48]
E
I mean, so Paul Erdos is a really colorful mathematician. He was essentially the Bob Dylan of math in that he, like, spent his life on the road. He died, I think, at age 83, actually, at a math conference. He slept on mathematician's couches his whole life. And as he went around, he compiled lists of problems that he thought were interesting. Either he would find them in the wild or he invented many of them. And he created this Erdos list. He endowed them with these, like, tiny little rewards, like $20 for solving this problem problem, $500 for solving this problem. And that fund still exists after his death. And These things are paid out, actually. I don't know if the LLMs have received the money or who gets the money when they do it.
- [35:26]
B
But anyway, don't give them the money. They don't need the money.
- [35:28]
C
Yeah,
- [35:30]
E
when a human solves them, they get the money. So Paul Eish collected over a thousand problems, twelve hundred problems that he thought were interesting, and he just kind of left them out there. The AI labs and these startups have looked for kind of benchmarks, kind of mountains they can climb, things they can do to prove that their models work well. The IMO was one of the most prominent ones. They got the gold medal there. They needed to move on. They moved on to the Putnam exam, which is the premier college math competition, and started to do quite well there. And then they just started looking for kind of like new targets. And these erdish problems are sitting out there, 1200 or so problems. And so they essentially set their models to work on all of them, like, see what you can do on them. And it would cook up answers to them. And through the beginning part of this year, we would see like on, on Twitter, one announcement after another. Solved Erdos problem 737. Solved Erdos problem 63. And I think mathematicians viewed those very kind of like hypey announcements differently than the energy behind the announcements themselves.
- [36:31]
C
How did mathematicians view them?
- [36:33]
B
They said, something isn't adding up here.
- [36:36]
C
Thank you, Casey.
- [36:38]
E
I'm going to have to definitely, like, think of some puns. I'm going to get one pun out before we finish this podcast. That's I what my goal. Yeah. So mathematicians, there are just a lot of unsolved math problems in the world. And just because a problem is unsolved and has been around for like decades and was dreamed up by a famous mathematician does not make it an important problem. Like an important problem is one. The field kind of in its collective wisdom determines either, like, the answer to the problem really will change how we view math, or more significantly, the methods we will need to develop to solve solve that problem are just going to remake the field. It's going to create important new math. These erdish problems were just not viewed that way. They were kind of like sophisticated riddles in a way.
- [37:19]
B
These are like the Sudoku of math. It's like the wordle of math.
- [37:22]
E
It is like the wordle of math. I think that's a fair statement. And so anyway, mathote didn't spend a lot of time looking at them. I think the conventional wisdom was these Erdos problems are like toy Problems, not serious problems. It's not true about all of them. And. And about a month ago, OpenAI came out with this big new result. They've solved what many people think of as one of the most important Erdos problems, this thing called the unit distance conjecture. What was important about the unit distance problem is it was a problem that a lot of people had looked at. So you could just say, no, humans have really tried to solve this. People have looked at it, they hadn't solved it. The methods underneath it were very sophisticated and surprising. It was not just kind of a clever cobbling together of obvious technologies, techniques. And the result itself was just like, so good. Pretty unanimously, people agreed this could be published in the Annals of Math, the top journal of math, in a way. Over the last year, there'd been this kind of shifting of goalposts. AI did this, but it can't do that. Oh, it did that. Nope, it still can't do this. But this result, this proof of the unit distance conjecture, really said AI can do absolutely top tier research.
- [38:26]
C
I've been following the story of AI and math in part through, through people like Terence Tao, who is widely considered the greatest living mathematician. He has been sort of experimenting and writing and making videos about his experiments with these AI programs for use in sort of frontier math research for a number of years now. And when he started sort of working with them, he was like, oh, these aren't that helpful. Or maybe they're like a sort of mediocre grad student who you'd have assisting you. And more recently he seems to be actually saying, like, this is revolutionary for the kind of, kind of frontier math research that I and other professional mathematicians do. He recently made a video with OpenAI talking about how he can now just try a bunch of sort of crazy ideas and experiments, because the sort of cognitive friction of using these models means that you can just sort of have an idea and give it to the model and say, go test this a bunch of different ways and figure out if there's anything there. Is that a widely held view among mathematicians or is he just sort of on the extreme AI pilled end of the field?
- [39:32]
E
Field, yeah. So Terry is an extremely interesting figure in this because he is so important, as you. As you said, I have a whole chapter in my book about some of the early work that he did with AI, this thing he called equational theories. And he's always been interested in different ways of doing math. He's very intensely collaborative and he's interested in kind of new ways of working Terry is, I think kind of representative of one of three attitudes towards AI and math.
- [39:58]
C
Right. Right.
- [39:58]
E
Now, a couple weeks ago I was at the Institute for Advanced Study in Princeton, New Jersey, which is like the citadel of modern math, like the biggest, the most dense collection of kind of great math minds in the world live and work there. And in a single afternoon I was walking the campus there and I had two strikingly different experiences. I ran into two 40 year old mathematicians, top of the field. One of them told me he had just tried to do some math with Gemini and he's like that stupid thing told me like XYZ thing, which we know is wrong is true. And then I closed it and I went back to doing math the other way. An hour later a guy who, you know, on paper looks a lot like the first guy says, I think in two years AI is going to put mathematicians out of business because it is just going to be strictly better than us at all of it and like we won't need mathematicians anymore. So like those two polls, Terry is squarely in the middle. He that OpenAI video you described, Kevin, that's like the kind of jetpack for your thoughts view of AI. It's like the Iron man suit that will allow me to do more and better and bigger things than I could before. Um, he is clearly the leading figure of that point of view. I don't really know if you were taking a poll right now of mathematicians, like how it would break down. I would guess the it's going to put us out of business would finish last. Um, and I would guess Terry's would finish first. And I think that it's good for nothing. That might have actually won a year ago, but I think that's definitely falling in the polls.
- [41:16]
B
Let's talk about some potential paths to a world where maybe more people are agreeing with the person who thinks the AI threatens the job of a mathematician. Kevin, do you want to talk a little bit about this letter that these mathematicians put together?
- [41:29]
C
I do. This was fascinating and this is actually the reason we wanted to have you on today was to talk about this response, this declaration, the Leiden Declaration on Artificial Intelligence and Mathematics. And this is a basically declaration signed by something like 800 mathematicians so far that I would characterize as like a very worried document. They are upset about the use of AI in their field. What they consider the irresponsible or reckless use. They make a bunch of statements about how these technologies are producing plausible but unreliable or even incorrect arguments which are hard to distinguish from sort of correct proofs so help us understand this declaration and kind of the perspectives of the mathematicians who are putting their names on it.
- [42:18]
E
Yeah, I think you are right that it reflects a kind of deep concern and worry for the future of the field. Mathematicians, I think, are deeply, deeply worried in the way of a population or a community that largely was able to run itself and self regulate for centuries and now there's this massive exogenous force that is shaking it and they want to be able to kind of defend the field. They want to, I do think, want to kind of set up some kind of guardrails and also say, like, this is our field. You don't get to tell us kind of what's important, how it runs. And this document you talked about, Kevin, is I think, an effort to try and start making that kind of stuff statement.
- [42:53]
B
Well, I think they've realized that there's strength in numbers.
- [42:55]
C
Oh my God.
- [42:57]
B
So here's what I want.
- [42:58]
C
The hits keep coming.
- [42:59]
B
Here's what I want to know. Like what, what exactly is so threatening to them about, you know, other people using ChatGPT to do math proofs?
- [43:08]
E
Well, let me actually step back one second. I think there are kind of two things the Lighting document is trying to do. One is the same thing that like all fields are trying to do, which is like, what are the new rules for the road in the age of AI? Like basically saying if you use AI when writing a proof, you need to tell us about it. Like the math Archive, which is where proofs are posted online before they're published, recently issued a statement that if we see unedited use of AI in your PDF that you upload, like we see like the metadata from the AI prompt, like you copy and pasted it in there and you didn't even know it was there and you didn't review it. We're banning you from the platform for a year. So there's an effort to set some new rules for the road. That's one, and then two. Two. I think they worry that the types of math and incentives to do math, the types of math problems that LLMs are good at, are different than the kinds they care about. But their own priorities are just going to be steamrolled by the rapid pace of progress and the particular kinds of problems that AI is good at at the moment, all the attention and kind of money that flows to them. I think they're worried the field will kind of get squeezed off and they'll have no say in that direction. They're trying to have a say.
- [44:13]
C
I'm sure this is a naive perspective, but isn't this just what people in every discipline feel when there's like a new technology that does the thing that they used to do better than they do? Like, wouldn't the Abacus Guild have been writing declarations about the dangerous new calculators?
- [44:31]
B
They wouldn't have bothered. They were very violent. They turned straight to violence.
- [44:36]
E
So I mean, is this just like a purely defensive thing? I think there are definitely large elements of math that are worth preserving and that AI could a certain way kind of undermine those elements without fully replacing them. And I think that is like a valid worry. Like, math is like a very rich discipline. It's the kind of the, the flowering of like the human mind. I think there are things to worry about that AI can kind of strip a lot of the, the incentive and value out of it without fully replacing it.
- [45:03]
B
I, I, I kind of just want to return because I'm still not sure I totally connected on like what the folks who signed the Leiden declaration are worried about there. There's like a version of this anxiety that I feel like I've seen in other professions, which is essentially AI just enables the instant creation of so much stuff, what is often called slop, that it kind of overwhelms and crowds out the people in the industry who are actually like, talented and doing a good job. Like, is this primarily just a slop issue where they feel like they're not going to be overcome a tide of AI generated proofs, or is there something else there that I'm missing?
- [45:42]
E
Oh, I think it's actually entirely that, like, if AI can generate proofs that are really good and we can read them and we can all be super impressed by them, then there'll be no more reason for us to like have jobs. Like, we will be like hobbyists, like great chess players.
- [45:56]
B
And is the anxiety there like an economic one of, hey, like, this is how I feed my family, or is it something in addition to that of like, without humans, like steering the direction of math, something bad will happen.
- [46:11]
E
I think the anxiety is having been in possession of something for a long time that was very special, that was rare in the human population, great ability at math, and now is kind of generally available. I think that's just kind of a weird thing to reckon with. I think it's also this belief that kind of math and the way the communities has developed the norms around it has produced a lot of basic discoveries that are, are both practically important. Like kind of math fuels our understanding of the universe. It's important in engineering. It's important in kind of all sorts of technology. So there's a concern that if you kind of squeeze it off in certain ways, that we will lose those downstream benefits. And I think the more serious point is this belief that kind of math is just a quintessentially human endeavor. It's like the pinnacle of human thought. It's like writing a sonata. It's like writing a novel. And that, I don't know, I think we don't feel as threatened in those areas by AI because we kind of understand that, like, the human behind the creation is such an important thing.
- [47:10]
C
Oh, I think writers and musicians feel very threatened by AI just. Just to offer that, like, I think there's a very similar response happening in the creative community.
- [47:20]
E
Do you. I guess I was. I was not so sure of that statement. I just like, do I think that people would not be as interested in a novel written by AI?
- [47:26]
B
They're not. They're not going to be interested if they know that it was written by AI.
- [47:30]
E
That is true. That is true. Anyway, so, like, if a proof is not. If there's no human kind of behind it, who kind of sat and wrestled with it, then maybe we lose some kind of very essentially human endeavor. That is the worry.
- [47:43]
C
Right? I think programmers are an interesting exception to this sort of defensiveness because for the most part, I think, like, many programmers are very excited about the tools that allow them to just like, do their jobs better and faster. And obviously they're worried about the future of their own jobs. But I don't think you're seeing this kind of like, Leiden declaration, backlash to the use of AI for programming. But I think it's interesting to see just the list of kind of all star mathematicians who have signed this declaration, including, we should say, Terry Tao, who we just mentioned, is like, fairly excited about the use of AI, also signed this declaration saying, hey, wait a minute, we got to be like, careful and put some rules on the road here.
- [48:23]
B
Let me ask what I imagine will be a naive question, though, which is my extremely limited understanding of math, is that math, mathematics are natural laws of the universe, right? Like, this field is not invented, it is discovered. And my sense is that maybe potentially it is a field that could even someday be solved completely because we will just simply understand the structure of math and all of those laws of the universe. So I could imagine a group of mathematicians saying, hey, this is really exciting because this is going to accelerate us to sort of like getting to the teleological end of Our entire time discipline. But I'm not hearing that today. So what am I missing?
- [49:04]
E
Yeah, this idea is math invented or discovered?
- [49:07]
B
Right.
- [49:07]
E
It's kind of a never ending debate. Ten years ago, a little more than 10 years ago, Terry Tao won a big prize and he was asked that question and he's his answer, which I very much remember was, when you're doing math, it feels like you're creating something. But ultimately he kind of viewed it, I think he said, as an act of discovery. I just don't think mathematicians have any concern that we're about to run out of math to be discovered. And AI would have to be like a lot better to discover it all. We already know, you know effectively 0% of all the math there is to know. There's like a lot more out there. So I don't, I don't think that's a concern. Although that is a fun thing to imagine.
- [49:42]
C
Yeah, I'm just kind of wondering, like, is the future of AI in math more likely to be sort of a bittersweet acceptance or is there going to be this kind of principled resistance pushing back and saying like, no, this is still going to be the domain of humans?
- [49:57]
E
It's hard for me to believe and I can only speculate. No one knows the answer to this. I ask mathematicians, like frequently. Where do you think this is going? What is the future for, for you all? No one knows. It is just hard for me to believe that something that has been so important and central to human activity for so long is just gonna completely disappear and be replaced by pushing a button. I think we will be surprised by the way it turns out. Put me kind of voting in that middle camp, the Terry Tao camp, that like we're gonna human beings directing these machines in some important ways. Choosing which problems to set them on is gonna continue to be important. So math is gonna look a lot different. There's just like no doubt about it. It's gonna have to adapt in a lot of ways. Ways just like everybody in kind of almost any industry is. But I think there will be something quite impressive and different that comes out at the end.
- [50:44]
B
Well, Kevin, thank you for helping us balance the equation. Yeah.
- [50:47]
C
You've been integral to the show.
- [50:51]
E
Thank you guys. It was a pleasure to come on and check your work.
- [50:56]
C
We really appreciate it. Thanks, Kevin. When we come back, hat GPT.
- [51:22]
A
Maybe that's an urgent message from your CEO, or maybe it's a deepfake trying to target your business. Doppel. Is the AI native social engineering defense platform fighting back against impersonation and manipulation. As attackers use AI to make their tactics more sophisticated, Doppel uses it to fight back. From automatically dismantling cross channel attacks to building team resilience and more Doppel outpacing what's next in social engineering. Learn more@doppl.com that'S-O-P-P-E-L.com so there's a lot
- [51:54]
D
of noise about AI, but time's too tight for more promises. So let's talk about results. At IBM, we work with our employees to integrate technology right into the systems that they need. Now a Global workforce of 300,000 can use AI to fill their HR questions. Resolving 94% of common questions, not noise. Proof of how we can help companies get smarter by putting AI where it actually pays off. Deep in the work that moves the business. Let's create smarter business IBM this podcast
- [52:24]
F
is supported by Only Fantasy on Audible. From the earliest days of the Internet, people have shared concepts online. But then came a platform that promised to put creators in charge of their own destiny. While you've heard of OnlyFans and its creators, Only Fantasy is here to challenge what you think you know about the platform. In this new investigative podcast, journalist Leon Nayfak teams up with comedian and OnlyFans creator Gracie Kanan for a one of a kind exploration into the current state of human connection. Listen to Only Fantasy wherever you get your podcasts or binge. All episodes ad free right now only on Audible. Start your Audible subscription in the Audible app or on Apple pay podcasts.
- [53:00]
C
All right, Kasey, before we go, we did have some other tech news that we wanted to discuss this week in our segment Hat GPT.
- [53:11]
B
Hat GPT. Of course, our segment where we take news stories, put them in a hat, draw them out one by one, riff on them a bit, and then when one of us gets bored, we say stop generating.
- [53:22]
C
And then we solve a formal math theorem that's a new twist on the game.
- [53:29]
B
All right, what's our first item today?
- [53:30]
C
First out of the Hat. A San Francisco startup is secretly testing robots in Airbnbs and trashing them. Lawsuit claims this one comes to us from the San Francisco standard. Casey, did you hear about this robot testing that's going on in the Airbnbs?
- [53:46]
B
I did, you know, and this is a thing. There are all of these well funded robotics companies and they need to just practice doing household chores over and over and over again, trying to generate lots and lots training data. And apparently a lot of Airbnbs are now caught up in the crossfire yes.
- [54:01]
C
So, on April 12, a Ring camera in San Francisco captured footage of people moving large black cases into a home in San Francisco. Two days later, the house's owner stopped by the house to take out the trash, looked through the window, and saw black cables taped to the walls. A man was typing at a laptop sitting next to what appeared to be a robot. And when the guest checked out 11 days later, the house was a. Everything had been removed from the kitchen cabinets and the dishwasher was scratched, and everything. Everything was amiss because this startup had been training their robots in this person's house without his knowledge.
- [54:41]
B
I have to say, I've rarely felt less sympathy for anyone on our show than the people who opened up their Airbnb to a robot company.
- [54:49]
C
Well, they didn't know they were opening it up to a robot company.
- [54:51]
B
Doesn't matter. I subscribe to the A lab theory. That's all landlords are bastards. So, look, if you have enough money to buy a place and then you just want to rent it out and charge people these usurious cleaning fees and make them take out the trash on their way out the door, I have no sympathy for you. Let a robot in there. Airbnb was a 2010s phenomenon. Everyone's staying in hotels again. We have to do something with these spaces. We might as well let a robot mess them up. Am I wrong? Tell me I'm wrong.
- [55:19]
C
You're wrong. You should not be able to just bring in a bunch of robots in body bags to an Airbnb and have them screw up the house. Or if you do, there should be a cleaning fee. And this. The owner of this house is now suing this company, called the Bot Company, for renting his Airbnb under false pretenses to do robot training. And he's seeking, wait for it, $12,383.50.
- [55:45]
B
That is now the median cleaning fee on Airbnb anyway. I'm telling you, this is a normal Airbnb situation.
- [55:50]
C
Cost of doing business.
- [55:52]
B
Stop generating. Okay, now, next up, Trump sides executive order seeking oversight of AI models. This from Shira Frankel and Trip Mickle here at the Times. President Trump signed an executive order on Tuesday that asked technology companies to voluntarily give the government oversight of new AI models before releasing them to the public. There is a big change here from an earlier version that got scrapped a couple of weeks ago, which is that the number of days that the government will get to review models is down from 90 days to 30. And apparently that was enough for former White House AI star David Sachs to give it his blessing. Kevin, what do you make of the new Trump eo?
- [56:30]
C
So, Casey, what is going on here? Because when we talked to Sundar Pichai a couple of weeks ago, he was going to the White House to
- [56:38]
B
be
- [56:38]
C
there for this EO signing. But then that got delayed because apparently David Sacks had a fit and didn't like something that was in the order. So now we have this 30 day provision. I just very confused about the state of the AI order and whether David Sacks is still kind of running the show from the shadows over there.
- [56:57]
B
Well, he's not the AI Czar anymore, but he definitely still has sway. And there are some within the administration who believe that if the government is able to hold up the release of a new model for 90 days, that could hurt American competitiveness. If you bring it down to 30 days, they're just not as concerned. So that's the change that was made. I mean, the part that just makes me roll my eyes at all of this is just that the fact that all of this is still voluntary. Like, I think we are past the point where frontier models actually should actually have to submit to mandatory required testing before they inflict these models on the public. But we're still not there yet, which
- [57:31]
C
was voluntary to do the 30 days,
- [57:34]
B
it's voluntary to submit it. And then the government has 30 days to, I guess, you know, give you notes.
- [57:39]
C
I see. I'm still confused about the state of AI regulation in this country. And my going assumption is that until I see something that is, you know, passed into law and signed, we are just sort of operating in the vibes universe.
- [57:52]
B
Yeah. If the state of AI regulation is, hey, what do you guys want to do? What sounds good to you? What would be good? What would work for you?
- [57:58]
C
Stop generating. All right, what's next? Okay, we've got us is said to be investigating George Santos. Haven't heard that name in years over Cali betting. This one comes to us from our colleagues at the New York Times. Federal authorities are investigating whether former U.S. representative George Santos engaged in insider trading by betting on a prediction market about whether he would show up at President Trump's State of the Union address in late February. And Kalshee has referred this matter to the Justice Department and the CFTC for further investigation.
- [58:37]
B
So say a bit more because am I right that there were maybe some indications that he was going to go to the State of the Union, but then it appears that he may have become aware of that and then gone and placed a bet that he Would not go and then did not go. Yes.
- [58:50]
C
So the pattern of facts as we understand them is that just before the State of the Union, George Santos goes on on social media and says that he's going to attend, but he missed the speech. And around the time of the event, Kalshee detected that he had bet against his own attendance. So we salute a legend.
- [59:09]
B
This diva truly will go down in her story. George Santos isolated. Now, look, there's a very narrow category of crimes, Kevin, for which I think you should not get in trouble. And this is absolutely one of them. If. If you are out there on social media engaging in trickery to get people to lose money in a prediction market, that I actually think should not be a crime. Or at the very least, I think you should get one for free.
- [59:34]
C
Yes, very funny. It's always the ones you most expect. And this is going to be just a hilarious genre of, like, silly crime stories over the next few years is just increasingly famous people just getting caught with their pants down betting on prediction markets about events that they themselves control.
- [59:52]
B
Yeah. I will say, as an aging millennial, it is very appealing to me, the idea that I could profit from saying I was going to go to a party and then not go. That we've all had that dream.
- [60:03]
C
We've been doing that for free for years.
- [60:04]
B
Truly.
- [60:05]
C
What's wrong with us?
- [60:06]
B
Okay, stop generating.
- [60:06]
C
Stop generating.
- [60:09]
B
All right, this next one comes to us from 404 Media. Hackers simply asked Meta AI to give them access to high profile Instagram Instagram accounts. And it worked. Hackers say they used a Meta AI support chatbot to break into a host of high profile Instagram profiles by asking the support bot to change the email address associated with the target account. The claims coincide with a series of high profile Instagram account takeovers, including the Barack Obama White House account, the Chief Master Sergeant of Space Forces account, and Sephora's account. Kevin, what do you make of the fact that you can just apparently access someone else's Instagram account by asking Meta AI?
- [60:46]
C
Well, I just want to say my old pal@Mea AI, Nasty Nancy, would never have done this. She would have upheld the integrity of these Instagram accounts. But now they've turned it over to this crazy chat bot who's just giving away people's passwords.
- [61:02]
B
Look, I know, I know it seems like this story is bad for meta, but I actually think it's good because we have finally found something that Meta AI is good for. And I'm not sure that I could name a second thing. So Congratulations to the super intelligence.
- [61:13]
C
I learned about this when someone posted the apparent account credentials and cell phone number of Mark Zuckerberg on X. So I have not tried the number yet to verify that it works, but it appears that you can just go on and ask Med AI for anything.
- [61:27]
B
I'm going to guess that that's not actually his contact information and is in fact some sort of phishing scam that would, you know, harm you.
- [61:33]
C
Only one way to find out. Everyone, try calling Mark Zuckerberg at.
- [61:40]
B
Kevin, you know we have a strict no doxing policy here on the show.
- [61:43]
C
Okay, well, I'll save that for our bonus content.
- [61:45]
B
All right, stop juddering.
- [61:47]
C
Next up, United. Oh, this. This is my favorite story of the week. United flight forced to turn around because of a Bluetooth speaker name. That's the Verge headline. A United Airlines flight from Newark to Mallorca, Spain last Saturday night had to turn around about two hours after takeoff and do an emergency landing due to security concerns over a Bluetooth signal. The crew on the flight asked for passengers to turn off their Bluetooth devices multiple times. And everyone compl except for one speaker that belonged to a 16 year old boy and was named Bomb.
- [62:28]
B
It's pretty funny because it's like there's maybe only one word in the English language that you could name your Bluetooth speaker that would force an emergency landing and you picked it, brother. Congrats. That's so true.
- [62:39]
C
I was following the story on Reddit where there were like, weirdly, a number of passengers on this flight were like active on Reddit. And so during, they were like, the pilots and the, you know, are coming on and telling us that we all have to turn off our Bluetooth devices immediately what's going on and you kind of follow it in real time and finally they figure out, yeah, there's this Bluetooth speaker and when you connect it, it shows up on the little list of Bluetooth devices as bomb, which is a very bad name for a Bluetooth speaker.
- [63:03]
B
Don't do that. It's a very bad name for a Bluetooth speaker. Unless you plan on playing some bomb ass tunes. You know it. Look, it's all about context. Also, I like, I have news for people who are, you know, I don't know, running airport security. Most bombs that would blow up planes, you cannot actually connect to them via
- [63:21]
C
Bluetooth and are not named bomb in the Bluetooth list.
- [63:24]
B
These are not discoverable devices that are advertising themselves as what they are.
- [63:30]
C
It reminds me of like, do you remember when people used to give their like Home WI fi networks, like names like, you know, CIA surveillance van or something. It's like, like the real CIA surveillance van is not named that.
- [63:41]
B
Yeah, look, I think we, we have a very important message to deliver to airline security, and that is you guys got to have a sense of humor, you know? And I, I mean, guys need to relax, live a little, take a chill pill. It was a damn Bluetooth speaker. Do you know how irritated I would be if I was two hours into my flight into Mallorca? And now we gotta turn around.
- [63:58]
C
Yeah.
- [63:58]
B
Trying to get to that beach.
- [63:59]
C
All right, last one out of the hat.
- [64:01]
B
You didn't say stop generating.
- [64:03]
C
Stop generating. Okay, last one out of the hat. Oh, Casey, this one's in your wheelhouse. Survivor boss Jeff Probst says Ki and Polymarket are, quote, incentivizing people to lie, cheat and steel. This one comes to us from Variety. Apparently there was some drama on Survivor recently when one of the episodes was spoiled due to widely circulated reports about the odds on these prediction markets. Kalshi and Polymarket. On both platforms, Aubrey Bracco was forecast to have an above 80% chance of winning before this season even premiered.
- [64:38]
B
Yeah, so this is a story that brings together two of my favorite things, which are Survivor and hating on prediction markets. You know, we have talked on the show about the fact that one of the main things that prediction markets do is incentivize you to betray your friends, family, co workers and possibly your country. And so what Jeff Probst is noticing is that now, like all of his crew members could stand to make a ton of money, you know, by betting on one of these prediction markets. Now, it is important to say that it does. We, we, we do not currently have information to suggest that this is what happened. Like, we don't know if somebody in particular on the Survivor or crew who may have leaked the information, but now we're just living in a world where everyone is suspicious and, you know, I mean, I think it just contributes to the low trust society that we're already living in. So this is obviously very bad. But let me take this opportunity to say, Kevin, that while I do think that Aubrey was played, played a great game and had a great season, I have to give a shout out to the greatest player to never win the game, Serie Fields, who truly came so close on this season and was amazing to watch every single week and I was absolutely crushed when she lost. So just incredible, incredible work, Sari, and incredible work to the Survivor team for putting out 50 really amazing seasons of television.
- [65:52]
C
Only like one or two of which you could bet on on prediction markets. I mean, they were just doing this for the love of the game. We have to start pretty soon. Like a segment that's just about people getting caught for doing stupid stuff on prediction markets. Because in addition to the George Santos thing and the Survivor thing, there was also a story about a Google engineer who was charged with using inside information to make a million dollars on Polymarket by PL bets on allegedly what users were searching for. So truly no corner of society is safe from the corrupting influence of prediction markets.
- [66:27]
B
Yeah, when you've got that Google money and you're still trying to make a little extra scratch by like corrupting a prediction market, something's gone wrong in this society.
- [66:35]
C
Yes. So that is hat GPT. Let's close the hat.
- [66:40]
B
Close up the hat.
- [66:52]
A
Maybe that's an urgent message from your CEO. Or maybe it's a deep fake trying to target your business. Doppel is the AI native social engineering defense platform fighting back against impersonation and manipulation. As attackers use AI to make their tactics more sophisticated, Doppel uses it to to fight back from automatically dismantling cross channel attacks to building team resilience and more. Doppel outpacing what's next in social engineering. Learn more@doppel.com that'S-O-P p e l.com the
- [67:23]
D
thing about AI for business, it may not automatically fit the way your business works. At IBM we've seen this firsthand. But by embedding AI across hr, IT and procurement processes, we've reduced costs by millions, slashed repetitive tasks, and freed thousands of hours for strategic work. Now we're helping companies get smarter by putting AI where it actually pays off, deep in the work that moves the business. Let's create smarter business IBM.
- [67:53]
F
This podcast is supported by Only Fantasy on Audible. From the earliest days of the Internet, people have shared content online. But then came a platform that promised to put creators in charge of the their own destiny. While you've heard of OnlyFans and its creators, Only Fantasy is here to challenge what you think you know about the platform. In this new investigative podcast, journalist Leon Neyfawk teams up with comedian and Onlyfans creator Gracie Kanan for a one of a kind exploration into the current state of human connection. Listen to Only Fantasy wherever you get your podcasts or binge all episodes ad free right now only on Audible. Start your Audible subscription in the Audible app or on Apple podcasts.
- [68:29]
B
Heart Fork is produced by Whitney Jones and Rachel Coh were edited by Veren Pavic or effect checked by Caitlyn Love. Today's show was engineered by Chris Wood. Original music by Alicia But It Marian Lozano, Rowan Nimisto and Dan Pout. Video production by Sawyer Roque and Chris Shot. You can watch this whole episode on YouTube@YouTube.com hardfork Special thanks to Paula Schumann, Huiwing Tam and Dalia Haddad. You can email us@hardforkytimes.com with all your solutions to those Erdos problems.
- [69:02]
C
It's called Erdos. That's what I said. You said Erdos.
- [69:30]
E
This podcast is supported by the Freedom From Religion Foundation. America is an idea, but progress isn't guaranteed. Today, those founding principles are being challenged
- [69:39]
C
by efforts to mix religion and government.
- [69:41]
E
The Freedom From Religion foundation is working to protect the Constitution and keep power where it belongs with we the people. This visit FFRF US NYC or text NYC to 511-511- text NYC to 511-511 and keep state and church separate.
- [69:58]
F
Text fees may apply.