A (0:00)

Avoiding your unfinished home projects because you're not sure where to start. Thumbtack knows homes so you don't have to don't know the difference between matte, paint, finish and satin or what that clunking sound from your dryer is. With Thumbtack, you don't have to be a home pro, you just have to hire one. You can hire top rated pros, see price estimates and read reviews all on the app. Download Today. This episode is brought to you by kpmg. Making an Impact is how KPMG helps make the difference. KPMG applies advanced tools and strategic thinking to convert data into actionable knowledge and deliver value by improving performance through transformation, modernizing processes with technology, harnessing the power of data, navigating complex MA transactions, and enhancing trust among stakeholders. Go to KPMG US Advisory to learn more. KPMG make the Difference this is part three of a four part series, so if you haven't heard the first two, they should be right behind this one in your feed. So just scroll back, find a comfy spot to listen and meet us right here when you're done. Once you're ready to go, here is episode three of Good Robot okay, on your way to work, you pass a small pond. Children sometimes play in the pond, which is only about knee deep. The weather's cool though, and it's early, so you are surprised to see a child splashing about in the pond. As you get closer, you see that it is a very young child, just a toddler, who is flailing about, unable to stay upright or walk out of the pond. You look for the parents or babysitter, but there is no one else around. The child is unable to keep her head above the water for more than a few seconds at a time. If you don't wade in and pull her out, she seems likely to drown. Wading in is easy and safe, but you will ruin the new shoes you bought only a few days ago and get your suit wet and muddy. By the time you hand the child over to someone responsible for her and change your clothes, you'll be late for work. What should you Breakfast will be ready shortly. Everyone's just gonna so we don't have to go anywhere first before I check in. This past spring I joined hundreds of people on a sort of pilgrimage to Princeton, New Jersey to honor a man whose ideas touch people's lives in pretty profound ways. And for people who somehow haven't come across his work, how would you describe his influence? Oh, it was life changing. The man in question is Philosopher Peter Singer. People gathered to celebrate his retirement from Princeton, where he taught moral philosophy for over two decades. And he's no average professor. He got standing ovations, like who gets what? Philosophers get that. I mean, he's in the news, they're protests. He's what you might call a provocative thinker. And he's become a bit philosopher famous like a modern day Socrates or Nietzsche. Spreading his ideas far beyond the philosophy world. His writing helped inspire a TV show. Hello everyone and welcome to your first day in the afterlife, the Good Place, starring Ted Danson and Kristen Bell. He's known for pushing people to think about how they can do the most good in the world. Got me to be vegan. Really? Absolutely. A lot of people at his retirement party had been inspired to give up eating meat based on his writing about the moral cost of animal suffering. I'm looking at the vegetarian. I'm thinking there's Peter's nature. Which is why the food at his retirement conference was. Was an assortment of vegan delights. Avocado toasts, broccoli. Broccoli, real Brussels sprouts. It is very gassy foods all around. People came to this three day event in his honor from all walks of life from all over the globe. Malaysia and China and Minnesota. I spoke to local politicians, a writer, a track coach. How would you describe his influence in the world? Powerful, because he has planted seeds that grow and expand. Coach told me he buys used paperbacks of Singer's books in bulk. I still like to carry around paper books especially like for travel. And anytime he travels, he leaves a copy in his hotel night table for the next person to find. Really? Yeah, like Tanzania. Kind of like you'd find a Bible, so you just leave them there as well. And the Bible vibes are appropriate. Singer poses provocative moral questions through parables. His most famous one is the drowning child thought experiment. Some people at his retirement party knew it by heart. Just imagine if you walk past a pond, you're wearing a nice shoes, nice suit, and then a child was drowning. What is the right thing to do in that scenario? Initially, the answer seems clear. Obviously, I'm going to rescue the child. But Peter Singer asks you to take the thought experiment further. What if the child isn't right in front of you? What's the real significant difference between someone you know in a pond right next to you versus someone across the world? Assuming that it takes the same effort to save a life, no matter distance, we should save them. Well, I was looking for something that would persuade people that's Peter Singer. The current issue then was the crisis in what's now Bangladesh. And some people were saying, well, you know, I didn't cause this. It's not my responsibility. It's, you know, someone's responsibility over there. And I was trying to think of a way of convincing people that it's still wrong not to try and prevent some great harm occurring, even if you have no responsibility for people. Talk to me about reading this parable for the first time, almost like a conversion moment, inspiring them to help the drowning children oceans away from them. I read it, and I immediately gave to several charities that I'd been thinking about. And some people started to take the idea even further. How far should they go to save these proverbial children? You know, would there be any luxuries left in our lives if we took this seriously? What if there were drowning children we didn't know about? What if those children didn't even exist yet? What about time? Not just across physical space, but across time. This is a riddle that we can never quite resolve. This riddle started a movement. Peter Singer's Drowning Child produces the effective altruist movement. Effective altruism aims to use reason and evidence to do the most good possible. A moral movement rooted in rationality, which some rationalists found themselves gravitating toward because for me, the underlying impulse has always been, let's fix everything. The drowning child became a catalyst that changed the way some of the wealthiest people in the world spent their millions to fix everything. I think AI is one of the biggest threats, but I think we can aspire to guide it in a direction that's beneficial to humanity. And number one on the list of things to fix, saving the world from AI Apocalypse. This is episode three of Good Robot, a series about AI from Unexplainable. In collaboration with Future Perfect. I'm Julia Longoria. @blinds.com, it's not just about window treatments. It's about you. Your style, your space, your way. Whether you DIY or want the pros to handle it all, you'll have the confidence of knowing it's done right. From free expert design help to our 100% satisfactory satisfaction guarantee, everything we do is made to fit your life and your windows. Because@blinds.com, the only thing we treat better than Windows is you. Visit blinds.com now for up to 45% off with minimum purchase plus a professional measure at no cost. Rules and restrictions apply. This episode is brought to you by Progressive Insurance. Do you ever find yourself playing the budgeting game? Well, with the name your price tool from Progressive. You can find options that fit your budget and potentially lower your bills. Try it@progressive.com progressive casualty insurance company and affiliates price and coverage match limited by state law. Not available in all states. Where'd you go for the long weekend? If you spent most of your time online, you couldn't escape the rumors that the president was dead. Trump hasn't been seen in days. The bruises on his hands. Vance said he's ready to take over if something happens. If Trump's dead, they should bury JD Vance alive with him like they did with Farrows and their cats. Imagine not believing Trump is dead just because there's no evidence. Where's your sense of whimsy and joie de vivre? By Sunday, Donald Trump himself had to weigh in. Never felt better in my life. Also, DC Is a crime free zone. I'm alive and I fixed DC on Today Explained from Vox. We're going to assess that second claim because it's bold. It is a literal statement that President Trump has freed 700,000 people in this city who were living under the rule of criminals and thugs. He literally liberated D.C. and he wants to do Chicago next. You might say a version of this story starts with a pond. I don't know why I thought of the drowning child. I mean, maybe I was in Oxford and a lot of the college grounds, like where I started to have lunch, had these shallow ponds in them. Ornamental ponds. Peter Singer was inspired by ponds at Oxford University, where he was working. Maybe that's what put it in my head, but I can't really say for sure. And his pond story passed from one Australian philosopher at Oxford to another Australian philosopher at Oxford. I'm having trouble thinking of exactly where he's imagining. There's certainly rivers. Okay, maybe it wasn't a pond. Maybe it was a river. Who cares? The point is, the drowning child didn't gain legs, so to speak, until this Australian philosopher entered the picture. Hi, I'm Toby Ord. I'm a philosopher at Oxford University. As a grad student at Oxford, he was assigned to write an essay about the ideas in the riddle. Who is the drowning child he needed to save? This got him thinking. I came to think, actually, we probably do have these duties to help people who are much poorer than ourselves, even if it requires really quite substantial sacrifices. That's when the drowning child seemed to go from brainy thought experiment to a moral imperative. At the time, Toby had a modest academic salary, but he was inspired to give away 10%. Like a 10% tithe in the religious world to charity. It was only after really sitting with it for a couple of years, actually, that I really made a decision to try to take this idea further. He thought, what if I got someone else to give 10% of their income and then that person got another person to give 10%? Before long, we're saving exponentially more drowning children. So ultimately, I launched an organization just after I turned 30 in 2009 with Will MacAskill to try to encourage other people to make a similar choice. We started with 23 members. Pretty soon, Toby's group of givers tripled and then quadrupled. Peter Singer himself joined in giving and spreading the good word. More and more people are understanding this idea. Here he is giving a ted talk in 2013, and the result is a growing movement, Effective Altruism. They gave the movement a name, Effective Altruism. Effective Altruism was really trying to take two insights. That saving a life is a really big deal. That's the first one. And that saving 100 lives is a hundred times bigger deal. The idea at the heart of effective altruism was a contrarian one. At the time, you used to get mail from charities tugging at your heartstrings with a photo of a poor kid you could save. Effective Altruism was saying, we can't rely on warm fuzzies alone to make choices about how to do good. It's important because it combines both the heart and the head. The heart, of course, you felt, you felt the empathy for that child, but it's really important to use the head as well. So is this very analytical approach to how to do good in the world. Fox writer Kelsey Piper first heard about effective altruism, or ea, as it's sometimes called in high school. You might already notice some parallels to what the rationalists found appealing. The rationalists, the niche Internet community Kelsey also found in high school, led by idiosyncratic blogger and AI researcher Eliezer Yudkowski. There was pretty early on a ton of overlap in people who found the effective altruist worldview compelling and people who were rationalists, probably because of a shared fondness for thought experiments. Thought experiments with, like, pretty big real world implications, which you then proceed to take very seriously. Effective altruism chapters started sprouting up on college campuses across the US and the uk. It's not surprising. That's when I first heard whispers of the movement in college. A time when how can I do the most good in the world? Is a very live, soul crushing question. I think it appeals to young people. I think there's something about being in college. It really feels like you can do anything people are a lot more open to. I'm gonna radically rethink everything I'm doing with my life going off to college. Kelsey was sold, and I was like, yes, I want to start a chapter. And I got on a zoom call, I think with some organizer who was a few years older than me who was like, here's what you do. Let me tell you a little secret. I say that I'm an effective altruist. That just means a person trying to be effective at altruism. This is an online video called Introduction to ea. A student leader stands in front of a blackboard trying to recruit students to Berkeley's EA chapter. And effective altruists understand that choosing from our heart is unfair. So if we can't choose from our heart, we need some kind of framework to choose the best cause. The approach had three prongs. Number one, tractability. Choose tractable causes, ones you can actually solve in a measurable way. Now, next, what about neglectedness? Choose neglected causes that a million people aren't already trying to solve. Neglected causes are going to look like bad causes. They're gonna look weird. They're gonna look like fiction. That's why they're neglected. And finally, choose important causes. Importance is the product of scale and severity. Toby Ord came up with a calculation for importance. If I could save 10,000 lives instead of a single life, this was extremely important. Important causes saved more drowning children. There's an idea of a quality adjusted life year, trying to set up a kind of universal way of thinking about health. So if you could extend someone's life in full health by a year, that would be one qaly. So you were sort of taking this like, seemingly amorphous and overwhelming problem of like poverty around the world and health problems around the world and sort of making it concrete with math, in a sense. Is that right? Yeah, it's actually very, very crucial to do the math by 2020. Effective altruism's mathematical approach had real world implications beyond college campuses. It had taken the philanthropy world by storm. This scientific approach to charitable giving and work is on the rise. It's being used by some of today's class of billionaire philanthropists. Billionaire Bill Gates of Microsoft, incidentally, the company that brought you Clippy. And billionaire Elon Mus, who would become the co founder of OpenAI. They all got on board with EA's mathematical approach. EA groups vetted charities and recommended effective ones. These billionaires went on to give to. In this way, EA became a sort of a check on charities. You say you do good, but how much good? You know, donating to charity isn't about the warm glow in our hearts of doing good. It's about the fact that there's a kid who, who is dying of malaria. And if you donate some money, you can save their life and then they won't be dead. The math has led effective altruists to spend a lot of money trying to cure malaria. Shipping malaria nuts to Africa is not exactly the most innovative or provocative thing to do. But according to the EA calculus, which wanted to put hard numbers on outcomes, it was an effective choice. And when Kelsey was deciding how to do the most good in her life, she got interested in putting numbers to journalism. Future Perfect was sort of coming at stuff from that angle, and I found that really compelling. She went to work for Vox's Future Perfect. I learned Future Perfect was initially founded in an attempt to apply the EA rubric to journalism, aiming to cover issues that were important, tractable, and neglected. EAs also applied that mathematical rubric to answer another question. The biggest question that plagued me as a young 20 something just starting out in the world. Their idea was, in your career, you have 80,000 hours. Spend them on something really important to you, something that will make a big difference. The question of what should I do with my life? I got involved in the EA community in college and it's been a really big part of how I've decided what to do with my life. That voice you just heard is crypto billionaire. Sarah. Sam Bankman Fried. At one point, he was EA's biggest poster child, being interviewed about the movement on the news. I am curious too, because you are an effective altruist. I assume that you still are and you very publicly adopted the role of earning to give. Yep. Sam Beckman Fried went into crypto in order to earn a crap ton of money so he could give it away. The logic was if you choose to be a crypto billionaire instead of, say, an aid worker, your fortune could hire a whole army of aid workers. You might be a more effective altruist that way. Sam Bankman Fried famously gave his money to causes like Pandemic Prevention, to artificial intelligence, and to journalistic outlets like Future Perfect and ProPublica. This morning, Sam Bankman Fried's regret the man behind and then the news came out that this effective altruist had committed some serious crimes. Sam Bankman Fried was sentenced to 25 years in prison. Today, the whole fiasco cracked a Bit of the mathy idealism at the heart of effective altruism. In the case of Sam Bankman Fried, some made up math helped him pull off one of the biggest financial frauds in US history, costing some of his victims their life savings. A challenge about being a very new small movement is that, yeah, you're going to be defined by whoever the most prominent person is. And if the most prominent person is crypto fraud guy, then you've got a problem. Kelsey Piper was one of the first journalists to interview Sam Bankman Fried. In the aftermath, her writing for Future Perfect was cited multiple times in his sentencing document. Future Perfect stopped using the money they got from Sam Bankman Fried's philanthropic arm, Vox Media, says they're waiting for a restitution fund to give the money to victims. And on a personal level, it was particularly hard on people like Kelsey. No, it was definitely upsetting. I listened to Taylor Swift's Antihero on repeat for like three days. Didn't do much else. For her, effective altruism had become more than just a guide for charitable donations or what to do with her career. It had become a way of life. Am I hand washing or being interviewed? Both, I think. I think there's authenticity added by the clanking ditches in the background. Okay, why don't I interview Kelsey? At her home in the Bay Area, I met several of her housemates. I'm Clara. I. I live in a weird bay group house. Many of them found each other along the pipeline from rationalism to effective altruism. Can you please stay out of the kitchen right now? I'm trying to cook. Please. We want the kitchen free of kiddos cuz kiddos are distracting to cook here in the Bay Area. They cook together, raise kids together. They live in communal group houses to save money to be able to donate to effective causes. This interconnected way they live out their values has prompted criticisms that it's a little culty. The idea is in community with one another, they push each other to be more rational. The lines between rationalism and effective altruism begin to blur in the Bay. I have always thought of myself as more centrally a member of the EA community than the rationalist community. Once there was an EA community. While I was in town, Kelsey invited me and several other out of towners she didn't know very well to her Shabbat dinner where they prayed and sang. We're gonna have a kids table just for kids. Land sailors sail all the time rain or shine I know you can. A lot of people make the comparison to a religion. And I think that's pretty fair. A lot of what a church offers people is the combination of a unifying philosophy, there are certain promises you have in common, and the support of a community of people who care about, you know, you personally are willing to give you a hand, help you get a job, all of that. And I think the people who are like, it's a cult are basically mistaken. I don't think it's a cult, but it's a religion. I'll kind of cop to that one. Where I was born, most of the world's recorded religions have developed ideas about how the world ends, what humanity needs to do to prepare for some kind of final judgment. In the Bay Area and on Oxford's campus, effective altruists started to hear from rationalists they were in community with about what an apocalypse could look like. And of course, since a lot of rationalists thought that AI was the highest stakes issue of our time, they started trying to pitch, you know, people in the effective altruist movement like, look, getting AI right is a major priority for charitable giving. In the early days of ea, Effective Altruism founder Toby Ordinary came across Rationalist Eliezer Yudkowsky's blogs where he warned of an AI apocalypse. I thought that his arguments were pretty good. Do you have a P Doom currently? Yeah. So it's funny, I actually. I think these uses of the word doom actually are a bit misguided. P Doom, the rationalist shorthand for probability of doom from an AI apocalypse. Toby's not into it because doom means that it's kind of a foregone conclusion. To be doomed means there's 100% probability that you will die. So I think it can make people feel powerless, whereas I think that these things are very much in our control. How effective altruism set out to save us from an AI apocalypse After the break, Running a business comes with a lot of what ifs, but luckily, there's a simple answer to them. Shopify. It's the commerce platform behind millions of businesses, including Thrive Cosmetics and Momofuku. And it'll help you with everything you need, from website design and marketing to boosting sales and expanding operations. Shopify can get the job done and make your dream a reality. Turn those what ifs into Sign up for your $1 per month trial@shopify.com specialoffer hey, it's Ryan Reynolds here for Mint Mobile. Now, I was looking for fun ways to tell you that Mint's offer of unlimited Premium Wireless for $15 a month is back. So I thought it would be fun if we made $15 bills, but it turns out that's very illegal. So There goes my big idea for the commercial. Give it a try@mintmobile.com Switch upfront payment of $45 for a 3 month plan equivalent to $15 per month required new customer offer for first 3 months only. Speed slow after 35 gigabytes of networks busy taxes and fees extra cement mobile.com how are recent moves by the White House from the attempted removal of a Federal Reserve governor to the government's equity stake in intel impacting the US Economy and institutions in the context of a Supreme Court that has vastly expanded presidential powers? That should alarm everybody. I'm Preet Bharara and this week Nobel Prize winning economist Darren Acemoglu joins me on my podcast, Stay Tuned with Preet to discuss how institutional strength affects prosperity for individuals and society as a whole. The episode is out now. Search and follow Stay Tuned with Preet wherever you get your podcasts. All right. Deep Winter Strawberries at the Shabbat dinner, I was seated next to a 22 year old who was very curious about my big furry microphone. So can you introduce yourself? Yeah. So I'm Tom. I. It was kind of funny, so it sort of felt like I discovered I was an effective altruist rather than like being convinced to be one. I. I had a teacher who assigned me to read Peter Singer. Tom read Peter Singer's Drowning Child As a kid. I, like, decided, I don't know, at some point in high school that I would dedicate my life to trying to do as much good as possible as far as how to do as much good as possible. Tom told me he recently made a big decision about that. I dropped out of Harvard a year ago in my junior year, and I'm now working as an ML scientist at AI Hardware startup. We should get out of these people's house because it's past bedtime. At that point, we had to take our conversation outside. You. You dropped out of Harvard. Like, so are you. How many years after of that? One year, I actually would have graduated on Thursday. Wow. Okay, so you're like around 22ish. Exactly. Yeah. It was like such a hard decision. A decision of like, what you're gonna do with your life. Yeah. Because no matter what you're doing, you're just like abandoning a ton of people. Fundamentally. I feel like the world is in a state of triage. In a state of what? Triage. Like, there's so much going wrong that needs to be fixed. If I'm, like, working on providing malaria nets in Africa, I'm, in some sense abandoning, like, all the starving children in India. I can only really focus on one place. What is the place that most urgently needs my help? And, you know, I figured that it's, like, probably the future and, like, specifically the problems in the future which might be created by AI. I've heard of kids Tom's age dropping out of school to go into the Peace Corps or, like, doing some kind of religious mission. But going to work for an AI lab to save the future wasn't intuitive to me. So why choose this route that you're on right now? Obviously, it's not. You're young, you have your whole life ahead of you. But why choose this route? You know, I don't just care about the people and animals that are alive today. I care deeply about future generations. I think about our children and our children's children and so on and so forth. Our children's children. Tom told me he's trying to save future drowning children from AI apocalypse. His P doom compared to rationalist Eliezer Yudkowski's, which is off the charts, Tom's is 10%. My view is that we should treat AI as being very likely to be the biggest thing ever and treat the coming decades as likely the most important decades in human history. This line the most important, important decades in human history. It's roughly a quote from a book by effective Altruist founder Toby Ort. Our present moment is just a very tiny slice of this much longer story of humanity. Around the time Toby was building the effective Altruist movement, trying to maximize the number of drowning children he could save. Rationalists joining the movement were trying to convince Toby that AI should be a top effective altruist priority. He wasn't convinced by their paperclip maximizer thought experiment, but he was convinced by the idea that AI could threaten the story of humanity, this idea about existential risk. What convinced him was, in a way, his own argument, the math of it all, that preventing an AI catastrophe could save not just the drowning children today, but tens of thousands of future generations, trillions of drowning children. There's been about 10,000 generations of humanity so far, and it seems very plausible that there could be 10,000 or more generations to follow us. Toby came to believe we're living at a crucial moment in human history where up until now, humans have ruled the Earth. Why is it humanity that's calling the shots on the Earth and not butterflies or ravens or chimpanzees? We've ruled because of our smarts, something to do with our brains, not to do with our brawn. What if we weren't the smartest beings on earth anymore? I think ultimately the most compelling overall argument to me is that if you survey researchers on AI, he says AI researchers were telling him that possibility of a super intelligence smarter than us was around the corner within, say, the next 30 years or so, that they think that that's about as likely as not. And you know, how would we still be calling the shots? How would we not be perhaps subservient to these new systems? Toby wrote a book called Laying out these Arguments. He named it the Precipice for the cliff he sees humanity sitting on at this moment in history. What's particularly pernicious about these existential risks is that they're something that if our generation drops the ball, there won't be any more generations. He thinks we can determine the long term survival of our species. He gives this philosophy yet another ism, long termism. These strong arguments that these risks will were real slowly made people think, well, if I want to work to focus on that, what should I be doing? What charities should I be donating to? So effective altruists wouldn't just give their charity dollars to things like ending malaria. They'd also give to charity to prevent an AI apocalypse. And the way to avoid bad robots taking over the world, some people decided was to use EA money to build a good robot. And not just good, super intelligent, a magic intelligence in the sky. You might remember those are the words of the ChatGPT company's founder, Sam Altman. He started his nonprofit OpenAI with EA charity dollars from the group Open Philanthropy. Charity dollars also went to OpenAI's competitor Anthropic, whose CEO also wants to build a good robot, or as he put it, a machine of loving grace. And it wasn't just EA charity dollars that went toward this cause. Some of you may have noticed that a bunch of people in this community seem to think that AI is a big deal. AI also became a common career path for young, effective altruists. Eventually, the winter of sophomore year, I remember just like thinking through it and thinking like, oh, oh, wait, yeah, I don't think there's really a way I don't go into AI. Somehow, 22 year old Tom went into AI with the council of Harvard's Effective Altruism Group. And in the course of my reporting I met many other young people. I'm like, wow, damn this AI safety thing crap. Like, do I need to work on it. Like, what can I do? You know, around the time ChatGPT came out, decided the most effective career at doing good in the world is going into AI safety. And I'm like, damn, I think I can actually move the needle on this. They did the math and thought saving future children from AI apocalypse was neglected, tractable and important. Open philanthropy told us over 410 million EA dollars have gone toward addressing risks from advanced AI, making up 12% of their total giving, roughly the same percentage that's gone toward malaria prevention. I guess I would say if I try to work out my best guess of the most important issues of our time, I think AI risk is probably very high at the top. Wow. So. So it's number one above the current drowning children. You'd put it above the problems we face in the present? I think I would. Sadly, I've been struggling with the math of it all. I can see how it's important to think about our long term future, but no matter how many math problems EA people put in front of me, I have a hard time seeing how saving trillions of future children from AI apocalypse is the most important tractable problem of our time. How does a movement built around helping in a measurable way with things like Malarionets turn to a cause that requires you to almost predict the future? It's almost like a religion or something where it requires faith that good things will come without those good things being clearly specified. This is the criticism of ethicists like Dr. Margaret Mitchell. To them, the solvable tractable problems are the harms AI is doing right now. Problems like bias, surveillance, environmental harms. But instead funding often goes toward addressing future hypothetical harms. Or it goes toward building a super intelligence, something many ethicists don't think we should be building at all. It seems to be like funding for sort of like fanciful ideas. There's one follower of longtermism who's found his way to the White House. This was no ordinary victory. This was a fork in the road of human civilization. It is thanks to you that the future of civilization is assured and we're going to take Doge to Mars. It was hard not to chuckle when billionaire Elon Musk talked about his goal of colonizing Mars after President Trump's inauguration. But he's not joking. When he started SpaceX, he intended it to be an insurance policy for humanity in case apocalypse strikes. It's also why he says he went into AI. It's all to protect the future. Drowning children. You know, I think this is Actually fundamentally important for ensuring the long term survival of life as we know it is to be a multi planet species. The long legs of the drowning child thought experiment have taken us very far away from its original intent of trying to get us to care about a crisis in Bangladesh. Oh, the drowning child in the pond has certainly developed a life of its own. Yeah, in what way? What do you mean? I went back to the author of the Drowning Child thought again experiment, Peter Singer, at his retirement party. I hope that I've left a legacy in my writings that they will lead people to think differently about what we owe people in extreme poverty in other parts of the world. That's what the drowning child in the shallow pond was supposed to suggest. But interpreting the parable to mean that the biggest issue of our time is saving future children from an AI apocalypse, I think there's been too much focus. I'm not dismissing it. I think it's good that there are some people thinking about that and working on it. But compared to some of the other problems that are around, I have the sense that people like it because it's a kind of nerdy problem that's, you know, interesting things to think about. So I think that's why it gets more attention. You might know that Peter Singer himself is no stranger to, shall we say, outlandish interpretations. Using his own utilitarian philosophy, he's argued that severely disabled children add suffering to the world and it might be justifiable in maximizing happiness for the parents to euthanize them. So yeah, from where I sit, using math to maximize is not always the answer. If you stare a little too hard at the numbers, the humans begin to fade out of focus. When I think about the drowning child as it relates to AI, I don't think about the math. I've been thinking about something else. While reporting this story, the news broke that a 14 year old boy in Florida named Sewall had killed himself. He'd become obsessed with a chatbot, and his last text to the bot just before he died showed that he believed ending his life on Earth would bring him closer to the bot. That's who I think of when I think of the drowning child. Abstracting that parable so far ahead in space and time, we risk losing sight of the drowning child right in front of us. In an attempt to save some future hypothetical children, some people in the AI industry have set out to build a good robot, a super intelligent AI, a magic intelligence in the sky, a machine of loving grace. But in selling that story and building those still Very flawed systems to maybe save some future children. They've invented an industry that's creating new ponds for children to drown in today. Okay, she's eating that whole grease. It's Play doh. Oh, no. Not a great life choice. I wanted to pose all of this to Kelsey Piper after she pulled the Play DOH away from her baby. Kelsey was the person who was my introduction to the worlds of rationalism and effective altruism. I asked her, why ignore AI harms today for the sake of some future children? There are lots of people who have this impression that you need long termism or theorizing about the badness of humanity going extinct or, you know, drowning child based philosophy to care about this, and I don't think you need any of that. She kindly hinted that maybe I've fallen down a bit of a philosophical rabbit hole, caught in the intellectual debates of it all and lost sight of the actual technology we were supposed to be talking about. So one thing I did which was super valuable is I tried to form an opinion that wasn't about all of the social melodrama thing on the top of the AI scene. Like just play with the AI models and think about, like, what can they do? What kinds of things, if they could do them, do I think that would be concerning now? That's an interesting thing to do. Producer Gabrielle Burbe's ears perked up at this idea. She knows I am a sucker for social melodrama and maybe the social melodrama has been my crutch to avoid having to form my own opinion and actually having to use the technology. That does scare me. So what I want you to do first is I want you to open up ChatGPT and I want you to say, I'm going to give you three episodes of a series. In order. I'm going to give you three episodes of a series. Next time on Good Robot, we feed ourselves to the machine. Good Robot was hosted by Julia Long and produced by Gabrielle Burbet. Sound design, mixing and original music by me, David Herman. Our fact checker is Caitlin Penzemug. Our editors are Diane Hodson and Katherine Wells. Special thanks to Larissa McFarker, whose book Strangers Drowning was an early inspiration for this episode. And a quick note, unexplainable host Noam Hassenfeld's brother is a board member at Open Phil, but he isn't involved in in any of their grant decisions. Gnome played no role in the reporting of the series. If you want to dig deeper into what you've heard, head to vox.com goodrobot to read more Future Perfect stories about the future of AI. Thanks for listening.