← 99% Invisible
99% Invisible
The Score
00:26:08
We keep score of everything these days. But what happens when the numbers start changing what we actually care about?
Loading summary
Transcript80 lines
- [00:00]
Sierra Miller
Hi, it's Sierra Miller. I can't wait for you to check out my new collection of shoes and accessories at Designer Shoe Warehouse. If you love shoes as much as I do, then trust me, I got you. From cute sneakerinas to the perfect flip flops to stunning heels, these shoes are all style, no drama. It's a girls girl summer. And DSW has just the shoes. Shop the Sierra Miller Collection right now at your DSW store or dsw.com
- [00:30]
Angie Hicks
hi, I'm Angie Hicks, co founder of Angie. One thing I've learned is that you buy a house, but you make it a home. For decades, Angie's helped millions of homeowners hire skilled pros for the projects that matter. Angie the one you trust to find the ones you trust. Find a pro for your project@angie.com this is 99% invisible.
- [00:48]
Roman Mars
I'm Roman Mars. Professor C T Nguyen teaches philosophy at the University of Utah, and he says the reason he got into this field is because he is drawn to life's big questions.
- [01:01]
C T Nguyen
These weird, romantic, bizarre questions, like about the meaning of life and what is art for? Like, are we just wasting our time doing our dumb hobbies or is it the best part of life? Those were the questions I cared about.
- [01:17]
Roman Mars
But when he started teaching philosophy, thi learned that what makes a good philosopher at a prestigious school had less to do with pursuing curiosity and had more to do with metrics. Your value as a philosopher seemed based on whether your papers were getting published in highly ranked philosophy journals.
- [01:34]
C T Nguyen
There's no moment where anyone told me to care about it, but everyone just talks in that language and suddenly you just find yourself kind of automatically thinking that your goal is to publish in the top ranked journals and that that's what success means in philosophy.
- [01:49]
Roman Mars
Suddenly, all the joy was sucked out of this thing that he loved so much.
- [01:53]
C T Nguyen
I was so bored with what I was writing because I was trying to go up this list and so miserable that I was going to quit the profession after, like, having burned 10 years in it.
- [02:04]
Roman Mars
Instead of giving up, t decided to do something that seemed like career suicide. He threw out those metrics of success and went after something harder to measure his own curiosity. This is the story Connecticut Wen uses to open his latest book, the how to Stop Playing Someone Else's Game. In it, t expands the definition of games to encompass all the ways metrics and scoring systems systems play out in our lives for good and for ill. From those dreaded philosophy journal rankings to duolingo step counting and beyond. I love this book and I was so excited to talk to T about it. We had a delightfully meandering conversation about the philosophy of games, the trap of metrics, and how to make sure we're playing the game we want to be playing. Our chat started with me asking T to define a concept he coined called value capture.
- [02:57]
C T Nguyen
Value capture is what happens when your own values are rich or subtle or developing in that direction. And then you get put in a social setting, an institution, or with a technology that feeds you simplified, typically quantified versions of your values, and then the simplified versions take over.
- [03:16]
Roman Mars
You have been here, you have been value captured. It happens all the time. Maybe you start going to school because you want to learn, or you start walking more for your health, but then you get focused on a metric like getting all A's or counting steps, and suddenly you're very far from the values that drove you to do those things in the first place. This kind of dynamic is everywhere.
- [03:37]
C T Nguyen
One of my favorite examples, a lot of these things are so insidious that I hadn't realized that Agreeswitch internalized this. And I've been working on this stuff for, like, five years. And I was sitting there watching my kid being like, you know, I should reduce his screen time. So screen time is this massive metric for a lot of us, but then if you think about it, it's a crap metric. One week, my screen time skyrocketed. The reason my screen time skyrocketed was I was reading two different translations of Kant on my iPad.
- [04:05]
Sierra Miller
Right?
- [04:05]
C T Nguyen
That's not. That is not a bad thing for me to do. But I was watching my kid, I'm like, oh, I'm supposed to reduce his screen time. And one of the things I noticed is that sometimes when he's on his screen, he's watching the dumbest possible ASMR videos. Sometimes he is literally learning geopolitics. He's obsessed with videos that explain the history of the rise of World War I and World War II. He's nine. Sometimes he is playing dumb clicker games. Sometimes he's building architectural masterpieces in Minecraft with, like, coded logic gates. These are not the same thing. Right. There's no way in which these are valuable in anything like, the same amount. But it's very easy for a device to capture screen time. And I think this is part of my core worry here, is that we're outsourcing our values to an external product or institution. And sometimes that's a classical story of evil. Somebody, like some Machiavellian tells us what to value. But A lot of the times, like a lot of outsourcing, what we're outsourcing it to is a process that's convenient at scale. What's determining how a lot of us parent is just that. Screen time happens to be an easy thing for our devices to measure automatically without any particular input from us.
- [05:20]
Roman Mars
T says that forcing the things we value into the sausage grinder of metrics can often flatten nuance and meaning in favor of generating a value that's more simple and measurable. It is, and often feels awful and reductive, and yet we can't help being seduced by it. Why do you think it is that you and others actually find this kind of value capture framework so tempting and rewarding enough that it pulls you into this type of engagement?
- [05:49]
C T Nguyen
I mean, life is full of these complicated existential value clashes where you have to make these nauseating decisions. I mean, I think every day I'm faced with the decision of whether to spend more time playing with my kids or more time doing hobbies I enjoy or more time staying up late doing extra email. That's a terrifying decision that asks me to weigh these very different values. But if you automate it, if you decide there's only one thing that's important and that everything feeds into that thing in a mechanically measurable way, suddenly you're sheltered from the existential storm. You're safe. So that's one answer. The second answer is the seductiveness is making yourself comprehensible and communicable to other people. This is something I do, I have done, and I'm very embarrassed about. So while I was researching this book and looking at scoring systems, I started reading about yo yo and I got really into yo yoing. Yo yoing is super interesting, modern yo yoing. There's been technology revolutions. It's gotten super complicated. It blew up with skateboarding. Really interesting and intricate topological structures you build. But I just want you to imagine me being an apparently adult philosophy professor at a dinner party, having to tell other people that I've been goddamn yo yoing in my free time. People look at me like I've gone nuts and they look at me like I'm making a joke. Because trying to explain. I mean, I think in any of your. Anybody, in any weird obsession you have, when you actually get to the reason that's important, the reason that really moves you, it's not going to be very accessible to people that aren't deeply in that thing.
- [07:36]
Roman Mars
T argues that one of the reasons yoyoing seems like a goof is because it doesn't really have understandable metrics. We excuse adults doing childish things. If there's a record to beat or a score to measure, those things would make yo yoing comprehensible and therefore would make you understood as a human and understood instantly.
- [07:55]
C T Nguyen
I think that's there's not. I mean, I think there are a lot of weird things that I love, that if someone trusts me and we spend some time together, I can transmit that. But metrics make you comprehensible instantly at scale.
- [08:12]
Roman Mars
Hearing all this, it's easy to get the impression that scoring systems and metrics are more or less evil. That although they're alluring in their simplicity, which can help us feel understood, they end up draining the life out of everything we hold dear. But actually, T would disagree. He argues that in the right context, scoring systems can also be a way to unlock connection, creativity, and even great joy. And the place that this is most readily visible is in gameplay.
- [08:39]
C T Nguyen
This is the paradox I got obsessed with, right? In games, scoring systems are beautiful. And then in metrics, scoring systems often seem like they're responsible for the worst
- [08:49]
Roman Mars
part of our lives.
- [08:49]
C T Nguyen
For the destruction of education, for the destruction of the arts, for the like, destruction of the entire environment, ecosystem, and everything that we care about. And it's good. And the thing I was trying to figure out is why scoring systems gave us such delightful play in games and gave us such soul draining awfulness in metrics.
- [09:15]
Roman Mars
T and I both love games and the design of games. And so we got really into talking about the magic of games and why exactly the scoring systems that hurt us in life can make games so rewarding.
- [09:28]
C T Nguyen
The funny thing about scoring systems is they are kind of little dictators. They tell you what you're supposed to want and value. And that's the weird thing. Scoring systems are little definitions of success and failure. I think one of the biggest differences is that in games those definitions are temporary and playful and under your control. And if you don't like it, you can throw it away and you never have to play again. And in institutions, they're authoritarian.
- [10:00]
Roman Mars
Like a true philosopher, Teague considers all kinds of things. Games, board games, rock climbing, even fly fishing. And something that kept coming up for him in writing this book is the way that in games, scoring systems are an integral part of the fun.
- [10:14]
C T Nguyen
One of the things that got me writing this book was that I had spent a bunch of years trying to explain what games were, and I ended up saying that there were these beautiful structures that use scoring systems to give Us alternate selves that they gave us alternate desires. And a game just told you make baskets, collect sheep, get to the top of the rock, and suddenly this thing you might never have cared about before, like getting to the top of some weird boulder, you're like, I need to do it. And then suddenly this whole new activity unlocks.
- [10:46]
Roman Mars
Now I love playing games with my kids. And since my kids are all over the country now, we plan game nights like months in. And I am just competitive enough inside of a game to make it fun. I am not trying to lose, I am definitely trying to win. But I have to say, at the end of the night or even at the end of any round of game, I cannot tell you who won that game. I cannot imagine caring about a game's outcome. I've never been able to describe this to people, but thi explained it to me that there are two types of play. Striving play and achievement play.
- [11:18]
C T Nguyen
Achievement play is caring about winning, right? Achievement play is caring about is playing because you actually want to win. Striving play is when you temporarily get yourself to want to win in order to experience the struggle. So the difference between the two is not about how intense you are about trying to win. You can be a striving player and be trying really intensely. The difference is the striving play values the experience not if they win, but if the struggle was interesting.
- [11:49]
Roman Mars
I am 100% a striver, but I still get wrapped up in the goal and drama of the game when I'm inside that game. So my family plays this game called Wingspan and it's a beautiful little game that is more intuitive than all the little pieces and dense rules would have you to believe. But my stepdaughter hates this game. She hates Wingspan. Because I swear a lot when I play this game, there are often these scenarios when I need a certain like card poll or a roll of the dice to make a very long planned strategy pay off and. And I often don't get that card that I want and hence the swearing. Since I am a very calm, non volatile presence in her life, she hates hearing me swear. And this game just brings it out of me more than most. I don't know why, but it turns out this freedom to swear, to connive and compete, is actually part of the magic of games. They give us this healthy arena for feelings that aren't so healthy in the real world.
- [12:46]
C T Nguyen
One of the interesting things about games is they're a place where we're released to do something like that. Jan Husinga, an Anthropologist who studied games in the early 20th century, one of the first great scholars of play. He said that what makes games and play distinctive is that they occur in a magic circle where the meanings of what you do are screened off from ordinary life. So what this means is like, you know, if we're close friends and then we're playing basketball against each other and you block my pass, I'm not going to come up after you afterwards and be like, how could you do that to me? You wound me, my friend. I thought we were close, right? And because the meanings are screened off in that way, because the points, I mean, part of the point is the points are valueless, right? And we know that galactically, even if in the game we're really into it, which makes us released. To be like, I try so hard in my life to be a nice person and to be a kind person, but there's a part of my brain that is a complete Machiavellian asshole. And I have to keep that under wraps most of the time. I don't get to do that. And in the game environment, because it's so screened off from the rest of life in just this simple way, I can do that. It is part of the contract of gaming that when I play with my family or my friends, we can go all out, we can lie to each other, we can, you know, manipulate, we can deceive each other, we can look for each other's weaknesses and destroy each other because we know that the gaming environment has designed to turn that into an interesting struggle.
- [14:29]
Roman Mars
Yeah, yeah. A great example that you give of striving play is fly fishing, which is a thing I, I also, I don't. I've. I love it. Like I have a fly fishing cat. I went to a fly fishing class. I haven't sort of gotten off my ass to do fly fishing, but I just admire everything about it. And the more I learned about it, the more I admired it. Could you talk about the fly fishing in terms of striving play?
- [14:54]
C T Nguyen
Yeah, fly fishing is really interesting to me. So I am in Utah and in Utah there are a lot of dudes with this very obsessive interest in fly fishing. So fly fishing I thought was about. I don't know what it. I thought it was just like, about having fancy gear and about like repeatedly casting and casting and casting. And what I found about fly fishing was what's interesting is that it's actually a sport about attention. So what you're doing, if you're fly fishing, especially in the style, I like which is dry fly fishing, which is where you're trying to get a fish to swim up and eat a bug off the surface. What you're often doing is walking along a river, in a river looking for either actually being able to see a trout rising or being able to see the quality of water where a trout is likely to be under the water. And then you have to figure out what kind of bugs it's feeding, which means you have to be really attentive to what is hatching and in the air, which can change every 20 minutes. And so what the game does is it forces you to hyper focus on small, subtle visual details across a huge ecological landscape. And one of the things I found interesting is if I go to a river without the fly fishing game, I look at the river for like a minute and then I'm bored and I look away. If you give me the game, then I can zero in on the surface of the water and have focus for hours. And it's really like two or three hours into focusing intensely on a river that I achieve like, I don't know, like these like weird altered mental states of complete, like zenned out brain water have flowed together. But I think it's really funky. The game is a support structure for that kind of attention. It's very hard to get there there on your own. When I try seated meditation, I can't get there. If someone's like, pay attention to the river until your mind empties and merges to the river. I'd be like, I have no idea how to do that.
- [17:07]
Roman Mars
What?
- [17:08]
C T Nguyen
But if someone's like, look for trout and then notice what insects are and then try to cast, then that's like a little tangible thread that I can crawl my way into this subtle, subtle mental state. One of the interesting things about games is you don't need to understand them for them to act on you. Right. Like, what a game is, is it tells you to do something and it gives you some constraints and you're like, I don't know, what's that for? And you just try it, do it.
- [17:40]
Roman Mars
Yeah.
- [17:40]
C T Nguyen
And then suddenly you have these discoveries of, I see this all the time. Like people playing Dungeons and Dragons for the first time, playing like a social communication party game. Like the mind for the first time, trying rock climbing for the first time. They don't know what it's for. They don't know the reasons why anyone would do it. Someone talked to them to do it, they try it. And the rules kind of force them into an intentional posture of looking at the world and seeking out, looking for holes in the rock, looking for little bugs in the air. And suddenly they're doing that. And then something happens to their mind and body and they find that there's some like, weird, new radiant kind of beauty that they hadn't known about and that they couldn't have chased directly. This is the magic of games.
- [18:24]
Roman Mars
More with t win after this.
- [18:28]
Sierra Miller
You're never just one thing.
- [18:29]
C T Nguyen
You're the boss.
- [18:30]
Angie Hicks
Hey Google, when's my next meeting?
- [18:32]
Sierra Miller
The athlete that class wrecks me and their mom. Everyone in the all new Mazda CX5 more to move every side of you. Learn more@mazdausa.com Google is a trademark of Google LLC. Sequences shortened and simulated. You know that thing where you get an amazing pair of shoes at a really great price and want to tell everyone about it?
- [18:50]
Angie Hicks
Yeah.
- [18:50]
Sierra Miller
So do we here at Designer Shoe Warehouse. We'll give you something to brag about, like the latest styles from brands you love or the trends everyone's obsessing over or shoes that make you feel like, well, you. So go ahead, show off a little. Buying shoes that get you and prices that get your budget. Head to your DSW store or dsw.com today. DSW. Let us surprise you.
- [19:13]
Angie Hicks
Hi, I'm Angie Hicks, co founder of angie and one thing I've learned is that you buy a house, but you make it a home. Because with every fix, update and renovation, it becomes a little more your own. So you need all your jobs done well. For nearly 30 years, Angie has helped millions of homeowners hire skilled pros for the projects that matter, from plumbing to electrical roof repair to deck upgrades. So leave it to the pros who will get your jobs done well. Angie the one you trust to find the ones you trust. Find a pro for your project@angie.com Breathe in.
- [19:45]
GoToBank Announcer
Feel the sense of calm that comes from having up to $300 in overdraft protection with GoToBank.
- [19:51]
Roman Mars
Now.
- [19:51]
C T Nguyen
Did you say $300?
- [19:53]
GoToBank Announcer
Yes. Now back to our breathing.
- [19:55]
C T Nguyen
So if I overspend my balance, Goto bank has my back up to $300.
- [20:00]
GoToBank Announcer
Yes. Can we breathe out now? Less worries, more zen. With over $300 in overdraft protection. Tap to open an account today. Eligible direct deposits and opt in required for overdraft protection fees. Terms and conditions apply.
- [20:16]
Roman Mars
We're back with C T ng. I'm really interested in how to use metrics for good because objective measures and transparencies are key components to good government, progressive era politics. And we've talked about Robert Moses A lot on the show. And before he became the villain of the Power Broker, he was championing civil service reform. And that's all about measuring achievement, taking tests and making sure people got jobs because they deserved them and not because they were someone's nephew. So how do we use scores and scoring systems in an effective way to make the world a better place and have them not dominate our lives in a bad way?
- [20:55]
C T Nguyen
One of the most famous cases, I think, is the quantification of policing in New York police districts. So in the early days, people said, like, look, all these police districts say that they're doing well. We can't tell if they're doing well. So we're going to put clear metrics about what we can measure, which is how many cases get closed, right? How many arrests do we make? And what happened was in the first bunch of years, it worked great. It detected all kinds of corruption, all kinds of bias, and it forced people to rid it, get that out of the system. And then after a little while, I think in a story that a lot of people know that I learned from the TV show the Wire, people started like gaming those metrics, right? You can game those metrics easily. One way to make your case closure rate look good is to discourage people from reporting crimes, right? One way to up your case closure rate is speeding tickets, because you open the case and you close at the same time. So in the beginning it gets rid of corruption and bias because the metrics are so brute that everyone can understand them. And after a period of time, they seem to drain what's genuinely valuable from the system because they point people at something that's very easily and mechanically checkable and measurable.
- [22:17]
Roman Mars
So in T's policing example, metrics start out as being helpful and in service of offering transparency to the public, but eventually they end up being counterproductive and sometimes even dangerous. And he told me that a similar dynamic can play out with population wide statistics where you're trying to get a sense of trends on a really big scale.
- [22:36]
C T Nguyen
What makes metrics work well is that they work at scale really fast, so they're really good for us to coordinate around for vast social efforts. So if you're going to coordinate the entire world around reducing CO2 emissions or increasing vaccination rates, right? That's a really simple thing. And when we count it in the same way, we can cooperate really easily. The cost is there are only certain kinds of things that we all measure in the same way and count in the same way that we can coordinate around. So here's that suggests another answer, which is that some kinds of targets are naturally stable at scale and easy for everyone to count at scale. And it's easier to get good metrics of that. So I'll give you an example. It's much easier to get a good metric for lifespan and mortality rate than it is to get a metric for mental health. Everyone counts lifespan and deaths in the same way. These other things aren't counted the same way. So it is appropriate in those cases because the kind of thing that's being targeted is the kind of thing that's stable at scale. But the worry, the price, is that we tend to socially overattend to those qualities that we over attend to lifespan and mortality rate instead of mental well being, flourishing community, flourishing social relationships.
- [24:04]
Roman Mars
So I guess the point I'm wondering is what do we do with all this? How do we live and thrive in a world where we have no choice but to engage with these metrics in so many areas in our lives?
- [24:18]
C T Nguyen
Yeah. So I would like to give you the peppy answer of just grit up and play with the institutions in your lives. But that's not. I mean, I think one of the things we know is that if you quit a game, nothing happens. And if you quit your KPIs or your other metrics in your work, you get fired and then you starve and then your family dies. It's not the same, but I think you can still there are a few things you can do. One thing you can do is at least have some ironic distance. I think there's a huge difference between someone thinking my goal in life is to have the most subscribers versus my goal is to communicate and have all these other things. And I need subscribers to do it. But I'm willing to trade off against it. Right. That's one thing.
- [25:00]
Roman Mars
Yeah. The last thing T told me about though, was my favorite approach to living in a world defined by metrics without letting them define you. He talked about finding little places in your life where you can choose to create or define your own metrics, which lets you design the game you actually want to be playing.
- [25:21]
C T Nguyen
I complained about metrics forever, and then I realized I was in charge of a huge one for my students. My grading system for my students is a scoring system that I have. I am an authority and I was just being an unthinking authoritarian. And so this might amuse you, but the last two years as I've been thinking about this, I decided that I had not realized the degree to which, as I complained about the Tyranny of metrics. I was turning around and imposing it on my students. And so I've been trying an experiment. I have been letting my students design their own scoring systems. So what I've been doing in my tech and design ethics class is walking in and saying, none of us have any clue what to do about ChatGPT in the classroom. And so, as an exercise in the class, we will talk about the philosophy of education, AI and democracy, and then they will democratically design their own grading system and assignments for the class. And that's something I could have done all along and I didn't realize it.
- [26:21]
Roman Mars
How did that go?
- [26:22]
C T Nguyen
Amazing. Unbelievable. Let me tell you. First of all, process over outcome. The grading system they designed was actually quite good, but the process of coming up with it was more valuable than any other assignment I've ever done.
- [26:40]
Roman Mars
Wow.
- [26:40]
C T Nguyen
They get so invested, and they ended up talking seriously about what an education was for, what a grading system was for, what the use of AI was for, what all of it meant. They took it super seriously, and I think, among other things, it taught them systems thinking. They started having to think about how the design of a grading system changed in education and how you get good and bad design. And I think part of what I was trying to do was get students to see what you're trying to get people to see, which is that all these quiet design decisions in the background totally change how people interact. Like, who cares? In some sense, I mean, they did come up with a good grading system, but I kind of don't care if they did, because the process of coming up with it actually got me what I wanted from the class in the first place.
- [27:27]
Roman Mars
I had just a great time talking with you. I love the book, the Score. I just. I had so much fun reading it, and I had so much fun sort of like looking at it and using it to decode my life and my choices. I really appreciate it.
- [27:38]
C T Nguyen
Thank you. Thank you so much.
- [27:43]
Roman Mars
99% invisible was produced this week by Lashma dawn and edited by Kelly prime, mixed by Martine Gonzalez. Music by Swan Rhiou. Kathy Tu is our executive producer. Kurt Kohlsted is our digital director. Delaney hall is our senior editor. The rest of the team includes Chris Barube, Jason De Leon, Emmett Fitzgerald, Christopher Johnson, Vivian Le, Joe Rosenberg, Jacob Medina Gleason Talon and Rain Stradley and me, roman Mars. The 99% invisible logo was created by Stefan Lawrence. We are part of the Sirius XM podcast family now, headquartered six blocks north in the Pandora building in beautiful uptown Oakland California. You can find us on all the usual social media sites as well as our own Discord server. There's a link to that as well as every past episode of 99pi@99pi.org.
- [28:39]
Angie Hicks
Hi, I'm Angie Hicks, co founder of Angie and one thing I've learned is that you buy a house but you make it a home. Because with every fix, update and renovation you it becomes a little more your own. So you need all your jobs done well. For nearly 30 years, Angie has helped millions of homeowners hire skilled pros for the projects that matter, from plumbing to electrical roof repair to deck upgrades. So leave it to the pros who will get your jobs done well. Angie the one you trust to find the ones you trust. Find a pro for your project@angie.com Breathe in.
- [29:11]
GoToBank Announcer
Feel the sense of calm that comes from having up to $300 in overdraft protection with GoToBank now.
- [29:18]
C T Nguyen
Did you say $300?
- [29:19]
GoToBank Announcer
Yes. Now back to our breathing.
- [29:22]
C T Nguyen
So if I overspend my balance, Goto bank has my back up to $300.
- [29:26]
GoToBank Announcer
Yes. Can we breathe out now? Less worries, more zen. With over $300 in overdraft protection, tap to open an account today. Eligible direct deposits and opt in required for overdraft protection fees. Terms and conditions apply. In the US there's a break in every 26 seconds. But when intruders step near Simplisafe, home security steps up.
- [29:47]
Roman Mars
Stop.
- [29:47]
C T Nguyen
This is Simplisafe.
- [29:48]
Roman Mars
Police are on the way.
- [29:50]
GoToBank Announcer
Using AI alerts, US based live agents help deter break ins. SimpliSafe no long term contracts.
- [29:55]
Sierra Miller
Save 50% on your new system with
- [29:57]
GoToBank Announcer
professional monitoring at SimpliSafe.com sxm or with
- [30:01]
Roman Mars
promo code sxm Outdoor deterrence requires a
- [30:03]
C T Nguyen
Simplisafe Active Guard Outdoor Protection plan starting
- [30:05]
Roman Mars
at $49.99 a month. Visit simplisafe.com licenses for alarm license information. Tennessee 2012.