TikTok Safety Feature Investigation

Summary

Bloomberg Businessweek Podcast Summary

Episode: TikTok Safety Feature Investigation
Date: August 6, 2026
Hosts: Carol Massar, Tim Stenovec
Guest: Olivia Carville (Investigative Reporter, Bloomberg News)

---

Episode Overview

This episode delivers an exclusive investigation into a confidential TikTok document revealing that the company deliberately withheld a safety feature meant to interrupt filter bubbles of depressing and self-harm content—for 10% of U.S. users as part of an experiment. The reporting centers on the tragic case of Chase Neska, a 16-year-old who died by suicide after TikTok’s algorithm repeatedly pushed him distressing content. The discussion explores algorithmic responsibility, the broader landscape of lawsuits against social media companies, and the tradeoffs tech firms make between user safety and engagement.

---

Key Discussion Points & Insights

1. The Confidential Document: Context and Revelations

[01:51 – 05:52]

• Carol Massar introduces the investigation as a “Bloomberg Businessweek exclusive” and brings guest Olivia Carville in to break it down.
• The story’s focal point is a confidential TikTok document, stemming from Carville’s questions following the suicide of Chase Neska in early 2022.
• Carville details how Chase’s mother, searching for answers, discovered his TikTok feed was overwhelmed with distressing, suicide-encouraging videos:
  • “She was shocked by the fact that the algorithm was sending him non stop, distressing, depressing videos, many of them encouraging suicide.” (Olivia Carville, [02:28])
• This prompted TikTok to conduct an internal review of Chase’s account, producing a confidential document now at the center of the investigation.

2. Who Was Chase Neska?

[03:38 – 04:47]

• Olivia Carville emphasizes Chase’s background:
  • “He was a high school junior, an elite athlete, really good at swimming, really good at soccer... There was no depression, no anxiety in his background. He was an honors student.” ([03:40])
• His suicide was “a mystery to his friends, to his family” until the TikTok algorithm’s influence was revealed.

3. The Filter Bubble and the Withheld Safety Feature

[04:28 – 06:12]

• The document revealed Chase was placed in a “filter bubble” of self-harm content:
  • “That’s like an online echo chamber where he is repetitively recommended depressing sad videos...” ([04:29])
• In early 2022, TikTok developed a “filter bubble prevention strategy” to break up repetitive content, seeking to protect users by mixing sad content with unrelated videos—but withheld this safety feature from 10% of U.S. users (about 15 million people) as a control group to study engagement levels.
• “They withhold 15 million Americans from this safeguard because they want to test engagement.” ([04:57])

4. “By Design”: The Conduct and Its Legal Implications

[06:13 – 07:26]

• Carol Massar presses on the significance of TikTok withholding the safety feature “by design.”
• Carville explains this mirrors language found in current litigation against social platforms, where platforms are accused of being “dangerous and addictive by design.”
  • “For the first time, we’re seeing a social media platform use that same language that they experimented on millions of US users, including teenagers, and that as part of that experiment, they…withheld a safety feature from one of those teenage users, quote, by design.” ([06:29])

5. TikTok’s Response

[07:26 – 08:10]

• Tim Stenovec reads TikTok’s official response:
  • "The company was, quote, deeply committed to the safety and well being of users, especially teens. Our hearts break for any family that experienced a tragic loss... invest significantly in trust and safety..." ([07:26])
• Carville notes TikTok’s large investments: a 40,000-person trust and safety team and more than $1 billion annually. She points out “sometimes these decisions are made too fast without thinking about the impact on the user.” ([08:10])

6. The Broader Legal and Social Context

[08:29 – 10:24]

• The hosts discuss the surge in litigation:
  • “More than 4,000 personal injury lawsuits have been filed accusing social media companies of harming children's mental health... 1,200 school districts have filed the same case...42 states, state attorneys general file suit against the companies alleging the same thing.” (Olivia Carville, [08:57]–[09:09])
• Carville details how plaintiffs gained access to millions of internal company documents through “discovery,” revealing behind-the-scenes strategies that prioritized engagement.
• Tech companies face “a trade off between user safety and user growth... too often the companies... are dialing up the user growth priority and dialing back the user safety priority.” ([10:34])

7. Timeline and Congressional Testimony

[11:00 – 12:53]

• Carville lays out the critical timeline:
  • In March 2023, while TikTok was reviewing Chase’s case internally, its CEO testified before Congress about child safety.
  • Congress specifically asked if TikTok knew of any suicides linked to their platform’s content.
  • “TikTok does not believe that use of the platform has caused users to commit suicide.” (company statement read by Carville, [12:21])
• The importance of timing: “He testified two weeks after that in depth review that TikTok did of Chase's account.” ([12:23])

---

Notable Quotes & Moments

• On the stakes:
  • “This story is about a document. What is this document? What does it tell us?” (Carol Massar, [01:51])
• On filter bubbles:
  • “He was pushed into a filter bubble of suicide and self harm content. That’s like an online echo chamber...” (Olivia Carville, [04:29])
• On company intent:
  • “They, they withheld a safety feature from one of those teenage users, quote, by design.” (Olivia Carville, [06:29])
• On the safety vs. growth tradeoff:
  • “How do we keep the platform growing as fast as it can, but keep it as safe as it can be for the users?” (Olivia Carville, [10:34])
• On timing and candor:
  • “They responded to congressional questions and put on the record that they didn’t believe that…their platform had caused any users to commit suicide. And this was said after this review was conducted...” (Olivia Carville, [12:33])

---

Key Timestamps

• [01:51] – Episode topic introduced; Olivia Carville joins to explain the confidential TikTok document.
• [02:28] – Chase Neska’s story and algorithmic content exposure.
• [04:29] – How the filter bubble worked and what it did.
• [04:57] – Safety feature withheld from ~15 million US users (the “control group”).
• [06:29] – Legal implications of “by design” terminology.
• [07:26] – TikTok’s official response.
• [08:57] – Litigation numbers and consolidation of cases.
• [10:34] – The “trade off” between user safety and growth.
• [11:21] – Congressional query about TikTok and suicides.
• [12:23] – TikTok’s written response and timeline importance.

---

Summary

This episode shines a spotlight on the ethical responsibilities of social media companies, specifically TikTok, as investigative reporting uncovers internal decisions to withhold user safety features for the sake of experimental engagement data. Through the lens of a preventable tragedy, listeners gain insight into the ongoing legal battles, tech industry practices, and the urgent “tradeoff” between rapid growth and user wellbeing. The hosts and their guest urge listeners to consider the real-world consequences of these algorithmic choices and the importance of transparent, ethical platform design.

Transcript

[Commercial Narrator]

What if data didn't sit still? What if intelligence moved with us? Not buried in reports, but activated in real time. Where lives are being shaped, where decisions are being made. It all starts with a where is the potential? Totality turns data into clarity, intelligence into insight, insight into action. Because when intelligence moves, we all move forward. Intelligence beyond bounds.

[Jacob Goldstein]

This is Jacob Goldstein from what's yous Problem? Running a business is hard enough. Don't make it harder. With a dozen apps that don't talk to each other. One for sales, another for inventory, a separate one for accounting. That's software overload. Odoo is the all in one platform that replaces them all. CRM, accounting, inventory, E commerce, hr. Fully integrated, easy to use and built to grow. With your business, thousands have already made the switch. Why not you try Odoo for free at o d o o.com that's odoo.com

[Commercial Narrator]

aging is real and so are the benefits of new vital proteins. Collagen, sparkling water. Because around the age of 30 your body needs backup to keep your collagen up. So get your daily glow up now in three fresh flavors. Strawberry blossom, lemon, lime and blood orange. Improved skin health in as little as 30 days thanks to collagen peptides. Cheers to that. So you can stay vital. Stay you. Visit vitalproteins.com to learn more and where to buy. These statements have not evaluated by the Food and Drug Administration. This product is not intended to diagnose, treat, cure or prevent any disease.

[Carol Massar]

Bloomberg Audio Studios Podcasts Radio news.

[Tim Stanovec]

You're listening to Bloomberg Business Week with

[Olivia Carville]

Carol Massar and Tim Stanovec on Bloomberg Radio.

[Carol Massar]

We do want to get to a Bloomberg Businessweek exclusive Original reporting. It's on a story about a confidential document that says kept a safety feature from millions of TikTok users. About 15 million by design. As part of an experiment, one of those users died by suicide. There is a lot of careful reporting here to get to the story by the award winning and recognized Bloomberg News investigative reporter Olivia Carville. She joins us here on set. This story, by the way, is also today's Bloomberg Big Take. Olivia, good to have you here. This story is about a document. What is this document? What does it tell us?

[Olivia Carville]

Thank you so much for having me on. So I think it's important to have context around this document and for that we've gotta go back in time. Early 2022, a 16 year old boy from Long island took his own life. He died by suicide. After this happened, his mum, who didn't understand went searching through his social Media accounts, trying to find like a sense of what had happened to him. When she found his TikTok account, she was shocked by the fact that the algorithm was sending him non stop, distressing, depressing videos, many of them encouraging suicide. A year later, I reach out to the company because I'm writing a story about this young boy and the way the algorithm was sending in so much sad content. And I asked the company what had happened to Chase, NASCAR's account. Why is the algorithm sending him all of these videos about suicide? That sparked an internal review at TikTok. It's an extraordinary review where they do a deep dive into his watch history, what he was seeing in the weeks, days and hours before he died. And that review is what is contained within this confidential document.

[Tim Stanovec]

Tell us more about Chase. Who, who is he?

[Olivia Carville]

Chase was a, a 16 year old boy from Long Island. He was a high school junior, an elite athlete, really good at swimming, really good at soccer. He had a big group of friends. He had no mental health issues. There was no depression, no anxiety in his background. He was an honors student. There was no warning shots that there was a, you know, a concern with his own mental health. This, his death was a mystery to his friends, to his family. But what happened in January of 2022 is that this young teenage boy started sharing very dark videos on TikTok with his friends, videos about suicide. They didn't understand why he was sharing this content and it happened very quickly. And this document tells us why.

[Carol Massar]

What does it tell us?

[Olivia Carville]

It tells us that this teenage boy's account, this very normal teenage boy, was pushed into a filter bubble of suicide and self harm content. That's like an online echo chamber where he is repetitively recommended depressing sad videos, many of them encouraging suicide. And it tells us why he was pushed into that filter bubble.

[Carol Massar]

So, so let's go there. Why was he pushed into this so called filter bubble?

[Olivia Carville]

So again, if we go back in time in early 2022, TikTok has realized that these filter bubbles can be quite harmful for its users. And at this point, TikTok has 150 million American users. They want to make the platform safer, so they design a feature to break up repetitive videos about the same topic. So rather than getting sad video, sad video, sad video, you get sad video, funny video, happy video, silly video, they want to break up those filter bubbles. So they roll out this feature which they call a filter bubble prevention strategy. But they hold back 10% of US users. That's one of the most important figures in this document. They withhold 15 million Americans from this safeguard because they want to test engagement. They want to understand how the safety feature is going to impact how long you logged on for.

[Carol Massar]

So this group that they held back, who didn't get essentially the safety feature right, that was their control group.

[Olivia Carville]

That was their control group.

[Carol Massar]

So this was an experiment.

[Olivia Carville]

This was an experiment in their own words in this document. They refer to it as an experiment. And Chase Neska was in that control group.

[ChatGPT Advertisement Narrator]

The.

[Tim Stanovec]

Go ahead, Carol.

[Carol Massar]

Well, one thing I want to ask because you, you and I have talked about this story and I've read it and we've read it. When they held it back in the document, TikTok says they held it back. They held back the safety feature by design. Why are those two words important?

[Olivia Carville]

Those two words are so important, Carol, because right now in US Courts, there is a broad litigation alleging that social media platforms are dangerous and addictive by design. That these companies have created platforms that are engineered for addiction. That what their main goal is is to keep you logged on for as long as possible, regardless of how that may impact your mental health. And so for the first time, we're seeing a social media platform use that same language that they experimented on millions of US users, including teenagers, and that as part of that experiment, they, they withheld a safety feature from one of those teenage users, quote, by design. This was the company intentionally, deliberately holding back that safeguard it speaks to.

[Carol Massar]

There was an awareness, right?

[Olivia Carville]

That's right. It speaks to intent.

[Tim Stanovec]

I want to read the company's response that they sent you. In response to questions about the document, a TikTok spokesperson sent a written statement saying the company was, quote, deeply committed to the safety and well being of users, especially teens. Our hearts break for any family that experienced a tragic loss. The spokesperson said, quote, to help protect our community, we continue to invest significantly in trust and safety, including robust detection systems and dedicated enforcement teams that proactively remove content that violates our community guidelines.

[Carol Massar]

So, Olivia, that was the company's response in the last couple of weeks.

[Olivia Carville]

That was the company's response this week to this story. And it's important to point out that TikTok has 40,000 people working on their trust and safety team. They have huge investments.

[Tim Stanovec]

How many people?

[Olivia Carville]

40,000 people working on trust and safety. More than a billion dollars is spent trying to safeguard this platform. So there are huge efforts underway to do this. But I also think what this document shows us is that sometimes these decisions are made too fast without thinking about the impact on the user.

[Tim Stanovec]

Can you talk about this, and you answered this a little bit before we read the statement. But the broader trend of social media companies over the couple of years, I mean, you and the team did a great documentary on this about the pressure that they've come under, not just from lawmakers, but also from lawsuits that have been filed on behalf of families.

[Olivia Carville]

Yeah, and I was mentioning the litigation earlier. So this is thousands of lawsuits that have been filed right across the country.

[Carol Massar]

Can I just put a number? Because then you put a number on it. You said more than 4,000 personal injury lawsuits have been filed accusing social media companies of harming children's mental health. Many, though. Right. Have been consolidated.

[Olivia Carville]

Yep. Being consolidated into two tracks, one in state court, one in federal court. In addition to those 4000 lawsuits, 1200 school districts have filed the same case against the social media platforms, alleging that they are addictive and that they have drained school resources on like mental health counseling. And in addition to that, we're seeing 42 states, state attorneys general file suit against the companies alleging the same thing. So there is massive litigation unfolding across the US right now. We saw the very first trial earlier this year where Google and Meta were held accountable for harming the mental health of a 20 year old woman. And documents like this are surfacing right now because of that litigation. These companies went through a two year discovery process and they handed over more than 6 million internal documents to the lawyers. So now we get a first kind of behind the scenes look at what was really happening inside the world's biggest social media platforms as they fought to grow their users. And this is an incredibly competitive space. You know, the main goal is to keep you logged on for as long as possible and they don't want to lose users to other platforms. And so this is, this is part of that.

[Carol Massar]

I mean, that's the thing, right? It's about bringing more users and then also like kind of managing against safety, like managing those two things and what

[Olivia Carville]

it's called in the trust and safety space, Carol, it's a trade off, a trade off between user safety and user growth. How do we keep the platform growing as fast as it can, but keep it as safe as it can be for the users? And too often the companies, according to these lawsuits and according to previous reporting, are dialing up the user growth priority and dialing back the user safety priority.

[Carol Massar]

What's so important in this story? And I highly recommend people check it out also on the Bloomberg, but you can tell in the reporting you're very careful about laying out the timeline. I just want to go back to that for a moment because there was a congressional hearing back in March on March 23, 2023 with TikToks CEO answering questions from lawmakers. Is that an. That's an important moment in time too,

[Olivia Carville]

hugely important for this timeline. So if we think about what's happening now that we have this document, we know that inside the company they were doing this, this review of Chase NASCAR's account to try and understand what had happened to his account and why he was receiving so many videos about suicide. They figure out why and that's because he had that safeguard withheld from his account. And that same month, that very same month, the CEO is testifying before Congress answering questions about child safety. And I do wanna point to just one of the follow up questions that they got from Congress. They were asked specifically how many cases is TikTok aware of where users have committed suicide after receiving sad, depressing or suicide promoting videos? We know the company knew that it had seen those kind of videos to Chase NASCAR because of this document. And this was the written response. TikTok does not believe that use of the platform has caused users to commit suicide.

[Carol Massar]

And again, what's key is timing in all of this which you lay out is he testified two weeks after that in depth review.

[Olivia Carville]

Right.

[Carol Massar]

That TikTok did of Chase's account.

[Olivia Carville]

That's right. This was in the written responses to Congress that came from the company rather than from, from TikTok CEO. We're not aware of whether or not he was aware of this review, but the company responded to congressional questions and put on the record that they didn't believe that, that their platform had caused any users to commit suicide. And this was said after this review

[Carol Massar]

was conducted, as we said, laid out. And, and the dates and the timeline are so important as well as some of the words that were said. Thank you so much. We really appreciate it.

[Commercial Narrator]

Always.

[Carol Massar]

Bloomberg News investigative reporter Olivia Carville her full reporting. It is today's Bloomberg Big take. It is on the Bloomberg. It can also be [e-mail] this is

[Jacob Goldstein]

Jacob Goldstein from what's yous Problem? Running a business is hard enough. Don't make it harder with a dozen apps that don't talk to each other. One for sales, another for inventory, a separate one for accounting. That's software overload. Odoo is the all in one platform that replaces them all. CRM, accounting, inventory, E Commerce, hr. Fully integrated, easy to use and built to grow with your business. Thousands have already made the switch. Why not you try Odoo for free at o d o o.com that's odoo.com

[Commercial Narrator]

Aging is real, and so are the benefits of new vital proteins. Collagen Sparkling water Because around the age of 30, your body needs backup to keep your collagen up. So get your daily glow up now in three fresh flavors Strawberry blossom, lemon, lime and blood orange. Improved skin health in as little as 30 days thanks to Collagen peptides. Cheers to that. So you can stay vital. Stay you. Visit vitalproteins.com to learn more and where to buy these statements have not been evaluated by the Food and Drug Administration. This product is not intended to diagnose, treat, cure or prevent any disease.

[ChatGPT Advertisement Narrator]

Some people use ChatGPT to answer questions. Others use it to get real work done. With ChatGPT work, you bring the goal plus real inputs like briefs, notes, files, feedback, data and project plans. It can help turn them into an analysis, tracker, deck, outline, prototype or workflow you can review and keep shaping. You stay in control, giving direction and choosing the final output. Put ChatGPT to work on your most ambitious ideas and projects. Get [e-mail] by selecting work mode available on plus and Pro plans.