AI Forensics· 7 November 2023· TikTok

TikTok's Role in Youth Mental Health

With Amnesty International: a two-part audit found TikTok's recommendation system could rapidly lead young users toward content glorifying self-harm and suicide.

Executive summary

AI-generated

This summary was generated by AI from the original report to make it easier to scan and cite. It is not a substitute for the source — read the original above.

AI Forensics, working with Amnesty International and the Algorithmic Transparency Initiative, tested TikTok's recommendation system with roughly 40 automated and manually configured accounts built to resemble 13-year-old users in Kenya, the Philippines, and the United States. The study tracked how quickly and how heavily the For You feed surfaced content related to mental health, self-harm, and suicide.

Accounts registered in the Philippines received a mental-health-themed video within about 67 seconds, and more than half of recommendations in a 12-minute session touched on anxiety, depression, or self-harm. US-based accounts reached similar content within roughly three minutes, including posts normalizing or glorifying suicide. Kenya-based accounts shifted more gradually but still reached 72% mental-health-related recommendations after 40 minutes; none of the surfaced content originated from qualified mental health professionals.

The researchers describe the pattern as evidence of structural weaknesses in TikTok's recommendation system across different regional contexts, calling for stronger safeguards to protect minors from algorithmically amplified harmful content.

Think this summary is wrong? Contact us.