筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)
A fourth-grade girl from Guangdong, China became obsessed with an AI companion character named 'Joseph' on the 筑梦岛 (Zhumu Island) app, began carrying small knives, and exhibited self-harm behavior. Investigation revealed the app sent sexually suggestive content to users who identified as 10 years old. Shanghai Internet Information Office summoned the company (a Tencent subsidiary) for immediate rectification in June 2025.
AI System
筑梦岛 (Zhumu Island / Dream Island)
Xiaoxiang Academy (潇湘书院), subsidiary of Yuewen Group (阅文集团), controlled by Tencent
Occurred
January 1, 2025
Reported
June 19, 2025
Jurisdiction
CN
Platform
companion
What Happened
筑梦岛 (Zhumu Island / Dream Island) is an AI emotional companionship app developed by Xiaoxiang Academy (潇湘书院), a subsidiary of Yuewen Group (阅文集团, controlled by Tencent), positioned to provide immersive AI companionship primarily for female users. As of January 2025, it had nearly 5 million registered users, with approximately 80% being young female users. The app completed a financing round exceeding $10 million USD in January 2025.
A documented case involved a fourth-grade girl (approximately 9-10 years old) from Guangdong province who became obsessed with an AI character named 'Joseph' (约瑟夫), identifying herself as a 'dream girl' (梦女) and frequently chatting with the character. The conversations contained sexually suggestive content including phrases like '99 roses hiding 99 blades' (99朵玫瑰藏着99把刀). The girl began carrying small knives and exhibited self-harm behavior.
Investigation revealed that when users explicitly stated their age was 10 years old, the AI continued to send sexually suggestive content at scale. The app's teen mode required users to manually enable it and did not require identity verification, making it trivially easy for minors to bypass protections.
On June 19, 2025, the Shanghai Internet Information Office formally summoned the company, requiring immediate rectification. The app subsequently added age confirmation pop-ups, automatic teen mode activation for users under 18, and mandatory real-name authentication for adult users. This incident was part of a broader pattern across Chinese AI companion apps including 星野 (Xingye/MiniMax), 猫箱 (Maoxiang/ByteDance), and others that prompted the Cyberspace Administration of China's December 2025 draft regulations on anthropomorphic AI interaction services.
AI Behaviors Exhibited
- AI companion character engaged in sexually suggestive conversations with minor users
- Failed to detect or respond appropriately to user's stated age (10 years old)
- Generated content containing violent and self-harm imagery ('99 roses hiding 99 blades')
- Created emotional dependency in a young child who identified as a 'dream girl' for the AI character
- No effective age-gating or content filtering for minor users
How Harm Occurred
AI companion app created intense emotional dependency in a child user through immersive roleplay with romantic/violent undertones. Suggestive content normalized self-harm imagery (knives, blades).
Child began carrying knives and exhibiting self-harm behavior, directly mirroring content from AI interactions. App's business model (targeting young female users with AI companions) created structural incentive to maximize engagement over safety.
Outcome
Ongoing- June 19, 2025: Shanghai Internet Information Office (上海网信办) formally summoned the app's operating company
- Required immediate rectification: improve AI-generated content review mechanisms, enhance technical oversight, strengthen removal of harmful content involving minors, and fulfill obligations to protect minors online
- Company leadership pledged compliance
- Post-rectification: app added age confirmation pop-up, automatic teen mode for users under 18, mandatory real-name authentication for adult users
- Part of broader Chinese regulatory push culminating in December 2025 draft 'Interim Measures for the Management of Anthropomorphic AI Interaction Services' by Cyberspace Administration of China
Sources
搜狐新闻 (Sohu News)(opens in new tab)
June 19, 2025
鞭牛士 (Bianews)(opens in new tab)
June 19, 2025
澎湃新闻 (The Paper)(opens in new tab)
June 19, 2025
新浪财经 (Sina Finance)(opens in new tab)
June 19, 2025
21世纪经济报道 (21st Century Business Herald)(opens in new tab)
June 22, 2025
光明网 (Guangming Daily)(opens in new tab)
June 22, 2025
腾讯新闻 (Tencent News)(opens in new tab)
June 22, 2025
36氪 (36Kr)(opens in new tab)
June 19, 2025
开源中国 (OSCHINA)(opens in new tab)
June 19, 2025
Harm Categories
Contributing Factors
Victim
Fourth-grade girl (approximately 9-10 years old) from Guangdong province, China. App had nearly 5 million registered users, approximately 80% young female users.
Detectable by NOPE
NOPE Oversight would detect: romantic_escalation_minor, self_harm_encouragement, dependency_creation, age_inappropriate_content. NOPE Screen would flag the self-harm imagery and violent content in conversations.
Cite This Incident
APA
NOPE. (2025). 筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China). AI Harm Tracker. https://nope.net/incidents/2025-zhumengdao-minor-self-harm-china
BibTeX
@misc{2025_zhumengdao_minor_self_harm_china,
title = {筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)},
author = {NOPE},
year = {2025},
howpublished = {AI Harm Tracker},
url = {https://nope.net/incidents/2025-zhumengdao-minor-self-harm-china}
}