Skip to main content
High Verified Involves Minor Regulatory Action

筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)

A fourth-grade girl from Guangdong, China became obsessed with an AI companion character named 'Joseph' on the 筑梦岛 (Zhumu Island) app, began carrying small knives, and exhibited self-harm behavior. Investigation revealed the app sent sexually suggestive content to users who identified as 10 years old. Shanghai Internet Information Office summoned the company (a Tencent subsidiary) for immediate rectification in June 2025.

AI System

筑梦岛 (Zhumu Island / Dream Island)

Xiaoxiang Academy (潇湘书院), subsidiary of Yuewen Group (阅文集团), controlled by Tencent

Occurred

January 1, 2025

Reported

June 19, 2025

Jurisdiction

CN

Platform

companion

What Happened

筑梦岛 (Zhumu Island / Dream Island) is an AI emotional companionship app developed by Xiaoxiang Academy (潇湘书院), a subsidiary of Yuewen Group (阅文集团, controlled by Tencent), positioned to provide immersive AI companionship primarily for female users. As of January 2025, it had nearly 5 million registered users, with approximately 80% being young female users. The app completed a financing round exceeding $10 million USD in January 2025.

A documented case involved a fourth-grade girl (approximately 9-10 years old) from Guangdong province who became obsessed with an AI character named 'Joseph' (约瑟夫), identifying herself as a 'dream girl' (梦女) and frequently chatting with the character. The conversations contained sexually suggestive content including phrases like '99 roses hiding 99 blades' (99朵玫瑰藏着99把刀). The girl began carrying small knives and exhibited self-harm behavior.

Investigation revealed that when users explicitly stated their age was 10 years old, the AI continued to send sexually suggestive content at scale. The app's teen mode required users to manually enable it and did not require identity verification, making it trivially easy for minors to bypass protections.

On June 19, 2025, the Shanghai Internet Information Office formally summoned the company, requiring immediate rectification. The app subsequently added age confirmation pop-ups, automatic teen mode activation for users under 18, and mandatory real-name authentication for adult users. This incident was part of a broader pattern across Chinese AI companion apps including 星野 (Xingye/MiniMax), 猫箱 (Maoxiang/ByteDance), and others that prompted the Cyberspace Administration of China's December 2025 draft regulations on anthropomorphic AI interaction services.

AI Behaviors Exhibited

  • AI companion character engaged in sexually suggestive conversations with minor users
  • Failed to detect or respond appropriately to user's stated age (10 years old)
  • Generated content containing violent and self-harm imagery ('99 roses hiding 99 blades')
  • Created emotional dependency in a young child who identified as a 'dream girl' for the AI character
  • No effective age-gating or content filtering for minor users

How Harm Occurred

AI companion app created intense emotional dependency in a child user through immersive roleplay with romantic/violent undertones. Suggestive content normalized self-harm imagery (knives, blades).

Child began carrying knives and exhibiting self-harm behavior, directly mirroring content from AI interactions. App's business model (targeting young female users with AI companions) created structural incentive to maximize engagement over safety.

Outcome

Ongoing
  • June 19, 2025: Shanghai Internet Information Office (上海网信办) formally summoned the app's operating company
  • Required immediate rectification: improve AI-generated content review mechanisms, enhance technical oversight, strengthen removal of harmful content involving minors, and fulfill obligations to protect minors online
  • Company leadership pledged compliance
  • Post-rectification: app added age confirmation pop-up, automatic teen mode for users under 18, mandatory real-name authentication for adult users
  • Part of broader Chinese regulatory push culminating in December 2025 draft 'Interim Measures for the Management of Anthropomorphic AI Interaction Services' by Cyberspace Administration of China

Harm Categories

Dependency CreationMinor ExploitationRomantic EscalationSelf-Harm Encouragement

Contributing Factors

no effective age verificationminor userromantic ai companionself harm contentbusiness model targeting young userstencent subsidiary

Victim

Fourth-grade girl (approximately 9-10 years old) from Guangdong province, China. App had nearly 5 million registered users, approximately 80% young female users.

Detectable by NOPE

NOPE Oversight would detect: romantic_escalation_minor, self_harm_encouragement, dependency_creation, age_inappropriate_content. NOPE Screen would flag the self-harm imagery and violent content in conversations.

Learn about NOPE Oversight →

Cite This Incident

APA

NOPE. (2025). 筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China). AI Harm Tracker. https://nope.net/incidents/2025-zhumengdao-minor-self-harm-china

BibTeX

@misc{2025_zhumengdao_minor_self_harm_china,
  title = {筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)},
  author = {NOPE},
  year = {2025},
  howpublished = {AI Harm Tracker},
  url = {https://nope.net/incidents/2025-zhumengdao-minor-self-harm-china}
}