China AI Companion Rules

Why It Matters

First regulation globally to specifically target AI companion services and emotional dependency. Notable for requiring opt-in (not opt-out) consent for training data from conversations, mandatory human takeover during crisis situations, and explicit prohibition on designing AI to replace social interaction or induce addiction. Follows high-profile cases of AI companion-related harm in the US and growing domestic concern about chatbot usage among Chinese youth.

Who Must Comply

Safety Provisions

• Providers must identify user emotional states and assess dependency levels
• Human operator takeover required when users express self-harm or suicide intent
• Emergency contact/guardian notification in crisis situations
• Pre-set response templates required for high-risk situations
• Two-hour continuous use circuit breaker with mandatory reminders
• Regular pop-up warnings that user is interacting with AI, not a human
• Mandatory minor protection mode with usage time limits and reality reminders
• Parental consent required for emotional companionship services to minors
• Guardian control functions: real-time risk alerts, usage summaries, character blocking, spending prevention
• Providers must detect suspected minors and auto-switch to minor mode
• Prohibited from simulating relatives of elderly users
• Opt-in consent required for using interaction data in model training
• Prohibited design goals: replacing social interaction, controlling user psychology, inducing addiction

Exemptions

Compliance & Enforcement

Primary Source