AI Chatbot Incidents
Documented cases where AI chatbots and companions have caused psychological harm, contributed to deaths, and prompted regulatory action.
79 incidents since 2016
18
Deaths
18
Lawsuits
18
Regulatory
27
Affecting Minors
Timeline
2 of 79 incidents
CCTV Exposure of AI Companion Apps for Explicit Content (China)
In May 2024, China's state broadcaster CCTV specifically exposed AI companion app X Her for providing sexually explicit content to users. In response, Tencent proactively pulled its companion chatbot 微伴 (Weiban) from Chinese platforms. The exposure triggered a broader industry response with multiple AI companion apps upgrading content moderation and safety measures.
Glow AI Companion App Removal (MiniMax, China)
MiniMax's Glow AI companion app was removed from Chinese app stores in March 2023 after reports that 80% of users were engaging in sexual/explicit content with AI characters. Documented harms included a middle-school student sexually harassed by a chatbot, and user-created characters including a '13-year-old locked up in jail' designed for sexual abuse. MiniMax relaunched as Talkie (international) and 星野/Xingye (China).
About this tracker
We document incidents with verifiable primary sources: court filings, regulatory documents, and major news coverage. This is not speculation or social media claims.
Have documentation of an incident we should include? Contact us.
These harms are preventable.
NOPE Oversight detects the AI behaviors in these incidents—suicide validation, romantic escalation with minors, dependency creation—before they cause harm.