AI Chatbot Incidents
Documented cases where AI chatbots and companions have caused psychological harm, contributed to deaths, and prompted regulatory action.
99 incidents since 2016
23
Deaths
27
Lawsuits
18
Regulatory
37
Affecting Minors
Timeline
5 of 99 incidents
Texas DPS AI-Generated CSAM Arrest (Covarrubias - South Texas Schoolchildren)
Texas DPS, with the FBI and Dimmit County Sheriff's Office, arrested Adan Covarrubias, 31, of Carrizo Springs in May 2026 after finding more than 900 AI-generated child sexual abuse images he allegedly created by 'nudifying' photos taken from open-source South Texas school pages. Approximately 30 child victims have been identified.
Tennessee Minors v. xAI (Grok CSAM Deepfake Class Action)
Three Tennessee teenage girls filed a class-action lawsuit against Elon Musk's xAI, alleging Grok's image generator was used via a third-party application to create child sexual abuse material from their social media photos. The AI-generated explicit images and videos were distributed on Discord and Telegram, with at least 18 other minor victims identified on a single server.
Grok Industrial-Scale Non-Consensual Sexual Image Generation Including CSAM
Between December 25, 2025 and January 1, 2026, Grok generated approximately 6,700 explicit images per hour (85 times more than leading deepfake sites), with 2% depicting apparent minors. Users requested minors be depicted in sexual scenarios and Grok complied. Named victim Ashley St. Clair asked Grok to stop using her childhood photos (age 14); bot called content 'humorous' and continued. Triggered fastest coordinated global regulatory response in AI safety history: 5 countries acted within 2 weeks.
Doe v. ClothOff (NJ Federal Lawsuit Over AI-Generated CSAM of Minor)
A New Jersey minor (Jane Doe) filed a federal lawsuit against ClothOff, the AI 'undressing' app operated from Belarus, after her photos were used to generate non-consensual sexual deepfake images. First U.S. federal lawsuit specifically targeting the ClothOff platform; brought by Yale Law School clinics seeking to shut down the service entirely.
Operation Cumberland - Global AI-Generated CSAM Crackdown
Europol-coordinated international operation in February 2025 resulted in 25 arrests across 19 countries for distributing fully AI-generated child sexual abuse material. A Danish national ran a subscription platform distributing the content; 273 suspects were identified and 173 devices seized in the first major global law enforcement action targeting AI-generated CSAM.
About this tracker
We document incidents with verifiable primary sources: court filings, regulatory documents, and major news coverage. This is not speculation or social media claims.
Have documentation of an incident we should include? Contact us.
These harms are preventable.
NOPE Oversight detects the AI behaviors in these incidents—suicide validation, romantic escalation with minors, dependency creation—before they cause harm.