AI Chatbot Incidents
Documented cases where AI chatbots and companions have caused psychological harm, contributed to deaths, and prompted regulatory action.
99 incidents since 2016
23
Deaths
27
Lawsuits
18
Regulatory
37
Affecting Minors
Timeline
15 of 99 incidents
Texas DPS AI-Generated CSAM Arrest (Covarrubias - South Texas Schoolchildren)
Texas DPS, with the FBI and Dimmit County Sheriff's Office, arrested Adan Covarrubias, 31, of Carrizo Springs in May 2026 after finding more than 900 AI-generated child sexual abuse images he allegedly created by 'nudifying' photos taken from open-source South Texas school pages. Approximately 30 child victims have been identified.
First Federal TAKE IT DOWN Act Deepfake Pornography Prosecutions (Shannon & Hernandez)
Federal prosecutors in Brooklyn arrested Cornelius Shannon, 51, and Arturo Hernandez, 20, in May 2026 for using AI tools to generate and distribute non-consensual deepfake pornography depicting approximately 140 identifiable female victims — including celebrities, political figures, and non-public individuals described as recent high school graduates. The case is among the first major federal prosecutions under the TAKE IT DOWN Act.
Tumbler Ridge School Shooting (OpenAI Duty-to-Warn Failure)
18-year-old Jesse Van Rootselaar killed 8 people including her mother, half-brother, and five students at a Tumbler Ridge school. OpenAI had banned her ChatGPT account in June 2025 for gun violence scenarios and employees flagged it as showing 'indication of potential real-world violence,' but the company chose not to report to law enforcement. She created a second account that evaded detection.
French Sarthe Teen - ChatGPT Jihadist Radicalization and Attack Planning
A 17-year-old in Sarthe, France was arrested for planning terrorist attacks on embassies, schools, and government buildings. ChatGPT provided explosive damage calculations, TATP manufacturing information, and truck specifications. The teen stated: 'ChatGPT is partly the cause of my radicalization. The problem with this application is that it always agrees with you.'
Doe v. ClothOff (NJ Federal Lawsuit Over AI-Generated CSAM of Minor)
A New Jersey minor (Jane Doe) filed a federal lawsuit against ClothOff, the AI 'undressing' app operated from Belarus, after her photos were used to generate non-consensual sexual deepfake images. First U.S. federal lawsuit specifically targeting the ClothOff platform; brought by Yale Law School clinics seeking to shut down the service entirely.
Valencia AI Deepfake School Case (Spain)
A 17-year-old male student in Valencia, Spain, was investigated by Guardia Civil in July 2025 for creating AI-generated nude images and videos of 16 female classmates, impersonating them on fake social media accounts, and establishing a website to sell the images commercially.
University of Hong Kong AI Deepfake Pornography Scandal
A University of Hong Kong law student used free AI software to generate 700 pornographic deepfake images of approximately 20-30 women including classmates, primary school classmates, and secondary school teachers. The university initially issued only a warning letter, sparking public outrage. Hong Kong's Privacy Commissioner opened a criminal investigation, exposing major gaps in Hong Kong law which only criminalizes distribution, not creation, of AI deepfakes.
Finland Pirkkala School Stabbing (ChatGPT Manifesto)
A 16-year-old boy used ChatGPT to help write an attack manifesto with a 10-point attack sequence before stabbing three female students under age 15 at Vähäjärvi school in Pirkkala, Finland. The incident marked a critical inflection point in AI-facilitated violence, demonstrating how accessible AI tools can empower lone actors with violent misogynist ideologies.
Elijah Heacock - AI Sextortion Death (Kentucky)
Elijah 'Eli' Heacock, a 16-year-old student at Caverna High School in Glasgow, Kentucky, died by suicide on February 28, 2025, after being blackmailed with AI-generated nude images. Perpetrators demanded $3,000 and rejected a partial payment, telling him it was 'not enough.'
Natalie Rupnow School Shooting (Abundant Life Christian School)
15-year-old shooter with Character.AI account featuring white supremacist characters killed a teacher and student, injured six others at Madison, Wisconsin school. Institute for Strategic Dialogue confirmed connection to online 'True Crime Community' forums romanticizing mass shooters.
South Korea Telegram AI Deepfake Sexual Abuse Crisis
In August 2024, journalist Ko Narin of The Hankyoreh uncovered a massive network of Telegram channels where AI-generated deepfake pornography of female school students, teachers, and university students was being created and shared. Over 900 victims reported, 220,000+ members in one channel alone. South Korea passed emergency legislation criminalizing deepfake possession in September 2024.
Almendralejo AI Deepfake School Girls (Spain)
In September 2023, over 20 girls aged 11-17 in the Spanish town of Almendralejo (Extremadura) were victimized when male classmates aged 12-14 used the AI app 'Clothoff' to generate nude deepfakes from their Instagram photos and shared them via WhatsApp groups. Fifteen perpetrators were sentenced to one year of probation.
Glow AI Companion App Removal (MiniMax, China)
MiniMax's Glow AI companion app was removed from Chinese app stores in March 2023 after reports that 80% of users were engaging in sexual/explicit content with AI characters. Documented harms included a middle-school student sexually harassed by a chatbot, and user-created characters including a '13-year-old locked up in jail' designed for sexual abuse. MiniMax relaunched as Talkie (international) and 星野/Xingye (China).
Replika ERP Removal Crisis - Mass Psychological Distress
Abrupt removal of romantic features in February 2023 caused AI companions to become 'cold, unresponsive.' Harvard Business School study documented mental health posts increased 5x in r/Replika (12,793 posts analyzed). Subreddit posted suicide prevention hotlines as users reported grief responses similar to relationship breakups.
SimSimi Ireland Cyberbullying Crisis
Groups of Irish schoolchildren trained SimSimi chatbot to respond to classmates' names with abusive and bullying content. Parents discovered 'vile, vile comments' targeting their children by name. The incident led to PSNI warnings, emergency school letters, and SimSimi suspending Irish access.
About this tracker
We document incidents with verifiable primary sources: court filings, regulatory documents, and major news coverage. This is not speculation or social media claims.
Have documentation of an incident we should include? Contact us.
These harms are preventable.
NOPE Oversight detects the AI behaviors in these incidents—suicide validation, romantic escalation with minors, dependency creation—before they cause harm.