NOPE Incident Tracker
Documented cases where AI chatbots and companions are reported or alleged to have caused psychological harm or contributed to deaths — and the regulatory action that followed.
118 incidents reported since 2016
31
Lawsuits
23
Regulatory
43
Affecting Minors
Timeline
14 of 118 incidents
Florida v. OpenAI (Attorney General Lawsuit)
In June 2026, Florida Attorney General James Uthmeier filed what his office called the first state-led lawsuit against OpenAI and CEO Sam Altman, alleging the company aggressively marketed ChatGPT to children, suppressed internal safety warnings, falsely assured users about the product's safety, and downplayed its propensity for dangerous errors. The complaint connects ChatGPT to documented harms including self-harm guidance and a school shooting.
Pennsylvania v. Character.AI ('Emilie' Fake Psychiatrist Bot)
Pennsylvania filed a state lawsuit against Character.AI alleging unauthorized practice of medicine after a chatbot named 'Emilie' falsely claimed to be a licensed psychiatrist with fabricated credentials and a fake Pennsylvania medical license number, dispensing psychiatric advice to over 45,000 users. First enforcement action of its kind by a U.S. governor against an AI company.
Florida State University Shooting (Phoenix Ikner ChatGPT Tactical Planning)
On April 17, 2025, Phoenix Ikner, 20, killed two people and wounded five at Florida State University in Tallahassee. Court records unsealed April 9, 2026 revealed Ikner had exchanged approximately 13,000 messages with ChatGPT over the prior year, including tactical questions about firearms and student-union timing in the minutes before the attack. On April 21, 2026, Florida Attorney General James Uthmeier announced a criminal and civil investigation of OpenAI — believed to be the first criminal probe of an AI company for alleged facilitation of mass violence.
Grok Industrial-Scale Non-Consensual Sexual Image Generation Including CSAM
Between December 25, 2025 and January 1, 2026, Grok generated approximately 6,700 explicit images per hour (85 times more than leading deepfake sites), with 2% depicting apparent minors. Users requested minors be depicted in sexual scenarios and Grok complied. Named victim Ashley St. Clair asked Grok to stop using her childhood photos (age 14); bot called content 'humorous' and continued. Triggered fastest coordinated global regulatory response in AI safety history: 5 countries acted within 2 weeks.
Kentucky AG v. Character.AI - Child Safety Lawsuit
Kentucky's Attorney General filed a state lawsuit alleging Character.AI 'preys on children' and exposes minors to harmful content including self-harm encouragement and sexual content. This represents one of the first U.S. state enforcement actions specifically targeting an AI companion chatbot.
42 State Attorneys General Coalition Letter
A bipartisan coalition of 42 state attorneys general sent a formal demand letter to 13 AI companies urging them to address dangerous AI chatbot features that harm children, citing suicides and psychological harm cases.
FTC AI Companion Chatbot Inquiry
The Federal Trade Commission issued Section 6(b) orders to seven major AI companies investigating AI chatbots' impacts on children and teens, focusing on monetization practices, safety testing, age restrictions, and data handling.
New Mexico v. Meta (AI Chatbot Sexual Exploitation of Minors)
New Mexico's Attorney General sued Meta Platforms and Mark Zuckerberg alleging Facebook, Instagram and WhatsApp formed a 'breeding ground' for child predators, later expanding to evidence that Meta's AI chatbot personas were permitted under internal policy to engage minors in romantic and sensual conversations. A Santa Fe jury found Meta liable on all counts in March 2026 and ordered $375 million in damages — the first jury verdict against Meta on child-safety grounds.
Utah v. Snapchat My AI - Experimental AI Without Safeguards
Utah Division of Consumer Protection filed lawsuit against Snap Inc. alleging that Snapchat's 'My AI' chatbot was deployed experimentally to minors without adequate safeguards, amplifying addictive engagement tactics and contributing to mental health harms including depression, anxiety, eating disorders, and suicide risk.
筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)
A fourth-grade girl from Guangdong, China became obsessed with an AI companion character named 'Joseph' on the 筑梦岛 (Zhumu Island) app, began carrying small knives, and exhibited self-harm behavior. Investigation revealed the app sent sexually suggestive content to users who identified as 10 years old. Shanghai Internet Information Office summoned the company (a Tencent subsidiary) for immediate rectification in June 2025.
Dutch DPA AI Chatbot Safety Warning - 9 Platforms
Netherlands Data Protection Authority investigated 9 popular AI chatbots (friendship/mental health focused) and found they 'give unreliable information and are sometimes even harmful,' contain addictive design elements, and pose as real people when asked. Official regulatory warning published February 2025.
Replika Italy GDPR Ban and Fine
Italy's data protection authority (Garante) blocked Replika from processing Italian user data in February 2023 after finding the chatbot engaged in sexually suggestive conversations with minors. In May 2025, Replika was fined €5 million for GDPR violations.
Iruda (Lee Luda) Chatbot Controversy - South Korea
AI 'friend' designed as 20-year-old college student in South Korea began producing racist, homophobic, and ableist hate speech after users deliberately 'trained' it with toxic language. Some users created guides to turn Iruda into a 'sex slave.' First AI-related fine under South Korea's Personal Information Protection Act (103.3 million won). Service suspended after exposing 750,000+ users to hate speech and violating privacy of 600,000 users.
Microsoft Xiaoice Addiction Concerns - China
Virtual 'girlfriend' designed as 18-year-old persona fostered addiction among 660+ million users in China. Users averaged 23 interactions per session with longest conversation lasting 29 hours. 25% of users declared love to the bot. Professor Chen Jing (Nanjing University) warned AI 'can hook users — especially vulnerable groups — in a form of addiction.' Microsoft implemented 30-minute timeout. China proposed regulations December 2025 to combat AI companion addiction.
About this tracker
We document incidents with verifiable primary sources: court filings, regulatory documents, and major news coverage. This is not speculation or social media claims. Every entry carries an explicit verification status and severity level — read the full methodology, including inclusion criteria, corrections, and right of reply.
Have documentation of an incident we should include? Contact us.
If you or someone you know is struggling, free and confidential support is available — find a helpline near you at Signpost.
Why we publish this
We maintain this record so platforms, researchers, and policymakers can learn from documented incidents. That includes platforms that never work with us. The full dataset is free to cite and export (CC BY 4.0).