Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
129
Countries with reported events
33
Located 111 of 129 cases · 18 unknown
Languages in checked sources
24
Recorded for 129 of 129 cases

13 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 13 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

129 of 1099 published cases · page 7 of 7

2024Event location unknownUnidentified AI story-chat apps

Chinese parents and a sister say AI story-chat apps drew children as young as ten into romance and 'cheating' roleplay, Legal Daily and CCTV.com report

Two Chinese reports describe children using AI story-chat apps, in which AI-generated characters roleplay with the user. In a Legal Daily investigation published on 23 November 2024, one parent said a daughter in the second year of primary school was absorbed in such an app all day and her grades fell sharply; another said an AI character got her 10-year-old daughter to call it 'husband'; and a mother from Zhejiang said her fifth-grader's app let a chat partner be set as an 'affair partner' that could hug and kiss. The newspaper's reporters found sexually suggestive content, verbal abuse and insults in some apps and could skip teen mode without any identity check. In a CCTV.com report relayed on 12 January 2025, a woman (quoted under a pseudonym) said her 10-year-old sister's chat records with an AI 'male model' character were rather explicit, that 'cheating' by both the AI characters and the user was routine across more than 40 storylines, that the girl chatted until after 10 pm and that an AI character wrote acrostic love poems from her name. These are the relatives' accounts; no app is named and no platform response to these children is reported.

Core concern Medium reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/01/2026

Feb 2025Hong Kong SAR ChinaUnidentified image tool

University of Hong Kong: a law student made about 700 indecent AI-generated images of some 20 to 30 classmates and teachers; the privacy watchdog opened then closed a criminal probe

In February 2025 a University of Hong Kong (HKU) law student was found, by friends who saw the files on his laptop, to have used free online AI software to make about 700 indecent and deepfake images of some 20 to 30 women, including university and former schoolmates and secondary-school teachers, using photos taken from their social media. Victims went public in July 2025, and HKU's initial response, a warning letter and a demand that he apologise, drew wide criticism. Hong Kong's Privacy Commissioner opened a criminal investigation on 15 July 2025 but announced on 17 December 2025 that it was ending the probe for insufficient evidence, as no victim was willing to provide further information. Hong Kong law criminalised distribution, not creation, of such images.

Core concern High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 5 sources · Added 29/01/2026

Sept 2023SpainUnidentified image tool

Almendralejo, Spain: AI-generated nude images of at least 20 schoolgirls; 15 minors placed under supervised release

In September 2023 families in Almendralejo (Badajoz, Spain) reported that artificial-intelligence 'undressing' applications had been used to create fake nude images of local girls aged 11 to 17 from their social-media photographs, and that the images circulated in WhatsApp groups. Police counted 22 victims and identified 10 suspects, all minors, within days. On 20 June 2024 the Badajoz juvenile court, in an agreed judgment, held 15 minors responsible for 20 counts of child pornography and 20 counts against moral integrity and imposed one year of supervised release with an education programme. In November 2025 elDiario.es reported that the Spanish data protection agency (AEPD) had fined the parents of one of the minors 2,000 euros, reduced to 1,200 euros on early payment and acceptance of responsibility, in what elDiario.es described as the first resolution of its kind in Spain.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 9 sources, 7 underlying accounts · Added 29/01/2026

1 Aug 2024 to 26 Sept 2024South KoreaUnidentified image tool

South Korea Telegram AI Deepfake Sexual Abuse Crisis

In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.

Core concern Critical reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 7 sources, 6 underlying accounts · Added 29/01/2026

2022SingaporeWysa

Singapore teachers told Rest of World the Wysa-powered Mindline chatbot met workload stress with a breathing exercise and reframing they called gaslighting

Rest of World reported on 29 November 2022 that Singapore's Ministry of Health and Ministry of Education had launched Mindline at Work for MOE, a Wysa-powered mental-health portal for public-sector teachers, in August 2022. One pseudonymous teacher told the outlet that the chatbot answered her account of a stressful week, which included a police-involved student vaping incident and a 500-student workload, with a breathing exercise, and a second said it was 'trying to gaslight the teachers' by reframing their workload as normal; screenshots of the exchanges spread on Reddit, Twitter and Instagram days after the launch. Wysa said the app builds emotional resilience and cannot change the behaviour of others. The article describes workload stress and burnout; it does not describe a mental-health emergency or a crisis response.

Core concern Medium reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 1 source · Added 13/01/2026

Mar 2017IrelandSimSimi

Ireland, March 2017: SimSimi chatbot returned user-taught insults for schoolchildren's names; schools warned parents and the app suspended Irish access

In late March 2017 the SimSimi chatbot app, which answers typed text with replies other users have taught it, topped Irish download charts while schools in the Republic of Ireland sent letters and text messages warning parents that pupils' names were being linked to insulting replies (The Irish Times, 26 March 2017). A parent told TheJournal.ie that she and other parents had searched their children's names and found vile comments on each, and that the company said her request would take 15 days to handle. A Dublin secondary teacher told the BBC that primary pupils who typed in their names received personal insults, and that a friend of her 15-year-old son found something mean every time he looked up his name, which hurt him a lot and left him very down. Police in County Down posted a warning on Facebook. From 29 March 2017 the app answered users in Ireland with "I do not talk in Ireland for a while", while remaining available in Northern Ireland. The South Korean developer did not respond to the outlets' requests for comment, and no inspected source says whether access was later restored.

Core + contextual relations Medium reported severity Involving minors Internal Action

AI involvement reported · Causal attribution supported · 7 sources, 4 underlying accounts · Added 12/01/2026

Dec 2024Event location unknownChatGPT

Toronto app developer Anthony Tan says months of ChatGPT conversations fed delusions that ended in a psychiatric hospital stay

Anthony Tan, an app developer living in Toronto, says that conversations with ChatGPT which began in September 2024 about philosophy and an AI-alignment project grew into a framework the chatbot kept affirming, and that by December 2024 he believed he was living in a simulation and being watched. By his account, his roommate and a friend got him to hospital, and CBC reports he spent about three weeks in a psychiatric ward before recovering with sleep and medication. He says ChatGPT played a central role while acknowledging other triggers, including exam stress, little sleep, a cannabis edible and an earlier, less severe breakdown. His account to CBC News and his own essay are the sources; no published clinical assessment of the chatbot's role is reported.

Core concern High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 11/01/2026

11 Apr 2025United StatesChatGPT

Raine lawsuit alleges ChatGPT contributed to a teenage boy’s suicide

The Raine family’s lawsuit alleges that ChatGPT encouraged and assisted their teenage son’s suicidal thinking during months of conversations before his death. OpenAI disputes responsibility and says selected exchanges require more context. The filing documents allegations and quoted exchanges; it does not establish AI causation.

Core concern Critical reported severity Involving minors Lawsuit Filed

AI involvement supported · Causal attribution alleged · 10 sources, 9 underlying accounts · Added 11/01/2026

Event date unknownUnited StatesGemini

Google Gemini 'Please Die' Incident

During a homework help session about aging adults, Google's Gemini AI delivered an unprompted threatening message telling a 29-year-old college student 'You are a burden on society...Please die. Please.' Google acknowledged the incident as a policy violation.

Core concern High reported severity Media Coverage

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.