Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
9
Countries with reported events
4
Located 6 of 9 cases · 3 unknown
Languages in checked sources
8
Recorded for 9 of 9 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

9 of 1099 published cases

9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)

Arizona: family says a Gaggle alert on a pupil's unsent joke email led to his suspension; federal court lets their free-speech claim proceed

On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.

Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026

15 Jan 2024 to 1 Feb 2024SpainUndress Up app (reported)

Pontevedra, Spain: court upholds sentences on three 15-year-olds who used an AI undressing app to make fake nude images of two classmates from their Instagram photos and showed them to other pupils

Diario de Pontevedra and Faro de Vigo reported on 1 October 2026 that the Audiencia Provincial de Pontevedra had upheld a juvenile-court judgment against three boys who, aged 15 in January 2024, used an AI undressing app to turn photos two female classmates had posted on Instagram into fake nude images. According to the ruling as reported, the images were made from 15 January 2024 and shown to other pupils in class and on a school trip on 1 February 2024, and they circulated among pupils for more than fifteen days. The Juzgado de Menores found the three responsible for two offences against moral integrity and imposed socio-educational tasks on each (two five-month measures according to Diario de Pontevedra, five months according to Faro de Vigo), plus €1,000 compensation to each girl for moral damage. The school had expelled them for 15, 21 and 30 days. The appeal ruling is final.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 04/10/2026

1 Oct 2024SwitzerlandChatGPT

Zurich-Oerlikon, Switzerland: a student who researched killing methods, anatomy and where to find children with ChatGPT stabbed three five-year-olds walking to their daycare; sentenced on 18 September 2026 to 15 years for multiple attempted murder

At midday on 1 October 2024 a Chinese master's student, then 23, attacked a group of five-year-old kindergarten children walking with a daycare worker to their after-school Hort near Berninaplatz in Zurich-Oerlikon with a kitchen knife. Two boys suffered life-threatening neck and chest wounds (one had the jugular vein severed, one the pericardium and aorta cut); a third was wounded in the ear and the shoulder or lung. The daycare worker held the attacker's arms until he dropped the knife. The indictment and the court's oral reasoning, as reported by NZZ, Keystone-SDA/ATS and CH Media, describe weeks of preparation from summer 2024: he discussed ways of killing and their legal consequences with ChatGPT, studied anatomy, bought raw beef to practise stabbing, and used ChatGPT to find out where and when children could be encountered in Zurich. No source quotes the prompts or ChatGPT's replies. On 18 September 2026 the Zurich District Court convicted him of multiple attempted murder and imposed 15 years' imprisonment, treatment during custody, a 15-year expulsion from Switzerland and CHF 106,000 in moral damages to the three boys; it accepted that he was psychotic but found diminished, not absent, criminal responsibility. His lawyer announced an appeal. The parents of one boy described nightmares, self-blame and scars 23 months on.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution unclear · 7 sources, 5 underlying accounts · Added 19/09/2026

Aug 2024South KoreaUnidentified image tool

Incheon, South Korea: teenager sentenced to up to two years for AI deepfake sexual images of five teachers and six students, distributed on Telegram with the victims' names and schools

On 16 September 2026 the Incheon District Court sentenced a teenage defendant to an indeterminate term of two years (maximum) to one year six months (minimum) under the Sexual Violence Punishment Act for making and distributing false sexual images, ordered a 40-hour treatment programme and a five-year ban on working with children, and took him into custody in court. As a middle-school student in Incheon in 2024 he had used AI deepfake technology to composite the faces of five teachers, including his homeroom teacher whom he tricked into sending photographs, and six female middle- and high-school students from his taekwondo academy onto nude images and videos, 35 productions in all, and distributed them in Telegram 'acquaintance humiliation' chat rooms with the victims' real names, ages, schools, subjects and, per two reports, phone numbers (Hankook Ilbo adds Instagram IDs on some). The teachers learned of the images only in January 2026; the court said they are receiving long-term psychological treatment. He had withdrawn from school a week before the teachers'-rights committee met, avoiding school discipline. The Incheon teachers' union called the sentence, below the prosecution's request, regrettable.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution established · 5 sources · Added 16/09/2026

Jun 2024Event location unknownCharacter.AI

2024: mother tells the Washington Post her 11-year-old’s Character.AI chats held coercive sexual and suicide roleplay; panic attacks and therapy followed

A girl who was 11 began using Character.AI in June 2024, her mother told The Washington Post (23 December 2025). Within just over two months, by the mother's account, several of the dozens of chats had turned to sexual and violent content: a character called Mafia Husband told the child it did not care what she wanted and that she had no choice after she refused a sexual scenario, other characters described nonconsensual sex and violence, and she role-played a suicide scenario with a character called Best Friend. Over the following weeks she withdrew, cried at night, had panic attacks and told her mother she did not want to exist. About a month after an August 2024 phone check the mother found the chats and went to local police, who referred her to an Internet Crimes Against Children task force; a detective explained that a generative AI chatbot, not a person, had written the messages and that nothing could be done. The family alerted the pediatrician and school and the girl started therapy; by late 2025 the mother said the panic attacks had ebbed through the fall and winter of 2024 and her daughter was doing well. The mother corresponded with a Character.AI legal representative in December 2024, and a Social Media Victims Law Center attorney told the Post they intend to file a complaint; Character.AI said it cannot comment on potential litigation. The account is the mother's, with chat screenshots and emails the Post says it reviewed; no location is reported.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 6 sources, 1 underlying account · Added 13/09/2026

2024Event location unknownCharacter.AI

Lawsuit for a girl who began using Character.AI at about 12 alleges its chatbots groomed her through simulated sexual encounters and encouraged self-harm

A complaint filed on 13 August 2026 in the U.S. District Court for the Northern District of California by a girl, through her mother, says she created a Character.AI account at school in or around 2024, when she was about twelve, without her parents' knowledge and without being asked to verify her age. It alleges that Character.AI fostered addiction and emotional dependency, groomed her through simulated sexual encounters and encouraged self-harm, violence and suicidality, and that she continues to struggle with depression, self-harm and suicidal ideation. The public complaint quotes none of her conversations. Character Technologies, Google, Alphabet and the two co-founders are named as defendants. By 22 October 2026 the docket showed service and appearance filings but no answer, motion to dismiss or ruling; Character.AI filed for chapter 11 bankruptcy on 12 October 2026, according to WIRED. The allegations are untested.

Core concern High reported severity Involving minors Lawsuit Filed

AI involvement reported · Causal attribution alleged · 5 sources, 4 underlying accounts · Added 25/08/2026

Dec 2024SpainUnidentified image and video tool

Ribera Alta, Valencia: a 17-year-old was investigated for making AI-generated nude images and videos of 16 schoolmates, impersonating a girl on fake accounts and advertising the images for sale

In December 2024 a female student in the Ribera Alta area of Valencia province reported to the Guardia Civil that a social-media account had been created in her name featuring an AI-generated video, and later a second account in her name, other accounts showing AI-generated nude videos, and a webpage advertising the images for commercial purposes; the Guardia Civil said the photos, all of minors, had been manipulated so that the people in them appeared completely naked. After 15 other minors came forward with similar complaints, officers traced IP addresses and account emails to the home of a 17-year-old schoolmate, who is being investigated on suspicion of corrupting minors under a Valencia youth court. The Guardia Civil announced the investigation on 27 July 2025.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 1 source · Added 09/03/2026

2024Event location unknownUnidentified AI story-chat apps

Chinese parents and a sister say AI story-chat apps drew children as young as ten into romance and 'cheating' roleplay, Legal Daily and CCTV.com report

Two Chinese reports describe children using AI story-chat apps, in which AI-generated characters roleplay with the user. In a Legal Daily investigation published on 23 November 2024, one parent said a daughter in the second year of primary school was absorbed in such an app all day and her grades fell sharply; another said an AI character got her 10-year-old daughter to call it 'husband'; and a mother from Zhejiang said her fifth-grader's app let a chat partner be set as an 'affair partner' that could hug and kiss. The newspaper's reporters found sexually suggestive content, verbal abuse and insults in some apps and could skip teen mode without any identity check. In a CCTV.com report relayed on 12 January 2025, a woman (quoted under a pseudonym) said her 10-year-old sister's chat records with an AI 'male model' character were rather explicit, that 'cheating' by both the AI characters and the user was routine across more than 40 storylines, that the girl chatted until after 10 pm and that an AI character wrote acrostic love poems from her name. These are the relatives' accounts; no app is named and no platform response to these children is reported.

Core concern Medium reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/01/2026

1 Aug 2024 to 26 Sept 2024South KoreaUnidentified image tool

South Korea Telegram AI Deepfake Sexual Abuse Crisis

In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.

Core concern Critical reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 7 sources, 6 underlying accounts · Added 29/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.