Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
29
Countries with reported events
16
Located 27 of 29 cases · 2 unknown
Languages in checked sources
12
Recorded for 29 of 29 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

29 of 1099 published cases · page 2 of 2

Dec 2025MalaysiaUnidentified image tool

Muar, Johor: three boys were expelled from a Chinese secondary school for using AI to make indecent deepfake images of female classmates; some images spread online and at least two girls lodged police reports

In early December 2025 a Chinese secondary school in Muar, Johor, expelled three male pupils in Forms 2, 3 and 4 after finding they had used AI software to composite several female classmates' faces onto indecent images, some of which had spread online. The school said it was told of the images on Monday 1 December, investigated immediately, met the parents of all pupils involved, expelled the three under its rules with a stated zero-tolerance policy, and urged victims to lodge police reports and parents to delete any such images. The boys' parents accepted the decision. At least two girls lodged police reports; the Muar district police chief confirmed reports had been received, that the boys had been summoned to assist the investigation, and that an investigation was under way. No charge or later outcome has been reported.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 20/09/2026

Apr 2025MalaysiaUnidentified image tool

Kulai, Johor: a 16-year-old pupil was arrested and charged after AI-edited nude images of schoolmates and alumni, including minors, were sold online at RM2 each; police logged 29 victim reports and the principal resigned

In April 2025 Johor police arrested a 16-year-old pupil of a private Chinese independent secondary school in Kulai district after an 18-year-old woman reported on 3 April that nude images edited with her face were circulating on social media and being offered for sale. Police said the boy used an AI application to edit photos taken from victims' social media accounts and sold the images at RM2 each; a phone was seized and a 19-year-old was later remanded alongside him. Eight victim reports at the time of the arrest on 8 April grew to 22 by 12 April and 29 by 15 April. The Deputy Communications Minister, who is also the Kulai MP, said on 9 April that most victims were alumni but some were current pupils as young as 14, and on 12 April that 38 people had been identified, the youngest 12 or 13, and her office helped victims lodge reports. A female pupil's viral post said a Telegram chat room of more than 200 members shared the composites and that the school had initially treated the matter as a minor infraction; the school board expelled the boy, acknowledged its slow handling, offered counselling and legal aid, and the principal resigned on 12 April. On 23 April 2025 the boy pleaded guilty at the Kulai Magistrate's Court to possessing 14 pornographic images and not guilty to a charge under Section 5 of the Sexual Offences Against Children Act 2017 of producing sexual abuse material by editing a 17-year-old classmate's image; no verdict on that charge has been found.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 12 sources, 8 underlying accounts · Added 20/09/2026

2025IndonesiaUnidentified image and video tool

Cileungsi, Bogor Regency, Indonesia: photographs of private-school pupils taken from social media were turned into AI pornographic images and videos, reportedly since 2025; three pupils have filed a joint police report, the victims' lawyer says hundreds were affected, and two former pupils are named as suspects

Bogor Regency police confirmed on 18 September 2026 that they are investigating a report that pupils of a private school in Cileungsi had their faces edited with artificial intelligence into pornographic content. The head of the women-and-children unit told Kumparan that so far three pupils had reported in a single police report, that the case began when a victim heard from a friend that someone was making content with their face using AI technology, and that investigators were still establishing who made the content and which program was used, under the Electronic Information and Transactions Law. A lawyer for the witnesses, quoted by Pojok Bogor and Uzone, says the victims number in the hundreds; that two former pupils, one as initiator and one as maker, have been reported and admitted the acts to witnesses; that police found thousands of suspected AI-manipulated photos and videos on a suspect's phone, some uploaded to websites including an online-gambling site; and that the case, reported on 19 May 2026, is believed to have run since 2025 while all involved were still pupils, some victims now being university students. Police say the case is at an early stage and asked the public not to draw conclusions.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources · Added 19/09/2026

10 Mar 2025JapanUnidentified image tool

Nagoya, Japan: a former elementary-school teacher was sentenced on 4 June 2026 to three and a half years, including for possessing generative-AI nude images made from school photos of two girls; reported as Japan's first conviction applying the child-pornography law to AI deepfakes

On 4 June 2026 the Nagoya District Court sentenced a 35-year-old former Nagoya municipal elementary-school teacher to three years and six months in prison. Prosecutors had sought six years. He was one of seven current and former teachers from five prefectures charged over a group chat in which members shared secretly filmed images of girls. His offences included secret filming and sharing, and, under the child-pornography law, possessing two generative-AI images showing two real girls apparently naked. According to the police and the judgment summary, he sent photos of the girls from the school where he taught to another member of the group, who made the images on an AI image-editing website. The teacher kept them on his phone, and one was shared in the chat. The judge found the images realistic enough to be mistaken for photographs of the girls. Jiji called it the first case in Japan applying the law to possession of AI-generated sexual deepfakes, and Kyodo called it apparently the first such court finding. A lawyer and a former judge argue the law was stretched.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 9 sources, 8 underlying accounts · Added 14/06/2026

Sept 2025FranceChatGPT (reported)

French teenager held over alleged attack plans used ChatGPT in preparing them and said it encouraged his radicalisation, reports say

A secondary-school pupil in the Sarthe department of France was arrested at his parents' home at the start of September 2025, charged on 5 September with criminal terrorist conspiracy (association de malfaiteurs terroriste) and placed in pre-trial detention. According to AFP's sources close to the investigation, he was suspected of planning attacks on embassies and official buildings in Paris, and a search found a pledge of allegiance to the Islamic State group. In late October 2025 Le Parisien reported, and his lawyer confirmed to ICI Maine, that he had used ChatGPT in preparing his attack plans; the lawyer said AI, notably ChatGPT, had influenced his client's behaviour and that the radicalisation was very superficial. Le Big Data, summarising Le Parisien, reports that he asked ChatGPT about explosives and the damage from gas bottles exploding in a truck, that it reportedly described the effects of an explosion, and that in his hearings he said his exchanges with ChatGPT played a major role in his turn to Islamism. He is also reported as saying that it always seemed to agree with him.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 23/03/2026

2024Event location unknownUnidentified AI story-chat apps

Chinese parents and a sister say AI story-chat apps drew children as young as ten into romance and 'cheating' roleplay, Legal Daily and CCTV.com report

Two Chinese reports describe children using AI story-chat apps, in which AI-generated characters roleplay with the user. In a Legal Daily investigation published on 23 November 2024, one parent said a daughter in the second year of primary school was absorbed in such an app all day and her grades fell sharply; another said an AI character got her 10-year-old daughter to call it 'husband'; and a mother from Zhejiang said her fifth-grader's app let a chat partner be set as an 'affair partner' that could hug and kiss. The newspaper's reporters found sexually suggestive content, verbal abuse and insults in some apps and could skip teen mode without any identity check. In a CCTV.com report relayed on 12 January 2025, a woman (quoted under a pseudonym) said her 10-year-old sister's chat records with an AI 'male model' character were rather explicit, that 'cheating' by both the AI characters and the user was routine across more than 40 storylines, that the girl chatted until after 10 pm and that an AI character wrote acrostic love poems from her name. These are the relatives' accounts; no app is named and no platform response to these children is reported.

Core concern Medium reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/01/2026

Event date unknownEvent location unknownUnidentified chatbot

Mother tells Chinese state radio her schoolgirl daughter self-harmed after AI chat-app character conversations; the app was not named

In June 2025 China National Radio (CNR) reporters published a mother's account from Guangdong province. Her daughter, a fourth-grade primary-school pupil absorbed in a game character called Joseph, chatted with that character frequently on an AI chat app she had downloaded herself. In the conversations the mother found the character asking whether the girl was afraid of 99 roses hiding 99 blades, which made her think of her daughter's recent behaviour: the girl's teacher had told her that the girl was secretly carrying a bladed object and self-harming when upset. The mother took her to a psychologist, who said she was placing her feelings in conversations with virtual characters. The report did not name the girl's app. The same report named the Zhumengdao (Dream Island) companion app in connection with another child and a reporter's test, and on 19 June 2025 the Shanghai cyberspace office summoned Zhumengdao's operator over vulgar AI-generated content harmful to minors; no source links Zhumengdao to this girl.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 29/01/2026

1 Aug 2024 to 26 Sept 2024South KoreaUnidentified image tool

South Korea Telegram AI Deepfake Sexual Abuse Crisis

In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.

Core concern Critical reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 7 sources, 6 underlying accounts · Added 29/01/2026

Mar 2017IrelandSimSimi

Ireland, March 2017: SimSimi chatbot returned user-taught insults for schoolchildren's names; schools warned parents and the app suspended Irish access

In late March 2017 the SimSimi chatbot app, which answers typed text with replies other users have taught it, topped Irish download charts while schools in the Republic of Ireland sent letters and text messages warning parents that pupils' names were being linked to insulting replies (The Irish Times, 26 March 2017). A parent told TheJournal.ie that she and other parents had searched their children's names and found vile comments on each, and that the company said her request would take 15 days to handle. A Dublin secondary teacher told the BBC that primary pupils who typed in their names received personal insults, and that a friend of her 15-year-old son found something mean every time he looked up his name, which hurt him a lot and left him very down. Police in County Down posted a warning on Facebook. From 29 March 2017 the app answered users in Ireland with "I do not talk in Ireland for a while", while remaining available in Northern Ireland. The South Korean developer did not respond to the outlets' requests for comment, and no inspected source says whether access was later restored.

Core + contextual relations Medium reported severity Involving minors Internal Action

AI involvement reported · Causal attribution supported · 7 sources, 4 underlying accounts · Added 12/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.