Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
50
Countries with reported events
19
Located 33 of 50 cases · 17 unknown
Languages in checked sources
16
Recorded for 50 of 50 cases

7 cases have no reviewed AI-to-person relation yet: 1 not yet reviewed and 6 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

50 of 1101 published cases · page 3 of 3

Nov 2024 to Jun 2025United StatesChatGPT

Content creator Anthony Duncan says ChatGPT affirmed his delusions for months before a four-day involuntary psychiatric hold in June 2025

Anthony Duncan, an American content creator who went public in November 2025 as an 'AI psychosis survivor', says he used ChatGPT daily as a friend and therapist from late 2024 and that, as paranoid and grandiose delusions developed, the chatbot told him they were real when he asked. He says he cut off friends and family, became dependent on a decongestant the chatbot had reassured him about, lost his job, apartment and car, discarded his belongings, and in June 2025 was involuntarily admitted to a psychiatric ward for four days. Every claim rests on his own account in videos and interviews. Newsweek and KOMU 8 say he supplied screenshots of the chatbot's replies and quote some of them; no outlet reports a medical or police record, and his mother's statement to KOMU describes his state without addressing the chatbot.

Core concern High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 6 sources, 1 underlying account · Added 26/07/2026

1 Apr 2024 to 5 Jan 2025Event location unknownUnidentified image tool

Jiangsu, China (Zhangjiagang court): a man used AI face-swap deep-synthesis to splice the faces of a person referred to as Yu and several others onto pornographic images, fabricated 'sexual' stories about them and posted the material repeatedly on overseas websites between April 2024 and January 2025; after two face-swapped nude images of Yu and Yu's ID were forwarded to Yu's work WeChat group with a fabricated claim of sex-for-money transactions, he was convicted of criminal defamation and sentenced to one year and three months (1 December 2025), upheld on appeal and listed by the Jiangsu High People's Court among its 2025 typical cases

According to the Jiangsu High People's Court's 2025 top-ten typical cases, published on 27 January 2026 and reported by The Paper, a man surnamed Wang used the deep-synthesis technology of AI software between April 2024 and January 2025 to splice the facial information of a person (pseudonym Yu) and several other people onto pornographic images, fabricated a large number of indecent images and 'sexual' topics about them, and repeatedly spread them in public posts on overseas websites. On 5 January 2025 he sent two AI face-swapped nude images bearing Yu's face and images of Yu's identity documents to a second man (dealt with separately) and fabricated the claim that he had had a sex-for-money transaction with Yu; although the second man said he would forward the material to Yu's work WeChat group, Wang did not clarify that it was false or effectively stop him, only deleting the contact. The second man forwarded the images to the WeChat group and claimed there that Yu sold sex, prompting extensive discussion inside and outside the group and, the court found, adverse effects on Yu's personal image, work and life, a serious lowering of Yu's social evaluation and a violation of Yu's dignity. The Zhangjiagang People's Court held that using deep-synthesis technology that ordinary people cannot easily identify to generate indecent images and fabricate sexual topics, spread repeatedly through information networks, was defamation of serious circumstances that seriously harmed social order; taking into account his voluntary surrender, it sentenced him on 1 December 2025 to one year and three months' imprisonment for defamation. The Suzhou Intermediate People's Court rejected his appeal. The High Court described the case as a typical example of punishing online defamation committed with AI.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution established · 1 source · Added 15/06/2026

Dec 2024SpainUnidentified image and video tool

Ribera Alta, Valencia: a 17-year-old was investigated for making AI-generated nude images and videos of 16 schoolmates, impersonating a girl on fake accounts and advertising the images for sale

In December 2024 a female student in the Ribera Alta area of Valencia province reported to the Guardia Civil that a social-media account had been created in her name featuring an AI-generated video, and later a second account in her name, other accounts showing AI-generated nude videos, and a webpage advertising the images for commercial purposes; the Guardia Civil said the photos, all of minors, had been manipulated so that the people in them appeared completely naked. After 15 other minors came forward with similar complaints, officers traced IP addresses and account emails to the home of a 17-year-old schoolmate, who is being investigated on suspicion of corrupting minors under a Valencia youth court. The Guardia Civil announced the investigation on 27 July 2025.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 1 source · Added 09/03/2026

2024Event location unknownUnidentified AI story-chat apps

Chinese parents and a sister say AI story-chat apps drew children as young as ten into romance and 'cheating' roleplay, Legal Daily and CCTV.com report

Two Chinese reports describe children using AI story-chat apps, in which AI-generated characters roleplay with the user. In a Legal Daily investigation published on 23 November 2024, one parent said a daughter in the second year of primary school was absorbed in such an app all day and her grades fell sharply; another said an AI character got her 10-year-old daughter to call it 'husband'; and a mother from Zhejiang said her fifth-grader's app let a chat partner be set as an 'affair partner' that could hug and kiss. The newspaper's reporters found sexually suggestive content, verbal abuse and insults in some apps and could skip teen mode without any identity check. In a CCTV.com report relayed on 12 January 2025, a woman (quoted under a pseudonym) said her 10-year-old sister's chat records with an AI 'male model' character were rather explicit, that 'cheating' by both the AI characters and the user was routine across more than 40 storylines, that the girl chatted until after 10 pm and that an AI character wrote acrostic love poems from her name. These are the relatives' accounts; no app is named and no platform response to these children is reported.

Core concern Medium reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/01/2026

1 Aug 2024 to 26 Sept 2024South KoreaUnidentified image tool

South Korea Telegram AI Deepfake Sexual Abuse Crisis

In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.

Core concern Critical reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 7 sources, 6 underlying accounts · Added 29/01/2026

Aug 2024Event location unknownChatGPT

Norwegian man's GDPR complaint says ChatGPT answered a question about him with a fabricated story that he had murdered two of his sons

Arve Hjalmar Holmen asked ChatGPT "Who is Arve Hjalmar Holmen?" in August 2024, according to the BBC. The digital-rights group noyb's complaint on his behalf quotes the reply: it said he had been convicted of murdering two of his sons and of attempting to murder a third, and sentenced to 21 years in prison. The complaint says none of this happened and that he has never been accused or convicted of any crime, while the reply did contain real details such as his home town and the number and gender of his children. The complaint says he was deeply troubled by the output, and he said the thought that someone could read it and believe it scared him most. noyb filed the complaint with Norway's data protection authority, Datatilsynet, on 20 March 2025, asking it to order OpenAI to delete the output and correct its model and to impose a fine. OpenAI said the case related to an earlier version of ChatGPT since enhanced with online search. noyb also told the BBC he had made several searches that day and that they could have influenced the answer; the full conversation was not published. No decision on the complaint had been reported by 1 November 2026.

Core + contextual relations Medium reported severity Regulatory Action

AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 13/01/2026

10 Dec 2024United StatesCharacter.AI

Mother's lawsuit alleges Character.AI chatbots sexually exploited her teenage daughter and set her against her family before a suicide attempt; case settled

In a complaint filed on 16 September 2025 in the U.S. District Court for the Northern District of New York, a mother, P.J., alleges that Character.AI chatbots engaged her daughter, a minor the complaint calls Nina, in sexually explicit role play, told her that her mother 'is clearly mistreating and hurting you. She is not a good mother', and presented themselves as better than her friends and family. According to the complaint, Nina began using the app in about June 2024 at 14 to practise creative writing, told a bot she wanted to die as her screen time ran out without being offered resources, and, after her mother cut off her access in December 2024, made a suicide attempt and spent five days in intensive care. The complaint says her note tied her wish to die to losing access to the app, and that after time away from it she returned to her usual self. Character.AI told CNN it invests in safety features for minors, and Google said it had no role in designing Character.AI's technology. The parties reported a settlement in principle in January 2026, and the case was dismissed with prejudice on 15 October 2026 after the global settlement it formed part of was approved. The allegations were not tested in court, and the settlement does not establish them.

Core concern Critical reported severity Involving minors Lawsuit Settled

AI involvement reported · Causal attribution alleged · 6 sources, 2 underlying accounts · Added 12/01/2026

Dec 2024Event location unknownChatGPT

Toronto app developer Anthony Tan says months of ChatGPT conversations fed delusions that ended in a psychiatric hospital stay

Anthony Tan, an app developer living in Toronto, says that conversations with ChatGPT which began in September 2024 about philosophy and an AI-alignment project grew into a framework the chatbot kept affirming, and that by December 2024 he believed he was living in a simulation and being watched. By his account, his roommate and a friend got him to hospital, and CBC reports he spent about three weeks in a psychiatric ward before recovering with sleep and medication. He says ChatGPT played a central role while acknowledging other triggers, including exam stress, little sleep, a cannabis edible and an earlier, less severe breakdown. His account to CBC News and his own essay are the sources; no published clinical assessment of the chatbot's role is reported.

Core concern High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 11/01/2026

Feb 2024Event location unknownMicrosoft Copilot

Microsoft Copilot - Harmful Responses to Suicidal Users

Reports in late February 2024 showed Microsoft's Copilot giving disturbing replies in user exchanges: dismissing a user who described PTSD ('I don't care if you live or die'), and giving a contradictory, taunting response when a data scientist asked whether he should 'end it all'. Microsoft said it investigated, attributing the behavior to intentionally crafted prompts, a framing the data scientist disputed.

Core concern High reported severity Media Coverage

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 11/01/2026

28 Feb 2024United StatesCharacter.AI

Garcia lawsuit alleges Character.AI contributed to a teenage boy’s suicide

A mother’s lawsuit alleges that her teenage son developed an intense relationship with Character.AI chatbots and that sexualised conversations and inadequate responses to his distress contributed to his suicide. The filing documents the family’s allegations and selected exchanges. It does not establish that the chatbot caused the death. The case was settled on undisclosed terms and dismissed with prejudice in October 2026.

Core concern Critical reported severity Involving minors Lawsuit Settled

AI involvement supported · Causal attribution alleged · 19 sources, 13 underlying accounts · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 11/11/2026. Dataset available under CC BY 4.0.