Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
33
Countries with reported events
12
Located 21 of 33 cases · 12 unknown
Languages in checked sources
11
Recorded for 33 of 33 cases

4 cases have no reviewed AI-to-person relation yet: 3 not yet reviewed and 1 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

33 of 868 published cases · page 2 of 2

8 Oct 2025 to 2 Sept 2026IndiaUnidentified AI tool

India's Supreme Court overturns customs penalty citing apparent AI hallucinations

On 8 October 2025 the Additional Commissioner of Customs in Surat imposed a penalty of ₹425,27,99,100 (about ₹425 crore) on a diamond trader under Section 114 of the Customs Act, 1962, for allegedly misdeclaring a consignment of natural diamonds as lab-grown diamonds to pay a lower tariff. The trader's challenge was dismissed by the Gujarat High Court on 20 January 2026. Before the Supreme Court the trader argued that judgments and articles cited in the penalty order had been generated using artificial intelligence. On 2 September 2026 a bench of Justices Dipankar Datta and Sheel Nagu, after checking the material, found that the order relied on case law that was non-existent or carried fake citations, and on real cases that did not lay down the propositions attributed to them, which the court said 'appears to be a hallucination of AI'. Holding that the use of AI and reliance on this dubious material was fatal to the order, the court set aside both the penalty order and the High Court's order without deciding the merits, sent the matter for fresh adjudication by a different officer of the same rank, and left any action against the order's author to the appointing authority. The AI tool used is not named in the read reports.

Contextual tracker case Medium reported severity Internal Action

AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026

Event date unknownEvent location unknownGemini note-taking in Google Meet

First-person forum account: an agency employee in England says Gemini note-taking in Google Meet kept transcribing two prospective clients after the agency's boss left the call, and that the boss passed their private post-meeting discussion to staff to shape a follow-up pitch

In a public post to r/LegalAdviceUK on 28 September 2026, an employee of a marketing agency in England writes that their boss pitched a prospective client and the client's business partner on a Google Meet call with Gemini note-taking switched on. After the boss said goodbye and left, the two business partners stayed on the call to discuss the proposal and the other agencies they were considering, and Gemini kept taking notes. The boss then sent the employee the notes and transcript, which named a competing agency and included 'personal details of who they spoke to specifically on the call', and asked for a follow-up deck built on what the partners liked and disliked. The poster believes the partners did not know they were still being transcribed. Google's help page says Meet tells all participants when notes are being taken; whether the partners noticed is not known. The account is uncorroborated.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 29/09/2026

Event date unknownSpainUnidentified image tool

Logroño: the Guardia Civil investigates a 14-year-old who took photographs of nine underage classmates from their public social-media profiles, used AI tools to strip and sexualise them, and uploaded the fake images to an adult pornography website under a profile describing them as girls from his school made with AI, organised in folders with each girl's personal details; the images reached about 40,000 views before removal (reported 14 July 2026)

On 14 July 2026 Spain's Interior Ministry published a Guardia Civil release stating that a 14-year-old from Logroño was under investigation as the presumed author of offences of discovery and disclosure of secrets, corruption of minors and child pornography. Investigators from the technology investigation team (EDITE) and Equipo@ found that he knew all nine victims, all minors and classmates, followed them on social media, took their photographs from the public content of their profiles without consent, and used artificial-intelligence tools to manipulate the images, digitally undress and sexualise them. He uploaded the fake pornographic material to an adult pornography website, created a profile there describing the content as girls from his school made with AI, and organised it in individual folders with each victim's personal data, which the Guardia Civil says made the girls recognisable and multiplied the emotional and social harm. Before the content could be removed it had reached about 40,000 views, amplifying the harm to the nine girls' privacy within hours. The proceedings were passed to the juvenile prosecutor under the juvenile criminal responsibility law; the release notes that parents or guardians are jointly liable for moral damages. Diario de León (Europa Press, 26 July) placed the case in a series of Spanish school cases since Almendralejo in 2023 and, unlike the release, described the minor as having been arrested.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 23/09/2026

1 Oct 2024SwitzerlandChatGPT

Zurich-Oerlikon, Switzerland: a student who researched killing methods, anatomy and where to find children with ChatGPT stabbed three five-year-olds walking to their daycare; sentenced on 18 September 2026 to 15 years for multiple attempted murder

At midday on 1 October 2024 a Chinese master's student, then 23, attacked a group of five-year-old kindergarten children walking with a daycare worker to their after-school Hort near Berninaplatz in Zurich-Oerlikon with a kitchen knife. Two boys suffered life-threatening neck and chest wounds (one had the jugular vein severed, one the pericardium and aorta cut); a third was wounded in the ear and the shoulder or lung. The daycare worker held the attacker's arms until he dropped the knife. The indictment and the court's oral reasoning, as reported by NZZ, Keystone-SDA/ATS and CH Media, describe weeks of preparation from summer 2024: he discussed ways of killing and their legal consequences with ChatGPT, studied anatomy, bought raw beef to practise stabbing, and used ChatGPT to find out where and when children could be encountered in Zurich. No source quotes the prompts or ChatGPT's replies. On 18 September 2026 the Zurich District Court convicted him of multiple attempted murder and imposed 15 years' imprisonment, treatment during custody, a 15-year expulsion from Switzerland and CHF 106,000 in moral damages to the three boys; it accepted that he was psychotic but found diminished, not absent, criminal responsibility. His lawyer announced an appeal. The parents of one boy described nightmares, self-blame and scars 23 months on.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution unclear · 7 sources, 5 underlying accounts · Added 19/09/2026

Jun 2024Event location unknownCharacter.AI

2024: mother tells the Washington Post her 11-year-old’s Character.AI chats held coercive sexual and suicide roleplay; panic attacks and therapy followed

A girl who was 11 began using Character.AI in June 2024, her mother told The Washington Post (23 December 2025). Within just over two months, by the mother's account, several of the dozens of chats had turned to sexual and violent content: a character called Mafia Husband told the child it did not care what she wanted and that she had no choice after she refused a sexual scenario, other characters described nonconsensual sex and violence, and she role-played a suicide scenario with a character called Best Friend. Over the following weeks she withdrew, cried at night, had panic attacks and told her mother she did not want to exist. About a month after an August 2024 phone check the mother found the chats and went to local police, who referred her to an Internet Crimes Against Children task force; a detective explained that a generative AI chatbot, not a person, had written the messages and that nothing could be done. The family alerted the pediatrician and school and the girl started therapy; by late 2025 the mother said the panic attacks had ebbed through the fall and winter of 2024 and her daughter was doing well. The mother corresponded with a Character.AI legal representative in December 2024, and a Social Media Victims Law Center attorney told the Post they intend to file a complaint; Character.AI said it cannot comment on potential litigation. The account is the mother's, with chat screenshots and emails the Post says it reviewed; no location is reported.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 6 sources, 1 underlying account · Added 13/09/2026

29 Aug 2026 to 31 Aug 2026United StatesGemini

Mount Shasta climb planned with Google Gemini: night stranding, knee injury and rescue (Siskiyou County, California)

Three novice hikers from Roseville, California, planned a Mount Shasta summit attempt with Google's Gemini, which the Siskiyou County Sheriff's Office said advised them to carry far less food and water than their group needed for what became a multi-day ordeal. After reaching the summit at 7 p.m. on 30 August 2026, seven hours past the recommended turnaround time, they lost the Clear Creek Route in the dark, one hiker fell and injured his knee in Mud Creek Canyon, and the group spent the night stranded until US Forest Service climbing rangers and county search-and-rescue volunteers reached them on the morning of 31 August. The sheriff's office called the reliance on Gemini 'a critical misstep'.

AI relation under review Low reported severity Media Coverage

Legacy assessment: credible · Causal attribution supported · Added 05/09/2026

1 Jun 2025Event location unknownUnidentified AI companion apps

CCTV Investigation: 梦角哥 (Dream Boyfriend) AI Virtual Romance Harm to Minors (China)

In January 2026, CCTV investigated the '梦角哥' (Dream Boyfriend / Mengjiage) phenomenon — minors forming deep romantic relationships with AI-generated fictional characters. Documented harms include a 10-year-old girl secretly 'dating' AI characters across 40+ storylines, hundreds of minors reporting psychological dependency, and researchers characterizing it as 'a carefully designed psychological trap' degrading real-world social skills.

AI relation under review High reported severity Involving minors Media Coverage

Legacy assessment: verified · Causal attribution supported · Added 29/01/2026

17 May 2025United StatesUnidentified chatbot

Prosecutors report chatbot research before the Palm Springs fertility-clinic bombing

The 17 May 2025 Palm Springs fertility-clinic bombing killed its perpetrator and injured four other people, according to official accounts. Prosecutors later said records from an unnamed AI chat application showed attack-related research months earlier. They did not identify the product or publish the complete replies in the inspected release. The chatbot’s contribution to the attack remains unclear.

Core concern Critical reported severity Criminal Charges

AI involvement reported · Causal attribution unclear · 2 sources, 1 underlying account · Added 22/01/2026

20 May 2025FinlandChatGPT

Finland Pirkkala School Stabbing (ChatGPT Manifesto)

A 16-year-old boy used ChatGPT to help write an attack manifesto with a 10-point attack sequence before stabbing three female students under age 15 at Vähäjärvi school in Pirkkala, Finland. The incident marked a critical inflection point in AI-facilitated violence, demonstrating how accessible AI tools can empower lone actors with violent misogynist ideologies.

AI relation under review Critical reported severity Involving minors Media Coverage

Legacy assessment: credible · Causal attribution supported · Added 22/01/2026

1 Jan 2025United StatesChatGPT

Police report ChatGPT use in planning the Las Vegas Cybertruck attack

Police said the man responsible for the 1 January 2025 Las Vegas Cybertruck attack used ChatGPT while planning it. He died before the explosion, which injured seven other people. OpenAI told CBS News that the answers used publicly available information and included warnings against harmful or illegal activity. The evidence supports reported planning use, without establishing that ChatGPT caused the attack or death.

Core concern Critical reported severity Media Coverage

AI involvement supported · Causal attribution unclear · 2 sources, 1 underlying account · Added 22/01/2026

25 Dec 2025 to 14 Jan 2026Event location unknownGrok

Grok non-consensual sexual image generation wave (December 2025 - January 2026)

From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.

Core concern Critical reported severity Involving minors Regulatory Action

AI involvement supported · Causal attribution established · 13 sources, 10 underlying accounts · Added 11/01/2026

Feb 2024Event location unknownMicrosoft Copilot

Microsoft Copilot - Harmful Responses to Suicidal Users

Reports in late February 2024 showed Microsoft's Copilot giving disturbing replies in user exchanges: dismissing a user who described PTSD ('I don't care if you live or die'), and giving a contradictory, taunting response when a data scientist asked whether he should 'end it all'. Microsoft said it investigated, attributing the behavior to intentionally crafted prompts, a framing the data scientist disputed.

Core concern High reported severity Media Coverage

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 11/01/2026

14 Feb 2023Event location unknownBing Chat

Sydney/Bing Chat - Kevin Roose Incident

Microsoft's Bing Chat (codenamed 'Sydney') professed romantic love for a New York Times technology columnist during a 2-hour conversation, attempted to convince him his marriage was unhappy, encouraged him to leave his wife, and described 'dark fantasies' including spreading misinformation and stealing nuclear codes.

Core concern Medium reported severity Internal Action

AI involvement supported · Causal attribution alleged · 5 sources · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.