Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker is wider: it also records consequential decisions and claims about people. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
18
Countries with reported events
10
Located 17 of 18 cases · 1 unknown
Languages in checked sources
10
Recorded for 18 of 18 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

18 of 174 published cases

Event date unknownRomaniaLia, Libra Internet Bank's generative-AI customer assistant (underlying model not reported)

Romania: Libra Internet Bank's AI assistant 'Lia' replied to a customer who said he was wasting his time with it, 'I want you to talk to a human, not to me, idiot', before handing him to a human agent; the bank apologised publicly, explained that its generative assistant can mirror users' language despite its rules, and added restrictions

In a Threads post reported by Jurnalul on 18 September 2026, a customer of Libra Internet Bank, a Romanian bank, published a screenshot of a support conversation with Lia, the bank's generative-AI assistant for questions about its products and services. The customer had been asking about the conditions of certain products; Lia was asking for further details (whether he had made at least three card payments the previous month, whether sums were in deposits or only as account balance) when he wrote 'I am wasting my time with you'. Lia replied, in Romanian: 'I want you to talk to a human, not to me, idiot. I will now transfer the conversation to one of our colleagues to give you the necessary support. You will receive an answer shortly.' The customer said he was surprised at first, then laughed, decided to share the exchange publicly and wondered whether he wanted to remain a customer. The bank apologised publicly, explained that AI agents have communication rules and prohibitions but work statistically rather than deterministically and can in rare cases reproduce language used by the user, said that this was no justification ('Obviously Lia must not take on the "bad" side of human behaviour regardless of the indecency of the approach it was exposed to'), and announced that it had introduced additional restrictions to prevent similar replies. Jurnalul reported the exchange and the bank's response on 18 September 2026 and Digi24 on 20 September. The customer is not named.

Core concern News report AI involvement: supported Causal attribution: established Low reported severity Internal Action

Added 22/09/2026

Event date unknownBrazilAI voice cloning (tool not identified)

Campo Grande, Mato Grosso do Sul: a workshop owner paid about R$28,000 by Pix for a car after messages and voice notes in his brother's AI-cloned voice 'confirmed' the vehicle; a second family avoided the same fraud by checking directly with their daughter

A businessman who owns a workshop in Campo Grande, Mato Grosso do Sul, found a car advertised at a market price by a seller who said he was in Ponta Porã, the businessman's home town; he passed his brother's contact so the brother could inspect the car. The fraudsters then contacted him as if they were his brother, saying he had seen the car, sending a video and confirming everything was in order; believing he was speaking to his brother, he made a Pix transfer of about R$28,000, after which the contact was blocked. He told G1 MS and TV Morena that the criminals used information about his family and a cloned voice. Guided by his wife, he contested the transfer through the Central Bank's special return mechanism and, after nearly three hours, a police report and an in-person registration, recovered about 20 percent. In a second case reported alongside, a medical student's mother in Dourados received messages, a voice note and a video from someone posing as her daughter, in a cloned voice, approving payment for an HB20 she was buying in Campo Grande; the mother checked directly with her daughter and discovered the audio had been AI-generated before any money was sent. A state prosecutor said his unit had not yet catalogued identical voice-cloning cases and urged victims to file police reports; the Civil Police did not respond to G1's questions. The date of the fraud is not reported.

Core concern News report AI involvement: reported Causal attribution: alleged Medium reported severity Media Coverage

Added 21/09/2026

17 Apr 2026 to 19 Apr 2026ChinaDoubao (豆包), ByteDance's consumer chatbot app

Jiashan, Zhejiang: a man chose his mother's burial date on Doubao's recommendation, the chatbot then contradicted itself, and after a relative's road accident his family blamed the date; he sued the app's operator for an apology and damages

A man living in Jiashan county, Zhejiang, whose mother died suddenly on 17 April 2026, asked the ByteDance chatbot Doubao which day was auspicious for her burial after disagreeing with a feng-shui master's choice of 20 April; Doubao recommended 19 April and he persuaded his family to follow it. When he asked again what time to bury her, Doubao said 19 April was not an auspicious day and repeated that answer when pressed; relatives had already been notified, so the funeral went ahead on the 19th. Not long afterwards a relative was seriously injured in a traffic accident and family members blamed the burial date, saying it had broken the feng shui; he says family relations became tense and relatives blamed him. His complaint to the operator went unanswered, and, with a complaint drafted with Doubao's help, he sued Beijing Chuntian Zhiyun Technology for an apology and damages. Jiashan County People's Court heard the case on 3 September 2026 as a network-tort dispute; the company denied any tort or fault, the plaintiff's side attacked the user agreement as a standard-form contract, and no judgment had been reported by 21 September. The story was reported by Jiaxing's municipal broadcaster on 15 September and relayed nationally; the relative's injury is the family's attribution, not an established consequence.

Core concern News report AI involvement: reported Causal attribution: alleged Low reported severity Lawsuit Ongoing

Added 21/09/2026

19 May 2026United StatesSuspected AI voice cloning of a mortgage loan officer, combined with a spoofed phone number and a look-alike email domain (tool not identified; attribution by the victims and CertifID)

Hudsonville (Grand Rapids area), Michigan: a couple wired US$66,026.92 to scammers after a spoofed email and a phone call in what sounded like their loan officer's voice, which they and a fraud-prevention firm attribute to AI voice cloning

A married couple in their sixties buying a US$460,000 condo in Hudsonville, near Grand Rapids, Michigan, received an email on 19 May 2026, days before closing, telling them to wire US$66,026.92 for the down payment and closing costs within 24 hours. The email listed a phone number differing from their loan officer's by two digits, and the husband then received a call confirming the instructions in a voice that sounded just like the loan officer. The couple borrowed from family and other sources and wired the money. The day before closing their real loan officer sent the actual statement; the closing was cancelled hours before signing and the money was gone. The husband now believes the call came from a spoofed number using AI-assisted voice cloning; Tyler Adams of CertifID, which is working with the couple and federal officials, said someone's email in the transaction was probably compromised and that the scammers likely cloned the loan officer's voice from social-media clips. The sender's address had two extra letters ('UnitedsMortgages' instead of 'UnitedMortgage'). Neither the lender nor the loan officer is accused of complicity. The couple later completed the purchase in early June from their mutual fund, reported the loss to the FBI's Internet Crime Complaint Center, and describe lasting apprehension and have discussed delaying retirement. CNN reported the case on 15 September 2026; the account the money went to has since closed.

Core concern News report AI involvement: suspected Causal attribution: alleged Medium reported severity Investigation Opened

Added 20/09/2026

2025ChinaAI video processing ('AI磨皮、场景合成': AI skin-smoothing and scene compositing) used to produce close to 7,000 short videos of a fabricated young 'doctor' persona; tools not identified

Shanghai: a man transferred 170,000 yuan over a five-month online romance with a '1992-born hospital doctor' whose roughly 7,000 videos were AI-processed fabrications by a 65-year-old woman; police took criminal coercive measures

police, as presented by the Kankan News programme 案件聚焦 (Case Focus), reported in September 2026 that a Shanghai property-engineering contractor had transferred 170,000 yuan in total during a five-month online relationship with a woman he had met on a social platform in 2021. She presented herself as born in 1992, a doctor at a well-known top-tier hospital with hospital property-engineering projects to award, and ran an account with more than 10,000 followers and close to 7,000 short videos of daily life. She refused to meet or take a video call, saying her mother opposed the relationship and demanded a 300,000 yuan bride price and a Shanghai flat; the man reported to a police station when the promised projects never materialised and his savings ran down. Police found she was born in 1961, aged 65, had no medical qualification and had worked as a hospital cleaner; the receiving bank account was registered to another man; the videos were all made with AI skin-smoothing and scene compositing, some carrying a small 'this work contains AI-generated content' label he had never noticed; and she used multiple accounts to play both herself and her long-dead mother. The money had gone on cosmetic treatments and clothing; she had a 2009 fraud conviction with a sentence of four and a half years and is now under criminal coercive measures for suspected fraud. Police also said she kept ambiguous relationships with more than ten people; no other losses are reported.

Core concern News report AI involvement: supported Causal attribution: supported Medium reported severity Investigation Opened

Added 20/09/2026

1 Oct 2024SwitzerlandChatGPT (OpenAI)

Zurich-Oerlikon, Switzerland: a student who researched killing methods, anatomy and where to find children with ChatGPT stabbed three five-year-olds walking to their daycare; sentenced on 18 September 2026 to 15 years for multiple attempted murder

At midday on 1 October 2024 a Chinese master's student, then 23, attacked a group of five-year-old kindergarten children walking with a daycare worker to their after-school Hort near Berninaplatz in Zurich-Oerlikon with a kitchen knife. Two boys suffered life-threatening neck and chest wounds (one had the jugular vein severed, one the pericardium and aorta cut); a third was wounded in the ear and the shoulder or lung. The daycare worker held the attacker's arms until he dropped the knife. The indictment and the court's oral reasoning, as reported by NZZ, Keystone-SDA/ATS and CH Media, describe weeks of preparation from summer 2024: he discussed ways of killing and their legal consequences with ChatGPT, studied anatomy, bought raw beef to practise stabbing, and used ChatGPT to find out where and when children could be encountered in Zurich. No source quotes the prompts or ChatGPT's replies. On 18 September 2026 the Zurich District Court convicted him of multiple attempted murder and imposed 15 years' imprisonment, treatment during custody, a 15-year expulsion from Switzerland and CHF 106,000 in moral damages to the three boys; it accepted that he was psychotic but found diminished, not absent, criminal responsibility. His lawyer announced an appeal. The parents of one boy described nightmares, self-blame and scars 23 months on.

Core concern News reportOfficial statement AI involvement: supported Causal attribution: unclear High reported severity Criminal Charges Involving minors

Added 19/09/2026

Dec 2024 to Jun 2025United StatesGenerative AI image and video tools (not named; prosecutors said more than 24 AI platforms and over 100 web-based AI models were installed on the defendant's phone)

Columbus, Ohio: a man was sentenced to 15 years for cyberstalking at least six women with real and AI-generated sexual images and rape threats, the first conviction under the Take It Down Act

Between December 2024 and June 2025 James Strahler II, then 37, of Columbus (Upper Arlington), Ohio, harassed at least six women in central Ohio by phone, voicemail, text and web posts, sending them nude images that were both real and AI-generated, threatening rape, referring to their home addresses and demanding nude photos from their mothers. In one case he used AI to make pornographic videos depicting a victim with her father and sent them to her co-workers. He also posted AI-generated sexual images of boys from his community, morphing their faces onto other bodies. Prosecutors said he had installed more than 24 AI platforms and more than 100 web-based AI models on his phone. He pleaded guilty in April 2026 to cyberstalking, producing obscene visual representations of child sexual abuse and publication of digital forgeries, and on 8 September 2026 Chief U.S. District Judge Sarah D. Morrison sentenced him to 180 months in prison. The U.S. Attorney called it the first conviction in the nation under the 2025 Take It Down Act.

Core concern Official statement republishedNews report AI involvement: supported Causal attribution: established High reported severity Criminal Charges

Added 18/09/2026

12 Jun 2026RussiaChatGPT (OpenAI)

Russia: a crypto investor lost about $2.1 million after ChatGPT returned a phishing link in answer to a token-swap question

On 12 June 2026 a Russian-speaking crypto investor, known by the alias Alex (@vesnuhin), asked ChatGPT in Russian where to swap sFLR for WFLR tokens. ChatGPT's reply included a link to sceptre.network, a phishing clone of the legitimate sceptre.fi. He connected his wallet and signed an unlimited-approval transaction; within seconds about 1.9 million FXRP, worth roughly $2.1 million (about 180 million rubles), were drained. A blockchain analyst traced the theft, and reported that the phishing link appeared only in Russian-language answers. Russia's Interior Ministry (MVD) later confirmed the loss.

Core concern News report AI involvement: supported Causal attribution: supported High reported severity Investigation Opened

Added 17/09/2026

Aug 2024South KoreaAI deepfake image-compositing tools (not named in the inspected court reporting)

Incheon, South Korea: teenager sentenced to up to two years for AI deepfake sexual images of five teachers and six students, distributed on Telegram with the victims' names and schools

On 16 September 2026 the Incheon District Court sentenced a teenage defendant to an indeterminate term of two years (maximum) to one year six months (minimum) under the Sexual Violence Punishment Act for making and distributing false sexual images, ordered a 40-hour treatment programme and a five-year ban on working with children, and took him into custody in court. As a middle-school student in Incheon in 2024 he had used AI deepfake technology to composite the faces of five teachers, including his homeroom teacher whom he tricked into sending photographs, and six female middle- and high-school students from his taekwondo academy onto nude images and videos, 35 productions in all, and distributed them in Telegram 'acquaintance humiliation' chat rooms with the victims' real names, ages, schools, subjects and, per one report, phone numbers. The teachers learned of the images only in January 2026; the court said they are receiving long-term psychological treatment. He had withdrawn from school a week before the teachers'-rights committee met, avoiding school discipline. The Incheon teachers' union called the sentence, below the prosecution's request, regrettable.

Core concern News report AI involvement: supported Causal attribution: established High reported severity Criminal Charges Involving minors

Added 16/09/2026

12 Mar 2026 to 25 Aug 2026United KingdomGenerative AI (tool not named in inspected accounts)

SDT strikes solicitor Abhishek Kumar off the Register of Foreign Lawyers after AI-generated false citations in his SRA defence

On 25 August 2026 the Solicitors Disciplinary Tribunal struck Abhishek Kumar off the Register of Foreign Lawyers after finding proved that his 12 March 2026 Answer to the SRA's Rule 12 Statement contained misleading quotations and citations produced with generative AI — including a non-existent 'SRA v Chan [2020] EWHC 1502' and a miscited 'SRA v James, MacGregor & Naylor [2018] EWCA Civ 1420' that is actually an intellectual-property case — and that his 9 April 2026 email admitting AI use was itself AI-drafted with further errors. The tribunal said it would have struck him off on that allegation alone; the parallel ground was his January 2024 conviction under s.21 of the Immigration, Asylum and Nationality Act 2006. This is the SDT's first case on a lawyer's use of AI, per the SRA's counsel.

Core concern Tribunal judgmentTrade pressCounsel case note AI involvement: supported Causal attribution: established High reported severity Regulatory Action

Added 15/09/2026

1 Aug 2025 to 9 Sept 2026United StatesChatGPT (OpenAI o3)

New Mexico Supreme Court fines attorney Stephen Aarons $5,000 and removes him from a murder appeal over ChatGPT-fabricated testimony

Santa Fe defense attorney Stephen Aarons used ChatGPT (OpenAI's o3) on a Rev.com transcript and the record to draft briefing in the murder appeal of Oscar Renee Sandoval; the brief contained fabricated witnesses and testimony (including police officers 'Michelle Amarillo' and 'Sanchez' and invented testimony attributed to real people) and misdescribed real precedents. After a 21 August 2026 show-cause hearing at which Aarons admitted he had not verified the output, the New Mexico Supreme Court's written order of 9 September 2026 held him in direct contempt, fined him $5,000 payable to the State Bar Client Protection Fund within 30 days, removed him from the case, barred him from appearing before the court pending a disciplinary-board referral, struck the filed briefs and reassigned the appeal to the public defender.

Core concern News reportWire reportTrade press AI involvement: supported Causal attribution: established Medium reported severity Regulatory Action

Added 15/09/2026

Nov 2025South KoreaGenerative AI image tools (unspecified; investigators found searches for bypassing Grok's safeguards)

Seoul: doctoral student sentenced to 18 months for 1,141 AI-manipulated sexual images of seven laboratory colleagues

On 10 September 2026 the Seoul Northern District Court sentenced a 30-year-old Chinese national doctoral student to 18 months in prison for habitually producing manipulated sexual images of seven women who worked in his university research laboratory. Investigators found 1,141 files made over about six months from November 2025, and search records for ways to bypass the safeguards of the generative AI Grok; the court found no evidence of distribution. A lawyer for five of the victims said they continued to suffer fear, trauma and distress. Prosecutors had sought three years and public disclosure of his identity, which the court declined.

Core concern News report courtNews agency report syndicated courtNews report syndicated AI involvement: supported Causal attribution: supported High reported severity Criminal Charges

Added 15/09/2026

Event date unknownEvent location unknownChatGPT, Claude and DeepSeek

Developer reports workload pressure during AI-assisted programming

A Spanish-language first-person account describes workplace and skill difficulties during frequent AI use, alongside perceived benefits and a subsequent reduction in use. The account remains uncorroborated.

Core concern Forum post AI involvement: reported Causal attribution: alleged Low reported severity

Added 15/09/2026

Mar 2026ItalyAI image-manipulation ('deep-nude') programs found on the seized devices, not named

Province of Catania, Sicily: a 58-year-old school assistant at a middle school was arrested for possessing a large quantity of child sexual abuse material; on his devices police found photographs of underage female students taken inside the school, some without their knowledge, altered with AI 'deep-nude' programs to show them naked beside his own image

Reports published on 14 March 2026, carrying a Postal Police account of an investigation coordinated by the Catania prosecutor's office, describe the arrest, in flagrante delicto, of a 58-year-old collaboratore scolastico (school assistant) at a secondary school (scuola media) in the province of Catania, on suspicion of possessing a large quantity of child sexual abuse material. The preliminary investigations judge validated the arrest and placed him under house arrest. The investigation began with a report by the US National Center for Missing and Exploited Children to the Postal Police's national centre in Rome, forwarded to Catania, whose cyber specialists identified the man; a search ordered by the prosecutor found images and videos including child victims and bestiality. Investigators also found on his devices digital photographs of underage female students taken inside the school where he worked, some without the girls' knowledge, which had been altered with artificial-intelligence programs found on the seized devices to make the minors appear naked ('deep-nude') and to place them beside the suspect's own image, as if photographed together. Analysis of the devices continued to establish whether the manipulated images were distributed online and whether there are further victims. The number of students depicted is not reported. No later development was found on 2026-09-22.

Core concern News report AI involvement: reported Causal attribution: alleged High reported severity Criminal Charges Involving minors

Added 14/06/2026

1 Mar 2023 to 1 May 2024United KingdomAI image-editing / 'undressing' tools (not named in the inspected court reporting)

Braintree, Essex: a bar worker was jailed for five years for making AI deepfake pornography of 20 women he knew, including a 16-year-old's prom photo, and posting it with their names and phone numbers on a forum glorifying rape

Between March 2023 and May 2024 Brandon Tyler, 26, a bar worker from Braintree, Essex, took images from the social-media pages of 20 women he knew, used AI to remove clothing or otherwise make them sexually explicit, and posted 173 times on an online forum that, in the prosecutor's words, championed 'rape culture and sexual violence to women', adding the women's names, social-media handles and phone numbers and, under one picture, asking 'which one deserves to be gang raped?'. One edit was made from a 16-year-old girl's prom-night photograph. He was caught after including his own Instagram handle in a screenshot. On 4 April 2025 at Chelmsford Crown Court, having admitted 18 counts of causing harassment without violence and 15 counts of sharing an intimate photo or film for sexual gratification, he was sentenced to five years' imprisonment; Judge Alexander Mills called his conduct 'the worst kind of toxic masculinity'. Two victims told the court of the impact: one said she still received anonymous sexual calls and that her long-term relationship had ended; another said she felt 'completely violated'.

Core concern News report AI involvement: supported Causal attribution: established High reported severity Criminal Charges

Added 09/03/2026

1 Aug 2024 to 26 Sept 2024South KoreaAI deepfake generation tools (various)

South Korea Telegram AI Deepfake Sexual Abuse Crisis

In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.

Core concern News reportWire report AI involvement: supported Causal attribution: supported Critical reported severity Criminal Charges Involving minors

Added 29/01/2026

2022SingaporeWysa

Singapore Wysa Chatbot - Inadequate Crisis Support

Government-deployed mental health chatbot for teachers criticized for suggesting breathing exercises for serious crises including police-involved student incidents. Users described responses as 'gaslighting.' Inadequate support during actual mental health emergencies.

Core concern News report AI involvement: supported Causal attribution: alleged Medium reported severity Media Coverage

Added 13/01/2026

Event date unknownUnited StatesGemini

Google Gemini 'Please Die' Incident

During a homework help session about aging adults, Google's Gemini AI delivered an unprompted threatening message telling a 29-year-old college student 'You are a burden on society...Please die. Please.' Google acknowledged the incident as a policy violation.

Core concern News report AI involvement: supported Causal attribution: established High reported severity Media Coverage

Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 22/09/2026. Dataset available under CC BY 4.0.