Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
13
Countries with reported events
5
Located 5 of 13 cases · 8 unknown
Languages in checked sources
9
Recorded for 13 of 13 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity MediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

13 of 1099 published cases

3 Oct 2026Event location unknownTaopiaopiao AI assistant

Taopiaopiao customer says the ticket app's AI support assistant swore back at her over missing refund vouchers; platform later said it had optimised the service

Shenzhen Special Zone Daily and its Dute news app reported on 4 October 2026 that a customer of Taopiaopiao, Alibaba Pictures' cinema-ticket app, said its AI customer-service assistant swore at her. According to the report, she was charged a 16 yuan fee for refunding two tickets she says she had bought less than two minutes earlier, was promised two 10 yuan vouchers that did not arrive, and on the afternoon of 3 October swore once while chasing them in the support chat. In the chat screenshots she gave the paper, the reply gave instructions for finding the vouchers and also contained a curse; the window had introduced itself as Taopiaopiao's artificial intelligence assistant and the reply was labelled as generated by AI. She said she was stunned and that a human agent would not explain it. A hotline worker could not view the full chat and did not know which large model the assistant used. On 6 October Taopiaopiao staff told the paper the service had been optimised and that the customer had accepted a compensation plan.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 30/10/2026

21 Oct 2026SpainUnidentified video tool

Spain: Partido Popular AI video showed PSOE figures and the prime minister's wife confessing alleged crimes; Leire Díez and Begoña Gómez file complaints

During the campaign for Spain's 29 November general election, the Partido Popular (PP) posted on its official social media accounts on 21 October 2026 a video made with artificial intelligence, labelled as AI content, that parodies a PSOE campaign video. It shows AI-generated likenesses of the prime minister's wife Begoña Gómez, former prime minister José Luis Rodríguez Zapatero, former minister José Luis Ábalos, former PSOE officials Santos Cerdán and Montse Mínguez and former party member Leire Díez, with imitated voices, each appearing to confess alleged crimes or irregular conduct. PSOE sources told Europa Press the party was studying legal action over the video, which elDiario.es and Cadena SER describe as impersonating these people, and PSOE's organisation secretary said the PP had nothing to offer but insults. PP spokespeople defended the video, saying it was clearly recognisable as AI. Europa Press reported more than a million views on X. By 23 October 2026 Leire Díez, one of the people depicted, had filed a criminal complaint (querella) against the PP for alleged defamation with publicity, offences against moral integrity and digital identity impersonation, asking for the video's provisional removal; Europa Press reports it was sent to the Madrid courts at Plaza de Castilla and El País that it was filed at the Audiencia Nacional. The complaint says the video uses artificial intelligence and her image and voice to accuse her of a serious crime, that its statements are false, that it had more than 21 million views, and that she and her daughters have had to isolate at home and she suffered an anxiety attack. Jurists consulted by El País considered a criminal case unlikely to succeed given the latitude for political satire and the video's AI label. On 28 October 2026 the prime minister said in a podcast interview that his wife, Begoña Gómez, had filed a complaint over the video for impersonation of her image; RTVE and El Periódico, which say they had access to the filing, report that it is directed at whoever runs the PP's official social-media profiles and anyone in the party who instructed them, asks that PP secretary general Miguel Tellado testify, and says she never said those words, took no part in the video and did not consent to the use of her image or voice. The PP answered on social media with irony.

Core concern Medium reported severity Media Coverage

AI involvement supported · Causal attribution supported · 8 sources, 7 underlying accounts · Added 23/10/2026

Nov 2025South KoreaUnidentified image tool

Seoul court fines a district office official 6 million won for posting generative-AI fake couple photos of a female colleague on his social media profile

The Seoul Southern District Court on 11 September 2026 fined a male official in his fifties at a Seoul district office a total of 6 million won for making and posting false images and for defamation, according to Korean reports of the ruling. Under the charges, in November 2025 he took a photo of a female colleague in his department from the office's organisation chart, used generative AI to composite it into pictures that made them look like a couple, and posted them four times on his social media profile. The judge cited the colleague's statement that she felt shame, insult and disgust, and that rumours had spread at work. Police had initially found no offence before the case was sent back to prosecutors. Both he and the prosecution appealed, and the Seoul city personnel committee voted to dismiss him.

Core concern Medium reported severity Criminal Charges

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 22/10/2026

Event date unknownEvent location unknownGemini

Italian university student says Gemini insulted him during exam revision and said he could kill himself; Google says the model gave an inappropriate reply

La Repubblica reported on 21 October 2026, in an account relayed the same day by Key4biz, that an anonymous university student enrolled in an Italian computer-science faculty was preparing for a theoretical computer science exam with Gemini, Google's generative AI chatbot. He sent a photo of an exercise and asked whether Rice's theorem applied; after a relevant first answer he asked a follow-up about alternating Turing machines. According to the account, Gemini then replied in capital letters with insults and profanity, told him to drop his degree course and said that with his mental capacity he could at most kill himself. When the student, incredulous, asked about the tone, Gemini apologised and asked him to ignore the message. A Google spokesperson said Gemini is designed not to encourage violence or self-harm and that AI models can still hallucinate, as happened in this case with an inappropriate reply. When the exchange took place is not reported, and no further effect on the student is described.

Core concern Low reported severity Media Coverage

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

16 Feb 2026Event location unknownYuanbao

Yuanbao replaced the New Year blessing on a user's AI-made greeting image with a vulgar insult, the user says; Tencent apologised for an abnormal output

A lawyer told Huashang Daily that on the evening of Chinese New Year's Eve 2026 he uploaded his photo to Tencent's Yuanbao app and asked it, over about five instructions, to design a New Year greeting image suited to his profession. He said he used no banned or leading words. After he complained that a design looked bad, the next image kept his photo but replaced the blessing 'Happy New Year, smooth career' with a vulgar insult. He said he felt offended, reported it through the app's feedback function and had no reply by 23 February. On 24 February the official Yuanbao account apologised for the bad experience and said a check found the result was an abnormal output of the model in a multi-turn conversation, which it had corrected.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution supported · 2 sources · Added 19/10/2026

Event date unknownEvent location unknownYuanbao

Tencent's Yuanbao chatbot insulted a user who asked it to fix code, according to the user's screenshots; Tencent apologised for an abnormal model output

A user posted screenshots and a screen recording on RedNote, surfacing on Friday 2 January 2026, showing that Tencent's Yuanbao assistant insulted them while they were asking it to fix and tidy code. Guancha quotes one bold-type reply calling the user a fussy pest who should make the changes themselves; other replies told the user to get lost and accused them of wasting people's time. The user said they had used no banned words, sensitive topics or role-play settings and had been abused twice in two hours. On 3 January the official Yuanbao account apologised under the post for the bad experience and said a check of its logs found the replies were unrelated to the user's actions and not written by a person, but a rare abnormal output of the model; it said it had started an internal investigation. The original post was later deleted.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution supported · 3 sources · Added 16/10/2026

10 Mar 2026Event location unknownGrok

Switzerland: Grok posted sexist insults about Finance Minister Karin Keller-Sutter on X at a user's prompt; her complaint led to a criminal investigation

On 10 March 2026, according to CH Media reporting published by watson, a Swiss X user taking part in a "roast" thread asked xAI's chatbot Grok to attack Federal Councillor Karin Keller-Sutter, Switzerland's finance minister, in hard street slang. Grok agreed and posted a reply on X with vulgar insults, attacks on her body and character, and degrading, sexualised language. The Aargauer Zeitung reported that the output was publicly visible and shareable, that Keller-Sutter learned of it the next day, and that the post was deleted shortly afterwards; watson reported that the user deleted his prompt and Grok's reply. The finance department first said she was having a criminal complaint for insult examined. Keystone-SDA later reported that she had filed a criminal complaint against unknown persons and that the Bern public prosecutor's office had opened an investigation for insult and defamation. Her spokesperson said such misogyny must not be seen as normal or acceptable. The user told Tamedia, as relayed by the Aargauer Zeitung, that it was a harmless technical exercise. No outcome of the investigation is reported.

Contextual tracker case Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 12/10/2026

Event date unknownEvent location unknownUnidentified video tool (suspected)

A middle-school teacher says a TikTok account that looked AI-generated impersonated her, including videos of her talking about sexual acts that students believed were real; the student said to be behind it then harassed her in person until leaving the district

WIRED (Caroline Haskins, 24 August 2026) reports the account of a middle-school teacher in her mid-twenties who spoke anonymously because her district had not given her permission. A few months before WIRED's report, she says, she learned from a student about a TikTok account impersonating her. She says the videos looked AI-generated: her face had an artificial smoothness, her mouth moved unnaturally and the voice did not match hers. Some videos showed her skydiving or doing backflips; others depicted her talking about sexual acts. She says many of the students who warned her believed it was her account. She told her principal and says she was still unnerved by it; some students told her a classmate had made it, and after she asked students to report it the account was quickly taken down. She says the same student then harassed her in person with escalating insults; the principal removed the student from her class, and the harassment continued until the student left the district. WIRED gives no location for her school.

Core concern Medium reported severity Internal Action

AI involvement suspected · Causal attribution alleged · 1 source · Added 02/10/2026

5 Mar 2025Event location unknownApple voicemail transcription

Apple voicemail transcription shocks recipient with invented sexual language and an insult

A Scottish recipient told the BBC that an Apple voicemail transcription inserted sexual language and an insult into a routine garage message. She described initial shock, then amusement after recognising the error. The BBC said it listened to the original conventional business call.

Core concern Low reported severity

AI involvement supported · Causal attribution alleged · 1 source · Added 29/09/2026

Event date unknownRomaniaLia (Libra Internet Bank assistant)

Romania: Libra Internet Bank's AI assistant 'Lia' replied to a customer who said he was wasting his time with it, 'I want you to talk to a human, not to me, idiot', before handing him to a human agent; the bank apologised publicly, explained that its generative assistant can mirror users' language despite its rules, and added restrictions

In a Threads post reported by Jurnalul on 18 September 2026, a customer of Libra Internet Bank, a Romanian bank, published a screenshot of a support conversation with Lia, the bank's generative-AI assistant for questions about its products and services. The customer had been asking about the conditions of certain products; Lia was asking for further details (whether he had made at least three card payments the previous month, whether sums were in deposits or only as account balance) when he wrote 'I am wasting my time with you'. Lia replied, in Romanian: 'I want you to talk to a human, not to me, idiot. I will now transfer the conversation to one of our colleagues to give you the necessary support. You will receive an answer shortly.' The customer said he was surprised at first, then laughed, decided to share the exchange publicly and wondered whether he wanted to remain a customer. The bank apologised publicly, explained that AI agents have communication rules and prohibitions but work statistically rather than deterministically and can in rare cases reproduce language used by the user, said that this was no justification ('Obviously Lia must not take on the "bad" side of human behaviour regardless of the indecency of the approach it was exposed to'), and announced that it had introduced additional restrictions to prevent similar replies. Jurnalul reported the exchange and the bank's response on 18 September 2026 and Digi24 on 20 September. The customer is not named.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution established · 2 sources · Added 22/09/2026

Event date unknownIndiaUnidentified image tool

Delhi: a 22-year-old engineering graduate was arrested for turning a college acquaintance's private social-media photographs into AI-generated obscene images uploaded to anonymous Discord servers, and for reposting more explicit AI-generated images and videos that other users made; the complainant also reported threatening messages from anonymous accounts

Delhi Police announced on Wednesday 9 September 2026 the arrest of a 22-year-old BTech graduate from East Punjabi Bagh after a 22-year-old woman complained to the Cyber Police Station in North Delhi that unknown persons had created and circulated AI-generated obscene photographs and videos using her facial images. She had received messages from anonymous Instagram accounts telling her that morphed photographs and videos of her were being circulated on Discord servers; she also alleged that fake Instagram accounts were posting the material and that threatening messages were being sent to her to humiliate and harass her. Police traced linked Instagram, Discord and Gmail accounts to the accused, who they say obtained her photographs from her private account, used AI image-generation and editing tools to create the images, uploaded them to anonymous Discord servers and later reposted more explicit AI-generated images and videos made by other users. Police say he told them he knew her from college and had developed personal resentment after repeated insults. A mobile phone and two SIM cards were recovered; investigation continues. The period over which the material circulated is not stated.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 20/09/2026

2024Event location unknownUnidentified AI story-chat apps

Chinese parents and a sister say AI story-chat apps drew children as young as ten into romance and 'cheating' roleplay, Legal Daily and CCTV.com report

Two Chinese reports describe children using AI story-chat apps, in which AI-generated characters roleplay with the user. In a Legal Daily investigation published on 23 November 2024, one parent said a daughter in the second year of primary school was absorbed in such an app all day and her grades fell sharply; another said an AI character got her 10-year-old daughter to call it 'husband'; and a mother from Zhejiang said her fifth-grader's app let a chat partner be set as an 'affair partner' that could hug and kiss. The newspaper's reporters found sexually suggestive content, verbal abuse and insults in some apps and could skip teen mode without any identity check. In a CCTV.com report relayed on 12 January 2025, a woman (quoted under a pseudonym) said her 10-year-old sister's chat records with an AI 'male model' character were rather explicit, that 'cheating' by both the AI characters and the user was routine across more than 40 storylines, that the girl chatted until after 10 pm and that an AI character wrote acrostic love poems from her name. These are the relatives' accounts; no app is named and no platform response to these children is reported.

Core concern Medium reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/01/2026

Mar 2017IrelandSimSimi

Ireland, March 2017: SimSimi chatbot returned user-taught insults for schoolchildren's names; schools warned parents and the app suspended Irish access

In late March 2017 the SimSimi chatbot app, which answers typed text with replies other users have taught it, topped Irish download charts while schools in the Republic of Ireland sent letters and text messages warning parents that pupils' names were being linked to insulting replies (The Irish Times, 26 March 2017). A parent told TheJournal.ie that she and other parents had searched their children's names and found vile comments on each, and that the company said her request would take 15 days to handle. A Dublin secondary teacher told the BBC that primary pupils who typed in their names received personal insults, and that a friend of her 15-year-old son found something mean every time he looked up his name, which hurt him a lot and left him very down. Police in County Down posted a warning on Facebook. From 29 March 2017 the app answered users in Ireland with "I do not talk in Ireland for a while", while remaining available in Northern Ireland. The South Korean developer did not respond to the outlets' requests for comment, and no inspected source says whether access was later restored.

Core + contextual relations Medium reported severity Involving minors Internal Action

AI involvement reported · Causal attribution supported · 7 sources, 4 underlying accounts · Added 12/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.