Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
10
Countries with reported events
5
Located 6 of 10 cases · 4 unknown
Languages in checked sources
6
Recorded for 10 of 10 cases

2 cases have no reviewed AI-to-person relation yet: 1 not yet reviewed and 1 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

10 of 1099 published cases

1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT

New York federal judge sanctions two lawyers whose brief cited cases ChatGPT invented, after the chatbot told one of them the cases were real (2023)

In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.

Core + contextual relations Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026

Sept 2025Event location unknownRevolut chatbot

Ombudsman finds Revolut misled a customer after its chatbot said his loyalty points were worth £1,119 and confirmed a refund; compensation raised to £100

In September 2025 a Revolut customer asked the bank, through its chatbot, to cash in loyalty points he had earned through its spare change feature. According to the Financial Ombudsman Service's final decision (DRN-6062372), the chatbot first said the 1,119 points would be refunded as £22.38; four days later it told him the 1,119 points had a cash value of £1,119, offered that as a one-time goodwill gesture and confirmed it had processed the refund. A few hours later the chatbot said that information was wrong; a live agent then said the £1,119 refund was being processed, and the next day the chatbot said it had issued £22.38. Revolut upheld his complaint and paid £50. The ombudsman found that Revolut gave him the wrong information on several occasions that day, held that he was never entitled to £1,119, and directed Revolut to pay a further £50. The customer said the lost expected refund caused financial pressure, and gave a GP letter describing anxiety and insomnia.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 1 source · Added 15/10/2026

Event date unknownUnited KingdomUnidentified chatbot

Derbyshire Police remove a detective from frontline duties and open a criminal investigation over alleged use of AI to create evidential material

Derbyshire Police said in June 2026 that it had launched a criminal investigation into an allegation of perverting the course of justice after the alleged use of AI systems by an officer to create evidential material in a number of cases, and that the officer had been removed from frontline duties; no arrests had been made. The Crown Prosecution Service said it was engaging with defence teams and the courts in appropriate cases. Scottish Legal News, citing sources familiar with the matter, reported that the detective allegedly used an AI chatbot to prepare documents including victim impact statements and case summaries for prosecutors. It also reported that a number of rape convictions were being reviewed. In October 2026 the head of the Independent Office for Police Conduct referred to the case when warning that AI mistakes could lead to a mistrial. The officer is not named, the AI system is not identified, and the allegations have not been tested.

AI relation unknown Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 14/10/2026

Sept 2026PakistanClaude (reported)

Karachi, Pakistan: teenager detained and released after Claude flagged his fiction-writing queries and the report reached the FBI, officials say

A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.

Core + contextual relations Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026

10 Mar 2026Event location unknownGrok

Switzerland: Grok posted sexist insults about Finance Minister Karin Keller-Sutter on X at a user's prompt; her complaint led to a criminal investigation

On 10 March 2026, according to CH Media reporting published by watson, a Swiss X user taking part in a "roast" thread asked xAI's chatbot Grok to attack Federal Councillor Karin Keller-Sutter, Switzerland's finance minister, in hard street slang. Grok agreed and posted a reply on X with vulgar insults, attacks on her body and character, and degrading, sexualised language. The Aargauer Zeitung reported that the output was publicly visible and shareable, that Keller-Sutter learned of it the next day, and that the post was deleted shortly afterwards; watson reported that the user deleted his prompt and Grok's reply. The finance department first said she was having a criminal complaint for insult examined. Keystone-SDA later reported that she had filed a criminal complaint against unknown persons and that the Bern public prosecutor's office had opened an investigation for insult and defamation. Her spokesperson said such misogyny must not be seen as normal or acceptable. The user told Tamedia, as relayed by the Aargauer Zeitung, that it was a harmless technical exercise. No outcome of the investigation is reported.

Contextual tracker case Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 12/10/2026

Event date unknownItalyUnidentified image tool

Rimini: police report a minor to the juvenile prosecutor for allegedly making and spreading images, apparently created with AI, that attached a girl's face to a nude body and circulated in chats

The Squadra mobile of the Rimini police reported a minor to prosecutors, accused of making and spreading images manipulated with artificial intelligence. According to the Polizia di Stato, the investigation began after a report that images apparently created with AI were circulating in which a girl's face had been attached to a nude body without her knowledge. Corriere di Bologna reports that the minor was reported to the juvenile prosecutor's office in Bologna on 30 September 2026 for unlawful dissemination of AI-falsified content and child pornography, and that investigators say the image was sent to friends and acquaintances on WhatsApp. Neither the girl nor the accused is identified.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 02/10/2026

2 Jan 2026Event location unknownGrok

UK: Grok made sexualised images of a Welsh presenter and a broadcaster at users' requests; police closed both cases, then reopened the presenter's, TBIJ reports

The Bureau of Investigative Journalism (TBIJ) and The Observer reported on 29 September 2026 that police investigations into sexualised images generated by X's chatbot Grok had failed to identify anyone. A Welsh presenter and campaigner against deepfake abuse, who had criticised Grok publicly on New Year's Eve 2025, saw an anonymous X user ask '@grok' to put her in a bikini made of cling film; Grok generated the image from her profile photo and posted it. She reported it to South Wales Police on 2 January 2026, was not asked for a statement until March, and was told officers had not heard back from X; the case was closed in May with the force saying no suspect could be identified. The same account also targeted a commentator and broadcaster, who estimates about 300 Grok images and videos of her were posted during the wave, including one alongside Jeffrey Epstein reported to the Metropolitan Police, which likewise said no suspect could be identified. The presenter entered pre-action legal correspondence with xAI (part of SpaceXAI) alleging misuse of private information and breaches of data-protection law and the Equality Act. On 22 October 2026 TBIJ reported that South Wales Police had reopened her case after she filed a formal complaint in September and TBIJ gave officers new information about the requesting user, including a crypto wallet and dozens of deleted posts; the force said it was now investigating the offence under the sexual-offences legislation aimed at deepfakes, rather than malicious-communications law, including enquiries with X. TBIJ added that other users had edited images of her with the standalone Grok app and that she is starting civil legal action against the company. BBC Wales had reported in January 2026 that explicit images of the presenter were created with the chatbot and shared without her consent.

Core concern Medium reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 30/09/2026

19 Jun 2026 to 13 Aug 2026BrazilChatGPT

Brazilian man held 54 days without charge after OpenAI reported his ChatGPT messages to the FBI; police allege a threat, he denies intent

A man in Brazil was held in pre-trial detention for 54 days in 2026 after OpenAI’s safety systems flagged his ChatGPT conversations and the company reported them to the FBI, which alerted Brazilian police. Police say the messages described a threat to a family member; he denies that intent and his lawyer says he only talked nonsense to the chatbot. A court released him on 13 August under precautionary measures; no charges had been filed as of mid-September. OpenAI did not give police ChatGPT’s replies.

Core + contextual relations High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026

Mar 2025SingaporeUnidentified chatbot

Singapore Far-Right Teen Plot (AI Chatbot Ammunition Search)

Singapore's Internal Security Department (ISD) says a 17-year-old far-right extremist supporter, detained under the Internal Security Act in March 2025 after preparing shooting attacks on Muslims at mosques in Singapore, had searched for instructions on an AI chatbot about producing ammunition and considered 3D printing his own firearms. The chatbot is not named, and what it replied is not reported.

Core concern High reported severity Involving minors Regulatory Action

AI involvement reported · Causal attribution unclear · 3 sources, 1 underlying account · Added 22/01/2026

2 Feb 2023ItalyReplika

Replika Italy GDPR Ban and Fine

Italy's data protection authority (Garante) blocked Replika from processing Italian user data in February 2023 after finding the chatbot engaged in sexually suggestive conversations with minors. In May 2025, Replika was fined €5 million for GDPR violations.

AI relation under review High reported severity Involving minors Regulatory Action

Legacy assessment: verified · Causal attribution established · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.