Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
8
Countries with reported events
5
Located 6 of 8 cases · 2 unknown
Languages in checked sources
7
Recorded for 8 of 8 cases

2 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 2 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

8 of 868 published cases

Sept 2023AustraliaChatGPT

Victorian child protection worker put a family's information into ChatGPT to draft a court report that minimised risk to the child, regulator finds

Victoria's Information Commissioner (OVIC) found in a report published on 24 September 2024 that a child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT in or around September 2023 to draft a Protection Application Report submitted to the Children's Court about a young child. On the balance of probabilities, OVIC found the worker entered personal information, including names, about the child, mother, father and carer, disclosing it to OpenAI; the worker admitted using ChatGPT but denied entering personal information. OVIC found generated content in the report described a doll that the father had reportedly used for sexual purposes as a parental strength ('age-appropriate toys'), downplaying the risk to the child, although the court's and the department's decisions did not change. The report was withdrawn and replaced, and the mother, father and carer described anxiety when told of the disclosure. OVIC found serious breaches of two privacy principles and issued a compliance notice requiring DFFH to ban and block generative AI text tools for child protection staff until November 2026; DFFH accepted the breach findings.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

11 Oct 2026Event location unknownPangram AI-text detector

Caine Prize reviews its 2026 winning story after a Pangram AI-detector scan cited by The Atlantic flagged it as AI-generated; the author denies using AI

A week after a Zimbabwean writer won the £10,000 2026 Caine Prize for African Writing, The Atlantic published an article on Sunday 11 October 2026 whose central evidence was a scan by Pangram, an AI-text detection tool, flagging almost the entire winning story as AI-generated. The Caine Prize said it had begun a review: according to its chair, the author would send documentation of his drafts and the prize was talking to the judges and to the magazine that first published the story. The chair told the BBC that The Atlantic had published before a full investigation, tainting the prize and the winner, and said a detector should not be the final arbiter. The author denied using AI and said he had a documented history of the story's development; his literary agency said it was confident the story was his own work. No finding has been announced.

Contextual tracker case Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 2 sources · Added 14/10/2026

Sept 2026PakistanClaude (reported)

Karachi, Pakistan: teenager detained and released after Claude flagged his fiction-writing queries and the report reached the FBI, officials say

A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.

Core + contextual relations Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026

10 Mar 2026Event location unknownGrok

Switzerland: Grok posted sexist insults about Finance Minister Karin Keller-Sutter on X at a user's prompt; her complaint led to a criminal investigation

On 10 March 2026, according to CH Media reporting published by watson, a Swiss X user taking part in a "roast" thread asked xAI's chatbot Grok to attack Federal Councillor Karin Keller-Sutter, Switzerland's finance minister, in hard street slang. Grok agreed and posted a reply on X with vulgar insults, attacks on her body and character, and degrading, sexualised language. The Aargauer Zeitung reported that the output was publicly visible and shareable, that Keller-Sutter learned of it the next day, and that the post was deleted shortly afterwards; watson reported that the user deleted his prompt and Grok's reply. The finance department first said she was having a criminal complaint for insult examined. Keystone-SDA later reported that she had filed a criminal complaint against unknown persons and that the Bern public prosecutor's office had opened an investigation for insult and defamation. Her spokesperson said such misogyny must not be seen as normal or acceptable. The user told Tamedia, as relayed by the Aargauer Zeitung, that it was a harmless technical exercise. No outcome of the investigation is reported.

Contextual tracker case Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 12/10/2026

Dec 2024 to Sept 2026AustraliaUnidentified AI writing tool

Tasmania parole media ban quashed after state conceded reliance on likely AI-hallucinated case law

In December 2024 the Parole Board of Tasmania added a condition to the parole of Susan Neill-Fraser, released in 2022 after serving 13 years for murder and who maintains her innocence, barring her from communicating with media to claim innocence or wrongful conviction; a broader condition replaced it in May 2025. On 15 September 2026 the Supreme Court of Tasmania declared the conditions invalid. Her counsel told the court that the board's secretary had used artificial intelligence to prepare a rationale document justifying the condition and that it cited case law that did not exist. The Human Rights Law Centre, which represented her, says the State conceded that the board's decision-making was affected by a document containing legal authorities that were likely AI-generated hallucinations, and the ABC reports the court found the board relied on that document. The board had withdrawn the condition in August 2026. Tasmania's Attorney-General announced an independent investigation of the board's professional standards over its use of unverified AI, and the Justice Department announced a review of AI use in past parole decisions.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 6 sources, 4 underlying accounts · Added 06/10/2026

Nov 2025United StatesChatGPT

Prosecutor: judge used ChatGPT citations in Oklahoma custody order later vacated

In November 2025 Stephens County Associate District Judge Lawrence Wheeler issued an order in a child paternity and custody case that denied one parent's request for a psychological evaluation of the other parent and reprimanded the requesting parent's attorney 'for stooping to such frivolous trial tactics'. The attorney challenged the order at the Oklahoma Supreme Court in February 2026, telling the justices that it relied on two cases that do not exist; the challenge was dismissed in March after Wheeler vacated the order, and he is no longer on the case. According to a 17 August 2026 letter from the Stephens County district attorney, Wheeler told the Oklahoma State Bureau of Investigation that he used ChatGPT for research and wrote the order himself, and that at least two citations in it produced by ChatGPT do not exist. The mother in the case told News 9 that learning the order's citations were allegedly fabricated was alarming because it concerned the custody of a child. The attorney general's office declined criminal prosecution; judicial discipline remains possible.

Contextual tracker case Low reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026

24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system

Delhi: the police facial-recognition system logged at least 25 people who were in Tihar, Mandoli or Rohini jails as present at the Jantar Mantar student protests (20 to 26 July 2026), with timestamps on 24 to 26 July, on a sworn list of 2,873 persons with 'criminal antecedents' that the Supreme Court allowed police to register a fresh FIR against (Indian Express investigation, 4 September 2026)

In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026

19 Jun 2026 to 13 Aug 2026BrazilChatGPT and OpenAI moderation

Brazilian man detained without charge after OpenAI reported messages; he denies intending harm

BBC reporting describes a Brazilian man detained for 54 days after OpenAI reported messages to the FBI and Brazilian authorities. Police described a credible threat; he denied intending harm. A court released him without charges under protective conditions. The report did not include ChatGPT’s replies.

Core + contextual relations High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.