Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
5
Countries with reported events
4
Located 4 of 5 cases · 1 unknown
Languages in checked sources
3
Recorded for 5 of 5 cases

1 case has no reviewed AI-to-person relation yet: 1 not yet reviewed and 0 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMedium
More filters: AI relation, use, setting, sources and responses
Clear filters

5 of 1101 published cases

1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT

New York federal judge sanctions two lawyers whose brief cited cases ChatGPT invented, after the chatbot told one of them the cases were real (2023)

In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.

Core + contextual relations Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026

May 2023United StatesChatGPT

Colorado lawyer suspended for a year and a day, 90 days served, after filing a motion with fictitious ChatGPT case citations and blaming an intern

A Colorado lawyer who had recently moved into civil litigation used ChatGPT in April and May 2023 to find case law for a client's motion to set aside a judgment and cited three Colorado Court of Appeals decisions that did not exist, without reading or checking them. On the morning of the 5 May hearing he realised the cases were fabricated but did not tell the court or withdraw the motion, and when the judge raised concerns he falsely blamed a legal intern; six days later he filed an affidavit saying he had used ChatGPT. The judge denied the motion, said the denial did not rest on the invented cases, and ordered him to show cause why he should not be sanctioned and reported to attorney regulators. On 22 November 2023 Colorado's Presiding Disciplinary Judge approved a stipulation suspending him for one year and one day, with 90 days served and the rest stayed on two years' probation, for violating rules on competence, diligence, candour to the tribunal and honesty.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 26/10/2026

27 Oct 2023BrazilUnidentified image tool

Rio de Janeiro: private school tells parents pupils used AI to make fake nude images of girls; police open inquiry with at least 20 victims

In late October 2023, fake nude images of girls at a private school in Rio de Janeiro circulated in messaging groups and on social media. Families said pupils in years 7 to 9 had used an artificial intelligence tool to put the faces of pupils aged 14 to 16 onto photos of naked bodies. The school sent parents a notice about pupils using AI to make intimate photo montages and said disciplinary measures would follow. The Rio de Janeiro Civil Police child-protection unit (DPCA) opened an inquiry; its head said the pupils were suspected of making fake nudes with AI and that more than 20 victims had been identified, including girls from other schools. A mother said the girls were having anxiety attacks and crying. The inquiry was placed under seal because minors were involved; its outcome is not known.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources · Added 22/10/2026

Sept 2023AustraliaChatGPT

Victorian child protection worker put a family's information into ChatGPT to draft a court report that minimised risk to the child, regulator finds

Victoria's Information Commissioner (OVIC) found in a report published on 24 September 2024 that a child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT in or around September 2023 to draft a Protection Application Report submitted to the Children's Court about a young child. On the balance of probabilities, OVIC found the worker entered personal information, including names, about the child, mother, father and carer, disclosing it to OpenAI; the worker admitted using ChatGPT but denied entering personal information. OVIC found generated content in the report described a doll that the father had reportedly used for sexual purposes as a parental strength ('age-appropriate toys'), downplaying the risk to the child, although the court's and the department's decisions did not change. The report was withdrawn and replaced, and the mother, father and carer described anxiety when told of the disclosure. OVIC found serious breaches of two privacy principles and issued a compliance notice requiring DFFH to ban and block generative AI text tools for child protection staff until November 2026; DFFH accepted the breach findings.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

2 Feb 2023ItalyReplika

Replika Italy GDPR Ban and Fine

Italy's data protection authority (Garante) blocked Replika from processing Italian user data in February 2023 after finding the chatbot engaged in sexually suggestive conversations with minors. In May 2025, Replika was fined €5 million for GDPR violations.

AI relation under review High reported severity Involving minors Regulatory Action

Legacy assessment: verified · Causal attribution established · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 11/11/2026. Dataset available under CC BY 4.0.