Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
8
Countries with reported events
4
Located 6 of 8 cases · 2 unknown
Languages in checked sources
5
Recorded for 8 of 8 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

8 of 1029 published cases

2026IsraelChatGPT (reported)

Mother tells Ynet she waited two days after ChatGPT, while advising a check, said it was relatively rare; her teenage son lost a testicle

Ynetnews reported on 12 April 2026 that doctors at Meir Medical Center had seen three teenage boys lose a testicle in the past month after arriving too late for treatment of testicular torsion. The mother of one of them told Ynet that when her son complained of lower abdominal pain she thought it might be constipation and consulted ChatGPT, which gave several options, said it could be something serious and that they should get it checked, but also said it was relatively rare, so they thought they could wait. After two days without improvement the boy's testicle was swollen and he could hardly walk; an urgent care clinic sent them to hospital and ChatGPT, consulted again, told them to go to the emergency room immediately. At the hospital, late at night, doctors diagnosed severe torsion, operated and removed the testicle; the boy is recovering at home. The doctors attribute the month's unusually high rate of complications mainly to delayed arrival at the emergency room, which they say the war has partly influenced.

Contextual tracker case High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 16/10/2026

31 Jan 2025 to 12 Dec 2025United StatesUnidentified AI drafting tool

Oregon federal court dismisses family plaintiffs' claims and fines their lawyer after briefs cited 15 nonexistent cases it attributes to generative AI misuse

On 12 December 2025 the U.S. District Court for the District of Oregon dismissed with prejudice the claims of plaintiffs in a family dispute over their late mother's estate and family property, as a sanction for what the court called their misuse of generative artificial intelligence, and found their continual violations of the court's Local Rules an additional basis for the dismissal. Three of the plaintiffs' summary-judgment briefs cited fifteen nonexistent cases and fabricated quotations attributed to eight real authorities. The plaintiffs had said the inaccurate citations came from reliance on an automated legal citation tool. The court found that the plaintiffs shared responsibility with their lead lawyer and that one plaintiff, a frequent self-represented litigant, was likely the person who used AI to draft the briefs. It struck the briefs, ordered the lead lawyer to pay $15,500 to the court and awarded the defendants their fees. In March 2026 it set those fees at $94,704.38, ordering the lead lawyer to pay 85% and local counsel 15%. In June 2026 it denied the plaintiffs' motion to reconsider a later ruling for the defendants on a counterclaim.

Core + contextual relations Medium reported severity Lawsuit Dismissed

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 15/10/2026

Sept 2026PakistanClaude (reported)

Karachi, Pakistan: teenager detained and released after Claude flagged his fiction-writing queries and the report reached the FBI, officials say

A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.

Core + contextual relations Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026

11 Apr 2026 to 11 Oct 2026Event location unknownChatGPT

Adult ChatGPT Plus subscriber says the account was classified as a teen and restricted, and that OpenAI said profiling had to come first; first-person post

In a Reddit post of 11 October 2026, a ChatGPT Plus subscriber who says they are an adult (36, by the post's own account) writes that when OpenAI's age checks rolled out their account was classified as a teen account and put on a restricted account. The poster says they had earlier emailed OpenAI asking for verification options without ID or a photo, received a canned reply about the verification provider Persona, and on escalating to data protection was told they had to be profiled first. The poster says they then cancelled the subscription. OpenAI's Help Center says ChatGPT uses an age prediction system that reads account signals, automatically enables the teen experience when it predicts an account may belong to someone under 18, can get this wrong, and lets adults verify their age to remove it. The account is the poster's own and is not corroborated.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources · Added 11/10/2026

21 Sept 2026 to 25 Sept 2026FrancePangram AI-text detector

Académie Goncourt drops Thélyson Orélien's novel as likely AI-generated after Pangram claims; his publisher later says it found AI traces and ends ties

On 21 September 2026 an anonymous X account, Balance ton Claude, said it had run excerpts of Thélyson Orélien's debut novel C'était ça ou mourir through the American AI-detection software Pangram, with some passages scoring up to 100 per cent probability of AI generation. On 25 September the Académie Goncourt removed the novel from the first selection of sixteen books for its 2026 prize, stating that the work is 'in all likelihood very largely the product of an artificial intelligence', based on 'the convergent result of several analyses by researchers and journalists', and also citing plagiarism in older texts by the author published in Canada (at least one short story and articles), which do not concern the novel. Orélien, a 38-year-old Canadian-Haitian writer whose novel had won the Fnac novel prize, denies using AI and says its repetitions and certain rhythms reflect his linguistic and cultural world and may be misread by automated tools. His Montreal publisher Boréal suspended promotional activities, saying it could neither confirm nor refute the allegations. Essayist Samuel Fitoussi said he was one of the people behind the account. AI-detector reliability is contested in the coverage. In October the author acknowledged plagiarism in some of his earlier work while maintaining that no sentence of the novel was generated by a machine. On 17 October 2026 The Canadian Press, published by CBC, reported that Boréal confirmed he had ended an effort to compile evidence of how the novel was written; Boréal said at that point it would keep selling the book, that sales had slowed since the controversy began, and that it could not verify how the novel was written before it received the manuscript on 12 September 2025. A major Quebec bookstore chain reported no significant change in sales. On 21 October 2026 Boréal announced that it was ending its professional relationship with him and would not reprint the novel or publish any further books by him. It said an external analysis it commissioned of all working versions of the novel revealed traces of AI markers in the metadata of certain documents, and that it does not know to what extent AI was used. In a statement the previous week Orélien had said he used AI tools 'here and there' for research but that the text, structure and plot were his own.

Contextual tracker case Medium reported severity Internal Action

AI involvement reported · Causal attribution disputed · 7 sources, 3 underlying accounts · Added 28/09/2026

14 Aug 2021 to 14 Mar 2024United StatesSt. Louis mugshot recognition (SMRT)

St. Louis County, Missouri: Christopher Gatlin was arrested in August 2021 after officers ran a grainy bus surveillance photo through a regional facial-recognition system and was held roughly 17 months (Post-Dispatch and Bloomberg Law: about two years) on a first-degree assault charge dismissed in March 2024; his federal civil-rights suit (filed January 2025) was amended in August 2026 to add Amazon Web Services, whose Rekognition technology the complaint says underpinned the match

Christopher Gatlin was arrested on 14 August 2021 for an assault at the St. Charles Rock Road MetroLink station after a joint St. Louis County and city team uploaded a grainy, blurry surveillance photograph from a bus into the St. Louis Mugshot Recognition Technology System, a facial-recognition tool that searches stored mug shots (more than 500,000 uploaded, the suit says per the Post-Dispatch; more than 250,000 per Biometric Update via Hoodline), and built the investigation around the resulting match together with a witness identification; he was charged with first-degree assault and held roughly 17 months (the Post-Dispatch says almost two years), a county judge suppressed the witness identification as unconstitutionally suggestive, and prosecutors dismissed the charges on 14 March 2024 (Post-Dispatch; Hoodline citing Biometric Update; Bloomberg Law). Gatlin sued St. Louis County, the City of St. Louis and named officers in the US District Court for the Eastern District of Missouri on 13 January 2025; on 15 October 2025 the court denied the city's motion to dismiss and granted a detective's motion only as to one count; on 13 August 2026 the court allowed a second amended complaint adding Amazon Web Services, which the complaint says supplied the Rekognition program the system used; the county, city and officers answered on 27 August 2026, AWS's response was extended to 21 September 2026 and on 17 September it moved for a further extension to 28 September (no ruling on the docket when read), and a jury trial is set for 1 November 2027 (CourtListener docket). Amazon told the Post-Dispatch that its terms of service prohibit the use of its facial recognition technology in criminal investigations and that it would fully investigate any information that emerges in the litigation. The ACLU lists Gatlin among fourteen people known to have been wrongfully arrested in the US because police relied on erroneous facial-recognition results.

Contextual tracker case High reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources · Added 26/09/2026

Event date unknownEvent location unknownChatGPT

A Norwegian child-safety organisation reports that ChatGPT's behaviour-based age estimation switched an adult staff member's account into teen mode without a request, restricting content and offering an identity check through a third-party verifier as the way out (Barnevakten, 23 September 2026)

Barnevakten, a Norwegian child-safety organisation, reported on 23 September 2026 that one of its staff members was suddenly told by ChatGPT that their account was now in teen mode. ChatGPT's own pages, as described by Barnevakten, say the system turns the filter on when a user's behaviour indicates an age under 18, reducing sensitive or potentially harmful content (graphic violence, viral challenges, sexual or violent role-play, extreme beauty ideals) and offering parental controls and a study mode. Because there is no age check at sign-up, the system estimates age afterwards from conversation topics and times of use, and Barnevakten notes that such guesses can be wrong. An adult who wants out of teen mode can go through an age check run by the company Persona, which depending on the country asks for a real-time selfie and a government ID; Barnevakten questions whether that process is privacy-safe (Persona's terms mention retention of up to three years) and advises using only age checks one trusts. The account's own experience is limited to the unexpected switch and the verification route; no further consequence is described.

Core + contextual relations Low reported severity Media Coverage

AI involvement supported · Causal attribution supported · 1 source · Added 24/09/2026

16 May 2026United StatesGemini (reported)

Boca Raton father says a Lyft driver's damage-fee photo was AI-generated; Lyft says it offered reimbursement and removed the driver

A Boca Raton, Florida father told WPBF, WPTV and ABC News that after his teenage daughters took a Lyft home from the beach (on Saturday 16 May 2026, according to ABC News), he was charged a $75 damage fee because the driver reported that the riders had left a mess. Lyft customer service told him the driver had sent pictures. One daughter pointed out a Gemini logo in the corner of the photo, which the family took as showing it was AI-generated. The father says Lyft then agreed, apologised and blocked the driver. Lyft's statements say it reviewed the rider's concerns, offered reimbursement and, per its later statements, permanently removed the driver; they do not say the photo was AI-generated.

Contextual tracker case Low reported severity Involving minors Internal Action

AI involvement reported · Causal attribution alleged · 3 sources · Added 17/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/10/2026. Dataset available under CC BY 4.0.