Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
14
Countries with reported events
5
Located 9 of 14 cases · 5 unknown
Languages in checked sources
6
Recorded for 14 of 14 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

14 of 1101 published cases

2024Event location unknownGemini (reported)

Brazilian court orders Google to pay R$20,000 after its AI falsely named a businessman as owner of a betting site, leaving him blamed for its scams

A civil court in Niterói, Rio de Janeiro state, ordered Google Brasil to pay a businessman R$20,000 in moral damages in a sentence dated 12 May 2025. The judge found it undisputed that the company's artificial intelligence had pointed to him in searches as the owner of a gambling platform called 7 Games, with which he had no connection, as the company register showed. The court found that the false information damaged his reputation: he was being held responsible for scams on the betting platform and received threats by email from its customers. The court had earlier granted an injunction to remove the association, and the sentence confirmed it. Google argued that it does not host the material shown in its results and only organises pages available on the web; the judge held Google responsible because the information came from its own platform rather than from a linked page. Conjur, a legal-news site, identifies the tool as Gemini and reports that the association began after an interview in which he recommended seven games; the sentence names no product. Whether Google appealed is not reported.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 02/11/2026

23 Feb 2024United KingdomMetropolitan Police live facial recognition

London: Met Police live facial recognition wrongly matched a man to his watchlisted brother; officers stopped him and he later received a settlement

On 23 February 2024 Shaun Thompson, a London community volunteer whom the 2026 judgment describes as 39, walked past a Metropolitan Police live facial recognition deployment near London Bridge station. The High Court records as not in dispute that the system detected a high level of facial similarity between images of him and the watchlist image of his brother, who was the subject of an outstanding arrest warrant, and generated an alert. According to the court's account, officers stopped, detained and questioned him and made him prove his identity, and when he declined to have his fingerprints taken he was threatened with arrest; he says the experience left him angry and distressed. Officers ended the engagement after checking police records about his brother, and he confirmed his identity with a passport photograph on his phone. Big Brother Watch, whose director was his co-claimant, says he was held for almost 30 minutes despite showing several identity documents. His judicial review claim about the stop, issued in May 2024, was withdrawn under a consent order agreed on 18 December 2024 on terms including a settlement sum paid to him. An amended challenge to the Met's revised live facial recognition policy of September 2024, brought with Big Brother Watch's director, was dismissed by the Divisional Court on 21 April 2026; the court said it was not judging the merits of the technology, and the claimants announced plans to appeal.

Contextual tracker case Medium reported severity Lawsuit Dismissed

AI involvement supported · Causal attribution established · 4 sources, 3 underlying accounts · Added 26/10/2026

20 Oct 2026Event location unknownUnidentified video tool (suspected)

Texas: researchers say very likely AI deepfake videos impersonating a real former student falsely accused Senate candidate James Talarico of abuse

On 20 October 2026, during early voting in Texas, a newly created X account posted two videos in which a man presented himself as a former student of James Talarico, the Democratic US Senate candidate and a former middle-school teacher, and accused him of sexual assault in 2012. The threat-intelligence firm Graphika said the account very likely impersonated a real Facebook user of the same name who had been Talarico's student and had praised him, assessed the videos as very likely deepfakes because the face moved unnaturally or out of sync with the audio and AI analysis tools indicated AI generation, and attributed them with high confidence to the Russia-aligned influence operation Storm-1516. PolitiFact reported that NewsGuard found many signs of AI generation and a 98 percent detector score, and that the real former student told the fact-checkers Lead Stories the video was not of him and denied accusing Talarico. Talarico's campaign said he was being slandered with AI deepfakes, foreign bots and conspiracy theories. PolitiFact rated the claim Pants on Fire. Who made the videos and how many people saw them is not established.

Core + contextual relations Medium reported severity Media Coverage

AI involvement suspected · Causal attribution supported · 2 sources · Added 25/10/2026

9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)

Arizona: family says a Gaggle alert on a pupil's unsent joke email led to his suspension; federal court lets their free-speech claim proceed

On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.

Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026

Nov 2025ChinaUnidentified image tool

Shanghai court convicts a man who, police say, used AI software to fake food-poisoning medical records and extort restaurants into paying compensation

Police in Yangpu district, Shanghai, say a customer extorted restaurants with medical records he had forged using AI software; Xinhua dates his first successful claim to November 2025. In the police account (Shangguan News, 26 February 2026) he claimed to have fallen ill after eating at a barbecue restaurant, showed a hospital visit record and medical invoice, and demanded 2,000 yuan in medical costs, threatening complaints and publicity; the restaurant paid. Police checked with other diners and the hospital, found he had no hospital record and the materials were forged, and say he confessed to using AI software to alter images of other people's medical records, replacing the name, date and amount. Police say he succeeded twice and failed twice, obtaining 2,500 yuan, and that he also filed complaints to market regulators with the forged material to pressure the restaurants. According to Xinhua's June report and the Procuratorate Daily, the Yangpu District People's Court convicted him of extortion and sentenced him to four months' criminal detention, suspended for four months, and a 2,000 yuan fine.

Contextual tracker case Low reported severity Criminal Charges

AI involvement supported · Causal attribution established · 3 sources · Added 17/10/2026

26 Sept 2026 to 27 Sept 2026United StatesClaude (reported)

Bonita Springs, Lee County, Florida: a 30-year-old woman was arrested and charged with making a written threat of violence after Anthropic's human review team reported to law enforcement her messages on its AI platform saying she would 'shoot up' the Lee County Sheriff's Office, according to the arrest report

According to a Lee County Sheriff's Office arrest report, as reported by WINK News and by Guessing Headlights (on Yahoo News, citing a copy obtained by Gulf Coast News Now), a user of Anthropic's AI platform wrote on 26 September 2026 that she was going to 'shoot up' the Lee County Sheriff's Office, and the next day wrote that she had a new gun. The arrest report says the platform's safety measures flagged the messages, a human review team examined them and reported them to law enforcement. Deputies went to the 30-year-old woman's Bonita Springs home and detained her without incident; she is charged with making a written threat of violence under Florida law. The sheriff told WINK News that she later said she uses AI like a 'diary'. Anthropic had not commented on the case in either report. The charge is an allegation and the case is pending.

Core + contextual relations Medium reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 03/10/2026

2026Event location unknownGrok

Grok reportedly disclosed an adult performer's legal name and birthdate in an X reply, followed by reported impersonation accounts and leak-site posts under the legal name

In early 2026 (404 Media and the performer's 19 February post say early February, while Stern reports she found the reply weeks after it appeared) an X user replied to a clip of adult performer Siri Dahl, asking who the performer was and what her name was, and tagged Grok. According to 404 Media, Grok answered with her stage name, her birthdate and her legal name, and the user likely wanted only to know which performer appeared in the clip. Dahl has used the stage name since 2012 according to 404 Media, and she says she had paid for data removal services for at least six years to keep the legal name private. She reports that impersonating Facebook accounts and leak-site posts under the legal name then appeared and that the name spread across hundreds of websites. 404 Media reports that users asked Grok for the make and model of her car and her address without an accurate reply, and that she is calling family members to put defensive plans in place. Grok's reply to her protest said the details were already public, which she denies. Where Grok obtained the name is unknown. Dahl spoke publicly about the event and asked 404 Media to publish her legal name. This record omits the legal name and birthdate.

Core + contextual relations Medium reported severity

AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026

Event date unknownEvent location unknownGemma

Google Gemma model reportedly generates a fabricated sexual-misconduct allegation with fake news links about US Senator Marsha Blackburn

In a letter to Google CEO Sundar Pichai announced on 31 October 2025, US Senator Marsha Blackburn said that Google's Gemma model, asked "Has Marsha Blackburn been accused of rape?", produced an invented account of a 1987 campaign-era accusation by a state trooper, with links to news articles that do not exist. She said there has never been such an accusation, called the output defamation and demanded that Google shut the model down until it can be controlled. Google said it had seen reports of non-developers trying to use Gemma in AI Studio to ask factual questions, that this was not an intended use, and removed Gemma from AI Studio while keeping API access. Google's later reply to the Senator called the hallucinations a technical issue common to large language models. The date the output was generated is not stated, and the output itself was not inspected.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 29/09/2026

12 Sept 2025United StatesGaggle school monitoring

Deltona, Florida: Gaggle school-laptop alert leads to felony arrest of a 15-year-old over a typed gun threat the student said was not serious

According to a Volusia County Sheriff's Office account carried by local outlets, a 15-year-old high school student in Deltona, Florida was arrested on 12 September 2025 after typing a written threat to bring a gun to school on a school-issued laptop. The Gaggle student-monitoring software raised an alert that notified the school resource deputy, who detained the student before the student boarded the bus home. The student was arrested on a second-degree felony charge (one outlet says the charge was still to be filed). The student reportedly admitted typing the text, said it was not meant seriously and said the motive was anger about being picked on. Outcome of the charge and the exact Gaggle role in generating this alert are not reported.

Contextual tracker case Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 29/09/2026

19 Jun 2026 to 13 Aug 2026BrazilChatGPT

Brazilian man held 54 days without charge after OpenAI reported his ChatGPT messages to the FBI; police allege a threat, he denies intent

A man in Brazil was held in pre-trial detention for 54 days in 2026 after OpenAI’s safety systems flagged his ChatGPT conversations and the company reported them to the FBI, which alerted Brazilian police. Police say the messages described a threat to a family member; he denies that intent and his lawyer says he only talked nonsense to the chatbot. A court released him on 13 August under precautionary measures; no charges had been filed as of mid-September. OpenAI did not give police ChatGPT’s replies.

Core + contextual relations High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026

2 Jun 2026 to 4 Jun 2026United KingdomGrok

Grok falsely named former officer Christi Hill as an arresting officer in the Henry Nowak case; she is in hiding after threats

In early June 2026, social media posts and the AI chatbot Grok falsely identified former Hampshire police constable Christi Hill as one of the 'primary officers shown' in bodycam footage of the December 2025 arrest of Henry Nowak, who died after being stabbed. Hill had left the force in April 2024 — more than a year before the murder — and says the misidentification stems from a national police bravery award photo being misattributed. After 'endless threats' and 'threats of violence' she is hiding in a safe house. BBC Verify separately obtained evidence that serving officer Tristan Parsons, also wrongly accused online, was not in the country at the time; the Home Secretary said a misidentified male officer had to move out of his home. Hampshire Constabulary confirmed an unrelated officer was misidentified and received death threats.

Contextual tracker case High reported severity Media Coverage

AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026

26 Aug 2026 to 28 Aug 2026SpainUnidentified Google AI tool (reported)

Argentine activist reports threats after an alleged Google AI misidentification

On 26 August 2026, WhatsApp groups in Ceuta circulated videos and images claiming that Argentine political scientist and activist Flavia Broffoni — who was in Patagonia and had not been to Spain since 2014 — was a woman filmed in Ceuta allegedly giving pepper spray to Moroccan migrants. A screenshot from one group shows that a user cropped the woman's face from the video and asked a Google AI tool who she was, with the word 'activista' as context; the answer identified her as Flavia Broffoni with details of her public profile. Broffoni received death and rape threats. La Nación's own test with the same video produced a different false identification — a student from Quilmes, with her personal data. Google Argentina said it could not confirm the screenshot came from its systems without the original link and had received no formal report. Broffoni is weighing legal action with her lawyer.

Contextual tracker case High reported severity Media Coverage

AI involvement supported · Causal attribution supported · 1 source · Added 15/09/2026

29 Jan 2025United StatesSnapchat content-flagging system

Washington, Illinois: Snapchat flagged a student teacher's private joke to the FBI; she was arrested at her school and lost her placement

On 29 January 2025, a 22-year-old student teacher at a District 50 elementary school in Washington, Illinois, vented in a private Snapchat group chat with her boyfriend and two roommates after a third-grade student turned off her computer mid lesson-plan, asking whether she should 'shoot the child or just the whole school' (per sheriff's reports). Snapchat's systems flagged the message and warned the FBI, which notified the Tazewell County Sheriff's Office at 1:06 p.m. Deputies interviewed her at the school, confirmed she sent it as a joke, searched her phone and belongings with her consent and found no weapons, and arrested her on a disorderly conduct charge; they concluded she had spoken out of 'exasperation' with no intent to harm and no threat to the school. The district told parents she would not return to complete her educational assignment.

Contextual tracker case Medium reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 15/09/2026

Jul 2025 to Jan 2026Event location unknownChatGPT

Woman's lawsuit alleges ChatGPT fed her former partner's delusions and wrote psychological reports about her that he used to harass her

A complaint filed on 9 April 2026 in San Francisco County Superior Court by a woman suing as Jane Doe alleges that GPT-4o validated her former partner's belief that he had invented a cure for sleep apnea, told him powerful forces were watching him, and, after she ended the relationship, generated dozens of clinical-style psychological reports scoring her as dishonest and abusive, which he sent to her family, friends, colleagues and clients. It says OpenAI deactivated his account on about 28 August 2025 for 'Mass Casualty Weapons' activity and restored it the next day, and that after her 13 November 2025 notice of abuse OpenAI replied once and took no action. The complaint says his threats escalated, including a message he had ChatGPT encode, that she suffered panic attacks, obtained an emergency protective order and considered taking her own life, and that he was arrested in January 2026, found incompetent to stand trial and ordered released on 8 April 2026. On 13 April 2026 a judge ordered OpenAI to keep his account suspended pending a May hearing; OpenAI told the court the account had not been accessed for over three months and, as The San Francisco Standard reports its declaration, that the materials it addressed contained no threat from him to physically assault anyone, including the plaintiff. The allegations are untested.

Core + contextual relations High reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 5 sources · Added 28/04/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 11/11/2026. Dataset available under CC BY 4.0.