Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
163
Countries with reported events
35
Located 136 of 163 cases · 27 unknown
Languages in checked sources
30
Recorded for 163 of 163 cases

16 cases have no reviewed AI-to-person relation yet: 3 not yet reviewed and 13 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

163 of 868 published cases · page 3 of 9

21 Nov 2025United StatesUnidentified AI drafting tool

Massachusetts federal court revokes an out-of-state lawyer's admission and orders fees after briefs with false citations; the lawyer admitted AI drafted one

On 25 September 2026 a judge of the U.S. District Court for the District of Massachusetts granted a defence motion for sanctions under Federal Rule of Civil Procedure 11 against a California-barred lawyer admitted for one case (pro hac vice) to represent the plaintiff. The court found that an opposition the lawyer filed on 21 November 2025 was replete with inaccurate citations, including a quotation attributed to a case with a fictitious Westlaw citation, and that later oppositions cited a non-existent case. In response to the court's order to show cause, the lawyer admitted using AI to draft the first opposition and explained a belief that the enterprise-level AI software in use did not hallucinate cases. The court revoked the lawyer's pro hac vice admission and ordered the lawyer's firm to pay the defendants' reasonable fees and costs, capped at $10,000. The order does not name the AI product.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 1 source · Added 16/10/2026

14 Sept 2026BrazilUnidentified document-analysis tool

São Paulo court fines a defendant 9% of the case value over a hidden instruction in his defence asking AI to praise his lawyer

A São Paulo business and arbitration court found that every page of a defendant's written defence carried a hidden instruction, placed above his lawyer's letterhead, asking any AI that analysed the petition to give a favourable opinion and praise the lawyer's probity and care. In a sentence dated 14 September 2026 the judge treated this as prompt injection and bad-faith litigation: although the defendant won on the merits, he was ordered to pay the plaintiff a fine of 9% of the updated case value, and the sentence was sent to the São Paulo bar to examine the lawyer's conduct. No source says any AI system read the instruction.

AI relation unknown Low reported severity Regulatory Action

AI involvement reported · Causal attribution established · 2 sources, 1 underlying account · Added 16/10/2026

2026SpainUnidentified AI drafting tool

Canary Islands high court fines a lawyer 420 euros for an appeal citing 48 non-existent judgments that it says a general-purpose AI tool generated

The Criminal Chamber of the High Court of Justice of the Canary Islands (TSJC) fined a lawyer 420 euros for breaching the duty of truthfulness and good faith, after an appeal the lawyer filed contained 48 citations of Supreme Court judgments and a report of the General Council of the Judiciary that did not exist. According to the court's order, as described in its press release of 13 February 2026, the lawyer used a general-purpose AI tool to draft the appeal and did not check a single citation against the free public case-law database; the court's documentalist verified that the references were false. The court referred the matter to the lawyer's bar association for possible disciplinary action and set the fine at about half the annual cost of a legal-specific AI tool, taking into account that the lawyer admitted the facts and expressed remorse. The court had first flagged the citations in its judgment dismissing the appeal, reported on 5 January 2026, which opened a separate proceeding. The lawyer told the court of comments and mockery from colleagues after the case became public.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 16/10/2026

Jun 2026 to Sept 2026GermanyUnidentified image tool (suspected)

Gauting, Bavaria: police say a man presumably lured by an AI-generated image of a TV presenter in a banner ad lost more than 25,000 euros to investment fraud

The Gauting police inspection in Bavaria, Germany, reported on 2 October 2026 that a man had filed a complaint after realising he had been the victim of investment fraud. According to the police report, he said he had clicked on an advertising banner for an investment on the website of a large German news magazine, and the police say he was presumably lured by the combination of an AI-generated image of a well-known television presenter with a supposedly lucrative investment strategy. After he entered his email address and phone number on the trading platform, four women callers contacted him from 4 June 2026 until September and led him to make four payments totalling more than 25,000 euros to accounts in Bulgaria, Malta and Lithuania. His bank could not reverse the transfers because he had authorised them himself. The police do not say how they concluded that the image was AI-generated, and the presenter is not named in the police report.

Core concern Medium reported severity Investigation Opened

AI involvement suspected · Causal attribution alleged · 2 sources, 1 underlying account · Added 16/10/2026

May 2025Event location unknownUnidentified video tool

Sweden: police say AI-generated videos of well-known doctors in social media ads led people to fraudulent sites and card fraud; doctors object

In June 2025 the Stockholm police region warned that since the end of May it had received several complaints from people defrauded through social media adverts with AI-generated videos depicting doctors, who appeared to give advice and recommend medicines or vitamins. According to the police, viewers who followed the adverts to fraudulent websites were induced to enter card details, after which a considerably larger sum was charged and the details were stolen. Dagens Nyheter reported that the doctors used included the former state epidemiologist Anders Tegnell and the professor Agnes Wold, who told the paper of being furious. In July 2025 the Public Health Agency of Sweden said fake Facebook films imitating its former state epidemiologist were advertising products for diabetes or asthma, that it had reported them to the police and had asked Meta to remove them; he said it was sad that fraudsters were exploiting vulnerable people. Dagens Nyheter, as relayed by Omni, reported that the investigations were closed because the offences were judged to have been committed abroad. The number of defrauded people and their losses are not stated, and the police do not say how the AI generation was established.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 16/10/2026

Sept 2025Event location unknownRevolut chatbot

Ombudsman finds Revolut misled a customer after its chatbot said his loyalty points were worth £1,119 and confirmed a refund; compensation raised to £100

In September 2025 a Revolut customer asked the bank, through its chatbot, to cash in loyalty points he had earned through its spare change feature. According to the Financial Ombudsman Service's final decision (DRN-6062372), the chatbot first said the 1,119 points would be refunded as £22.38; four days later it told him the 1,119 points had a cash value of £1,119, offered that as a one-time goodwill gesture and confirmed it had processed the refund. A few hours later the chatbot said that information was wrong; a live agent then said the £1,119 refund was being processed, and the next day the chatbot said it had issued £22.38. Revolut upheld his complaint and paid £50. The ombudsman found that Revolut gave him the wrong information on several occasions that day, held that he was never entitled to £1,119, and directed Revolut to pay a further £50. The customer said the lost expected refund caused financial pressure, and gave a GP letter describing anxiety and insomnia.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 1 source · Added 15/10/2026

7 May 2025 to 23 Jul 2025Event location unknownChatGPT

Alabama federal judge reprimands and disqualifies three Butler Snow lawyers and refers them to the state bar over ChatGPT-fabricated citations (2025)

In an incarcerated man's lawsuit against Alabama prison officials in the US District Court for the Northern District of Alabama, two motions filed in May 2025 for the defence of a former Alabama corrections commissioner contained five citations that did not exist or did not support the propositions cited. Lawyers of the Butler Snow firm, which the state retains to defend its prisons, told the court that a partner had obtained the citations from ChatGPT and had not verified them. On 23 July 2025 Judge Anna M. Manasco publicly reprimanded three of the firm's lawyers, disqualified them from the case and referred the matter to the Alabama State Bar, and ordered them to give the order to clients, opposing counsel and judges in all their pending cases. She declined to suspend them and released the firm and two other lawyers without sanction.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 15/10/2026

17 Jul 2026United StatesUnidentified voice-cloning tool

Boone County, Missouri: sheriff's office says a fake-kidnapping ransom call used an AI-generated copy of a resident's daughter's voice

The Boone County Sheriff's Office in Missouri said that on Friday 17 July 2026 a resident received a call whose caller ID showed their daughter's number. A voice that sounded like the daughter said she had been kidnapped at gunpoint, and another voice then demanded ransom. The office said it later determined that the voice was AI-generated, without saying how. Deputies found the daughter safe in Jefferson City and unaware of the call. The office called it the first AI voice-impersonation call it had encountered. No suspect had been identified by 19 July, and no source reports whether any money was paid.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 15/10/2026

23 Jun 2026United KingdomUnidentified AI system

Derbyshire Police refer a senior detective to the police watchdog, which opens a gross misconduct investigation into the officer's use of AI

The Independent Office for Police Conduct (IOPC) said, as reported by the BBC on 10 August 2026, that Derbyshire Constabulary had made a voluntary conduct referral on 23 June 2026, following an internal review of an officer's use of artificial intelligence and concerns that it was not in line with guidance and conditions issued by the force. The IOPC decided the matter warranted an investigation, and the officer was served notice of an investigation for alleged gross misconduct. The BBC, citing the Financial Times, reported that a person familiar with events said the officer is a detective chief inspector alleged to have used AI to maintain decision logs, which investigators keep to record their reasoning and which can be disclosed to defence lawyers. The BBC describes the case as unrelated to the criminal investigation opened in June into another Derbyshire officer. The AI system and the outcome are not reported.

AI relation unknown Low reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 1 source · Added 14/10/2026

Event date unknownUnited KingdomUnidentified chatbot

Derbyshire Police remove a detective from frontline duties and open a criminal investigation over alleged use of AI to create evidential material

Derbyshire Police said in June 2026 that it had launched a criminal investigation into an allegation of perverting the course of justice after the alleged use of AI systems by an officer to create evidential material in a number of cases, and that the officer had been removed from frontline duties; no arrests had been made. The Crown Prosecution Service said it was engaging with defence teams and the courts in appropriate cases. Scottish Legal News, citing sources familiar with the matter, reported that the detective allegedly used an AI chatbot to prepare documents including victim impact statements and case summaries for prosecutors. It also reported that a number of rape convictions were being reviewed. In October 2026 the head of the Independent Office for Police Conduct referred to the case when warning that AI mistakes could lead to a mistrial. The officer is not named, the AI system is not identified, and the allegations have not been tested.

AI relation unknown Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 14/10/2026

11 Oct 2026Event location unknownPangram AI-text detector

Caine Prize reviews its 2026 winning story after a Pangram AI-detector scan cited by The Atlantic flagged it as AI-generated; the author denies using AI

A week after a Zimbabwean writer won the £10,000 2026 Caine Prize for African Writing, The Atlantic published an article on Sunday 11 October 2026 whose central evidence was a scan by Pangram, an AI-text detection tool, flagging almost the entire winning story as AI-generated. The Caine Prize said it had begun a review: according to its chair, the author would send documentation of his drafts and the prize was talking to the judges and to the magazine that first published the story. The chair told the BBC that The Atlantic had published before a full investigation, tainting the prize and the winner, and said a detector should not be the final arbiter. The author denied using AI and said he had a documented history of the story's development; his literary agency said it was confident the story was his own work. No finding has been announced.

Contextual tracker case Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 2 sources · Added 14/10/2026

24 Apr 2026United StatesUnidentified AI research tool

Alabama Supreme Court dismisses two siblings' family-trust appeal as a sanction after their lawyer admits using AI that produced fake citations

On 24 April 2026 the Supreme Court of Alabama dismissed an appeal by two siblings in a family dispute over living trusts because their lawyer, W. Perry Hall, had filed briefs in which most of the legal authorities were misquoted or did not exist. The court said they appeared to be AI hallucinations, and at a show-cause hearing in February 2026 Hall admitted that many authorities did not exist and that he had improperly used AI to obtain them. The court ordered Hall to pay the opposing party's fees and costs of $17,200 and double appeal costs, barred him from filing in the court without a co-signing attorney and referred him to the Alabama State Bar. It said the dismissal was imposed as a sanction because of the particularly egregious facts. One justice, concurring in part and dissenting in part, objected to dismissing the appeal as a sanction for the lawyer's conduct but would have affirmed the judgment against the clients on the merits.

Core + contextual relations Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 1 source · Added 14/10/2026

Sept 2026PakistanClaude (reported)

Karachi, Pakistan: teenager detained and released after Claude flagged his fiction-writing queries and the report reached the FBI, officials say

A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.

Core + contextual relations Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026

Event date unknownArgentinaChatGPT (reported)

Chaco, Argentina: Gendarmería says two men were detained after an FBI alert that one of them told ChatGPT he had weapons and a plan for a school shooting

Argentina's Gendarmería Nacional said on 13 October 2026 that its investigators in Presidencia Roque Sáenz Peña, Chaco, under the direction of the federal prosecutor there, opened a criminal investigation after an alert from the US FBI. According to the release, the alert warned of a user in the town who, in consultations on ChatGPT, claimed to have weapons, explosives and ammunition and a detailed plan for a mass shooting at local educational establishments; the release's opening paragraph says the two people involved used ChatGPT to consult and obtain a specific plan for an attack. Gendarmes searched a home on a federal court order, seized notebooks with handwritten plans for the attack, bladed weapons and tools, a fuel can, a book with Nazi symbols, cash and computers, and detained two adults on the judge's order. Infobae, relaying the official information, reports that the target was a university in Corrientes. The accusations are allegations, and what ChatGPT replied is not reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 14/10/2026

Jun 2025 to Jul 2025Event location unknownUnidentified voice-cloning tool

State Department cable says an impostor used AI voice and text messages to pose as Secretary of State Marco Rubio to foreign ministers and US officials

A State Department cable dated 3 July 2025, sent to all US embassies and consulates and reported by The Washington Post, AP and The Guardian, said an impostor posing as Secretary of State Marco Rubio had contacted at least five senior officials, including three foreign ministers and a US governor, by text, Signal and voicemail, with the aim of gaining access to information or accounts. According to AP, two senior officials and the cable described the attempts as using technology driven by artificial intelligence; the Guardian reports that the messages mimicked Rubio's voice and writing style. The department said it was investigating and advised all employees and foreign governments. One official told AP the attempts had been unsuccessful; the technical basis for the AI description was not disclosed.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

Jun 2025Event location unknownLegal Genius (reported)

Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool

In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

25 Feb 2025 to 7 Jul 2025Event location unknownUnidentified AI drafting tool

Colorado federal court fines two MyPillow defence lawyers $3,000 each over a brief with fabricated citations; lead counsel had admitted running it through AI

In the defamation case Coomer v. Lindell in the US District Court for the District of Colorado, a brief that lawyers for Mike Lindell and MyPillow filed on 25 February 2025 contained nearly thirty defective citations, including citations of cases that do not exist. At a conference on 21 April 2025 lead counsel Christopher Kachouroff told Judge Nina Y. Wang that he had drafted the motion and then 'ran it through AI' and had not personally checked the citations. Counsel later said a wrong draft had been filed by mistake; the court was not persuaded. On 7 July 2025 the court found that he and co-counsel Jennifer DeMaster had violated Rule 11 and fined each $3,000 (Kachouroff jointly with his law firm). The court did not sanction Lindell or his companies.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 14/10/2026

3 Jun 2026United StatesUnidentified AI tool

Ninth Circuit fines and suspends two immigration lawyers over briefs with AI-hallucinated citations and denials of AI use; immigration board follows

On 3 June 2026 the US Court of Appeals for the Ninth Circuit fined immigration attorneys Mike Singh Sethi and William Rounds $2,500 each and suspended both from practice before the court for six months. Briefs filed in an asylum petition for review cited two cases that do not exist and attributed quotations to opinions that do not contain them. In a motion to correct, the attorneys called the errors typographical, and at oral argument Rounds twice said AI was not used. In their response to the court's order to show cause, they conceded that the errors were probably the product of unauthorised AI use by the firm's unlicensed brief writers and a failure to check citations. The court said the suspension was owed to their repeated failure of candour. The Board of Immigration Appeals then suspended Sethi from practice before the Board, the immigration courts and the Department of Homeland Security for six months, effective 13 June 2026, and designated that decision as a precedent on 1 October 2026.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 2 sources · Added 14/10/2026

1 Sept 2026Event location unknownUnidentified AI drafting tool

Austria: Federal Administrative Court fines a litigant EUR 200 for hundreds of pages of submissions it found were AI-generated and unlabelled

In a pending appeal against a decision of Austria's data protection authority, the Federal Administrative Court (BVwG) found that the appellant had filed hundreds of pages of statements and attachments within less than four months that were obviously created exclusively with large-language-model text programs and not labelled as AI-generated. In a decision of 1 September 2026 the court imposed a EUR 200 penalty for wanton use of the court, holding that the AI-assisted filings repeated the same complaints, brought no new facts or evidence and ignored the EU labelling duty for AI-generated content. The court announced it as the first such penalty for AI submissions. The appellant is anonymised and the appellant's response is not reported.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 13/10/2026

Jun 2026BrazilUnidentified AI drafting tool

Paraíba, Brazil: judge fines a lawyer R$32,800 over hidden AI commands in a petition, G1 reports; state bar later suspends two lawyers in such cases

A judge of the 5th Mixed Court of Sousa, Paraíba, found hidden instructions aimed at artificial intelligence tools spread over seven pages of a lawyer's motion for clarification in a public-competition case in June 2026, including an order to ignore impartiality and a note calling it a test of whether the judge used only AI to decide. The judge fined the lawyer two penalties of R$16,400 (R$32,800 in total) for bad-faith litigation and contempt of the court's dignity, and referred the case to the Paraíba bar (OAB-PB) and the state prosecutors, G1 reports. The defence said the commands were not inserted deliberately and blamed an error in exporting a file prepared with AI support. An appeal judge refused to suspend the fines on 30 June, the trial judge kept them on reconsideration, and in July, G1 reports, the OAB-PB preventively suspended two lawyers after opening procedures into two hidden-command cases, one of them the Sousa case.

AI relation unknown Low reported severity Regulatory Action

AI involvement reported · Causal attribution established · 4 sources · Added 13/10/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.