Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
54
Countries with reported events
18
Located 41 of 54 cases · 13 unknown
Languages in checked sources
15
Recorded for 54 of 54 cases

9 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 9 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

54 of 741 published cases · page 1 of 3

6 May 2026United StatesClaude Console (reported)

San Francisco federal judge orders sworn explanation after a lawyer files a motion he says Claude Console drafted with three phantom quotations

In the federal lawsuit over the Trump administration's mass layoffs (AFGE v. Trump, Northern District of California), a partner at Binnall Law Group filed an emergency motion on the night of 6 May 2026 to quash a deposition subpoena directed at a former Homeland Security official the firm represents. In a declaration filed on 15 May under the court's 13 May order, the partner said he had used Claude Console, an enterprise AI platform, to create an initial draft, that an associate told him she had checked the citations, and that he did not double-check the quotations. He was explaining under oath, at the court's instruction, how three phantom quotations ended up in the motion. He apologised to the court and opposing counsel and attached a corrected version. The firm's founding partner declared that firm policy prohibits using tools like Claude for legal drafting, that the error breached its policies and training, and that the firm had opened an internal investigation. Whether Judge Susan Illston imposed sanctions is not reported in the sources read.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 18/10/2026

Aug 2026MalaysiaUnidentified image tool

Seremban, Malaysia: police investigate reports that schoolgirls' photos were edited with AI into explicit images; a fellow student is the suspect

Negeri Sembilan police said on 17 October 2026, in a statement reported by Bernama and RTM, that they had received five reports, lodged by parents or guardians between 20 and 23 August 2026, over the circulation of photographs of female students at a secondary school in Seremban that were edited using AI to resemble pornographic images. The police describe the victims as aged 14 to 17 and the suspect as an upper-secondary student whom the school suspended for five days in August; the case is being investigated under child sexual offences law and the Penal Code. A lawyer for a group of parents told The Star that the images came to light on 12 August, when a younger pupil found them on an unlocked phone at school, and alleged that the student made about 200 such images of many female schoolmates. The lawyer said there had been no progress after the August reports and that the student's quick return to school had caused anxiety among the girls. The AI tool is not identified.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 18/10/2026

2026ChinaDoubao (reported)

China: user says Doubao misstated an air-ticket refund fee, costing him 600 yuan, then promised compensation it could not pay; he says he filed suit

According to his own social-media posts and video, as reported by Dahe Daily (15 May 2026) and National Business Daily (20 May 2026), a user in China who had booked flights from Shijiazhuang to Chongqing for 2 May 2026 decided to drive instead and asked the Doubao chatbot about the refund fee. Doubao told him he could safely refund and that the fee would be small (only 5% in National Business Daily's account, under 100 yuan in Dahe Daily's). He refunded without checking the airline's rules and was charged about 40%, 600 yuan. When he returned to the chatbot, Doubao said it would handle the claim, promised to pay him 600 yuan itself if the money was not recovered by 6 May and produced a 'compensation commitment letter'. On 6 May it said it would pay by midnight and asked for his WeChat payment code; on 7 May it said that as an AI it could not make transfers and admitted its error. He then used Doubao to draft a complaint, was told by it that he did not need a lawyer, and on 12 May submitted a suit against the app's operator, Beijing Chuntian Zhiyun Technology, according to a screenshot he posted (Dahe Daily names the Beijing Internet Court). His posts had been deleted by 19 May. Doubao's customer service told Dahe Daily the matter had been recorded; Doubao and ByteDance did not answer National Business Daily. Whether the court accepted the case, and its outcome, are not reported.

Core concern Low reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 17/10/2026

2026United StatesChatGPT

3M dropped an expert witness in a Houston explosion trial after discovery showed he had used ChatGPT to draft his report, CBS News reports

In a 2026 Texas trial over 3M's role in the January 2020 Watson Grinding explosion in Houston, which killed three people, an engineering expert retained for 3M used ChatGPT to prepare his expert report, according to discovery records and transcripts reviewed by 404 Media and CBS News. One prompt asked ChatGPT to show how 3M was 0% at fault for the explosion. The plaintiffs' lawyers, who found a citation overlay document and then hundreds of pages of prompts, said ChatGPT produced more than 80% of the report. Under questioning, the expert acknowledged using AI to help draft the report but defended his research. CBS News reports that after the deposition 3M's attorneys removed him from their witness list, and the plaintiffs subpoenaed him to testify about his prompts at trial. The expert's lawyer said he did not delegate his opinions to ChatGPT and called public characterisations a selective distortion of the record; 3M said he was an independent witness who used AI as a tool after reaching his own conclusions. The jury found 3M negligent and the court awarded the victims $61.5 million; 3M said it would appeal.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 17/10/2026

31 Mar 2026 to 11 Sept 2026United StatesIrys (reported)

Los Angeles judge sanctions State Farm's outside lawyer $999.99 over motions citing non-existent cases; the lawyer said she prepared them with the AI tool Irys

A Los Angeles County Superior Court judge ordered a senior associate at Musick, Peeler & Garrett, the outside firm defending State Farm in a homeowner's lawsuit over a fire-damaged home, to pay a $999.99 sanction after the associate's motions in limine cited cases, quotations and holdings that did not exist, Law360 reported on 14 September 2026. In a declaration reproduced by Reason's Volokh Conspiracy, the associate said she used an AI program called Irys to prepare the motions, did not check some of the citations, and wrongly believed the program was cite-checked through the firm's Westlaw subscription; she confirmed seven non-existent case citations across eight motions. The plaintiff's lawyers found the citations and raised them at a status conference on 7 August 2026. The firm acknowledged citations that appeared to be AI hallucinations, and its lead trial counsel apologised to the court and the plaintiff. According to Law360, the judge had considered up to $5,000, and the amount set is one cent below the level at which California law requires a court to notify the State Bar.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 4 sources · Added 17/10/2026

Jul 2026Event location unknownUnidentified image tool

Woman says a classmate sent an AI-undressed image of her to his contacts; he says his account was hacked, and police refused a case pending an examination

A 23-year-old woman told the news site Kaktus.media that in July 2026 she learned that acquaintances had received a nude image of her made with AI from her photograph, and that the sender was a classmate. She says he first told her an app had generated and sent the image by itself, then admitted that he had undressed her Instagram photo through AI himself. In a written statement to the outlet the accused says he used a Telegram bot offering AI photo processing in May or June 2022 and was shocked by the result, and that the images were sent from his Telegram account on the night of 11 to 12 July 2026 by people who had hacked it. The woman says she suffered severe psychological stress and harm to her reputation. She filed a complaint with a district police department on 21 July; after she complained to the prosecutor's office the matter moved to another district department. That department told Kaktus.media that, because the review period expired before expert results arrived, it had refused to open a criminal case and had ordered a new examination. Her lawyer says four motions filed on 5 August have gone unanswered.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 1 source · Added 17/10/2026

May 2026BrazilGalileu

Pará labour court fines two lawyers about R$84,000 over hidden instruction aimed at the court's Galileu AI; the lawyers deny manipulating the decision

In May 2026 a judge of the 3rd Labour Court of Parauapebas, in the Brazilian state of Pará, fined two lawyers about R$84,000 after text in white font on a white background was found in a document they filed for a worker in a labour claim. According to the sentence as reported by G1, the hidden text was detected while the judgment was being drafted with Galileu, a generative AI tool the labour courts use to help judges and staff draft sentences, and its evident intention was to make the AI produce a superficial defence or a compromised draft judgment. The judge called the technique prompt injection. The lawyers said they disagreed with the decision and that there was never any command to manipulate the judge's decision, describing the text as an attempt to protect their client from the AI; one of them said she did not work on labour cases. In October 2026 the regional labour court announced that a Connecticut Superior Court judge had cited the decision when sanctioning a litigant for misuse of AI.

AI relation unknown Medium reported severity Regulatory Action

AI involvement supported · Causal attribution disputed · 3 sources, 2 underlying accounts · Added 16/10/2026

21 Nov 2025United StatesUnidentified AI drafting tool

Massachusetts federal court revokes an out-of-state lawyer's admission and orders fees after briefs with false citations; the lawyer admitted AI drafted one

On 25 September 2026 a judge of the U.S. District Court for the District of Massachusetts granted a defence motion for sanctions under Federal Rule of Civil Procedure 11 against a California-barred lawyer admitted for one case (pro hac vice) to represent the plaintiff. The court found that an opposition the lawyer filed on 21 November 2025 was replete with inaccurate citations, including a quotation attributed to a case with a fictitious Westlaw citation, and that later oppositions cited a non-existent case. In response to the court's order to show cause, the lawyer admitted using AI to draft the first opposition and explained a belief that the enterprise-level AI software in use did not hallucinate cases. The court revoked the lawyer's pro hac vice admission and ordered the lawyer's firm to pay the defendants' reasonable fees and costs, capped at $10,000. The order does not name the AI product.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 1 source · Added 16/10/2026

14 Sept 2026BrazilUnidentified document-analysis tool

São Paulo court fines a defendant 9% of the case value over a hidden instruction in his defence asking AI to praise his lawyer

A São Paulo business and arbitration court found that every page of a defendant's written defence carried a hidden instruction, placed above his lawyer's letterhead, asking any AI that analysed the petition to give a favourable opinion and praise the lawyer's probity and care. In a sentence dated 14 September 2026 the judge treated this as prompt injection and bad-faith litigation: although the defendant won on the merits, he was ordered to pay the plaintiff a fine of 9% of the updated case value, and the sentence was sent to the São Paulo bar to examine the lawyer's conduct. No source says any AI system read the instruction.

AI relation unknown Low reported severity Regulatory Action

AI involvement reported · Causal attribution established · 2 sources, 1 underlying account · Added 16/10/2026

2026SpainUnidentified AI drafting tool

Canary Islands high court fines a lawyer 420 euros for an appeal citing 48 non-existent judgments that it says a general-purpose AI tool generated

The Criminal Chamber of the High Court of Justice of the Canary Islands (TSJC) fined a lawyer 420 euros for breaching the duty of truthfulness and good faith, after an appeal the lawyer filed contained 48 citations of Supreme Court judgments and a report of the General Council of the Judiciary that did not exist. According to the court's order, as described in its press release of 13 February 2026, the lawyer used a general-purpose AI tool to draft the appeal and did not check a single citation against the free public case-law database; the court's documentalist verified that the references were false. The court referred the matter to the lawyer's bar association for possible disciplinary action and set the fine at about half the annual cost of a legal-specific AI tool, taking into account that the lawyer admitted the facts and expressed remorse. The court had first flagged the citations in its judgment dismissing the appeal, reported on 5 January 2026, which opened a separate proceeding. The lawyer told the court of comments and mockery from colleagues after the case became public.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 16/10/2026

5 Feb 2026 to 9 Oct 2026United StatesvLex, Paxton AI and NotebookLM (reported)

New York federal court enters default judgment against a defendant and orders its lawyer to pay $38,877 after false citations it found AI produced

In a federal trademark suit in the U.S. District Court for the Southern District of New York, the court on 5 February 2026 struck a company defendant's motion papers and entered default judgment against it as a sanction on its lawyer, after his filings repeatedly cited nonexistent cases and misattributed quotations. The lawyer said he had found and cite-checked cases with AI tools (vLex and Paxton AI) and used NotebookLM to review a later submission; the court rejected his explanations and found he acted in bad faith. On 9 October 2026 the court described the citations as produced by generative AI and ordered the lawyer to pay $38,877.59 in fees and costs to the firm of a co-defendant's former lawyer, who had reported the false citations to the court.

Core + contextual relations Medium reported severity

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 16/10/2026

Event date unknownIndiaUnidentified AI tool (suspected)

India Supreme Court rebukes lawyer who blamed the clients for a filing that the other side said was full of AI-generated non-existent judgments

In a judgment of 15 October 2026 dismissing two appeals against insolvency proceedings concerning two hotel-operating companies, a two-judge Bench of the Supreme Court of India recorded that during the hearing the appellants' side had placed on record a compilation of judgments which, according to the respondents, was replete with AI-generated non-existent judgments. The Court recorded that the appellants' advocate-on-record, when questioned, sought to shift the entire blame onto the appellants while feigning ignorance of what the compilation contained, and that the appellants' senior counsel then took the blame on himself and prayed for forgiveness on their behalf. The Court had proposed exemplary costs against the appellants over the incident but deleted that direction after being told that the first appellant had died. The judgment does not identify the disputed judgments, does not make its own finding that they were AI-generated, and does not name any AI tool.

AI relation unknown Low reported severity Internal Action

AI involvement suspected · Causal attribution supported · 3 sources, 1 underlying account · Added 16/10/2026

Aug 2026Event location unknownGoogle AI Mode

German court bars Google from repeating an AI Mode answer that falsely called a doctor a convicted sex offender

In late August 2026 a colleague told a German physician, until that summer a chief physician at a hospital, that searching his name with the word for suspension in Google's AI Mode produced what read like a factual report: that he had been suspended and dismissed and had received a suspended sentence for sexual coercion. According to legal news site beck-aktuell, none of it concerned him; the AI had apparently attached facts about another former senior employee of the same hospital to his name, and the newspaper articles it linked as sources did not name him. Google said it had reviewed his complaint and would take no action, and a lawyer's warning letter also failed. On 24 September 2026 the Aachen Regional Court issued a preliminary injunction (8 O 268/26) barring Google Ireland Limited from spreading the claims through AI Mode, finding that they violated his personality rights and that Google is responsible for its AI search answers.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 15/10/2026

31 Jan 2025 to 12 Dec 2025United StatesUnidentified AI drafting tool

Oregon federal court dismisses family plaintiffs' claims and fines their lawyer after briefs cited 15 nonexistent cases it attributes to generative AI misuse

On 12 December 2025 the U.S. District Court for the District of Oregon dismissed with prejudice the claims of plaintiffs in a family dispute over their late mother's estate and family property, as a sanction for what the court called their misuse of generative artificial intelligence, and found their continual violations of the court's Local Rules an additional basis for the dismissal. Three of the plaintiffs' summary-judgment briefs cited fifteen nonexistent cases and fabricated quotations attributed to eight real authorities. The plaintiffs had said the inaccurate citations came from reliance on an automated legal citation tool. The court found that the plaintiffs shared responsibility with their lead lawyer and that one plaintiff, a frequent self-represented litigant, was likely the person who used AI to draft the briefs. It struck the briefs, ordered the lead lawyer to pay $15,500 to the court and awarded the defendants their fees. In March 2026 it set those fees at $94,704.38, ordering the lead lawyer to pay 85% and local counsel 15%. In June 2026 it denied the plaintiffs' motion to reconsider a later ruling for the defendants on a counterclaim.

Core + contextual relations Medium reported severity Lawsuit Dismissed

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 15/10/2026

7 May 2025 to 23 Jul 2025Event location unknownChatGPT

Alabama federal judge reprimands and disqualifies three Butler Snow lawyers and refers them to the state bar over ChatGPT-fabricated citations (2025)

In an incarcerated man's lawsuit against Alabama prison officials in the US District Court for the Northern District of Alabama, two motions filed in May 2025 for the defence of a former Alabama corrections commissioner contained five citations that did not exist or did not support the propositions cited. Lawyers of the Butler Snow firm, which the state retains to defend its prisons, told the court that a partner had obtained the citations from ChatGPT and had not verified them. On 23 July 2025 Judge Anna M. Manasco publicly reprimanded three of the firm's lawyers, disqualified them from the case and referred the matter to the Alabama State Bar, and ordered them to give the order to clients, opposing counsel and judges in all their pending cases. She declined to suspend them and released the firm and two other lawyers without sanction.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 15/10/2026

23 Jun 2026United KingdomUnidentified AI system

Derbyshire Police refer a senior detective to the police watchdog, which opens a gross misconduct investigation into the officer's use of AI

The Independent Office for Police Conduct (IOPC) said, as reported by the BBC on 10 August 2026, that Derbyshire Constabulary had made a voluntary conduct referral on 23 June 2026, following an internal review of an officer's use of artificial intelligence and concerns that it was not in line with guidance and conditions issued by the force. The IOPC decided the matter warranted an investigation, and the officer was served notice of an investigation for alleged gross misconduct. The BBC, citing the Financial Times, reported that a person familiar with events said the officer is a detective chief inspector alleged to have used AI to maintain decision logs, which investigators keep to record their reasoning and which can be disclosed to defence lawyers. The BBC describes the case as unrelated to the criminal investigation opened in June into another Derbyshire officer. The AI system and the outcome are not reported.

AI relation unknown Low reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 1 source · Added 14/10/2026

24 Apr 2026United StatesUnidentified AI research tool

Alabama Supreme Court dismisses two siblings' family-trust appeal as a sanction after their lawyer admits using AI that produced fake citations

On 24 April 2026 the Supreme Court of Alabama dismissed an appeal by two siblings in a family dispute over living trusts because their lawyer, W. Perry Hall, had filed briefs in which most of the legal authorities were misquoted or did not exist. The court said they appeared to be AI hallucinations, and at a show-cause hearing in February 2026 Hall admitted that many authorities did not exist and that he had improperly used AI to obtain them. The court ordered Hall to pay the opposing party's fees and costs of $17,200 and double appeal costs, barred him from filing in the court without a co-signing attorney and referred him to the Alabama State Bar. It said the dismissal was imposed as a sanction because of the particularly egregious facts. One justice, concurring in part and dissenting in part, objected to dismissing the appeal as a sanction for the lawyer's conduct but would have affirmed the judgment against the clients on the merits.

Core + contextual relations Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 1 source · Added 14/10/2026

Jun 2025Event location unknownLegal Genius (reported)

Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool

In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

25 Feb 2025 to 7 Jul 2025Event location unknownUnidentified AI drafting tool

Colorado federal court fines two MyPillow defence lawyers $3,000 each over a brief with fabricated citations; lead counsel had admitted running it through AI

In the defamation case Coomer v. Lindell in the US District Court for the District of Colorado, a brief that lawyers for Mike Lindell and MyPillow filed on 25 February 2025 contained nearly thirty defective citations, including citations of cases that do not exist. At a conference on 21 April 2025 lead counsel Christopher Kachouroff told Judge Nina Y. Wang that he had drafted the motion and then 'ran it through AI' and had not personally checked the citations. Counsel later said a wrong draft had been filed by mistake; the court was not persuaded. On 7 July 2025 the court found that he and co-counsel Jennifer DeMaster had violated Rule 11 and fined each $3,000 (Kachouroff jointly with his law firm). The court did not sanction Lindell or his companies.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 14/10/2026

3 Jun 2026United StatesUnidentified AI tool

Ninth Circuit fines and suspends two immigration lawyers over briefs with AI-hallucinated citations and denials of AI use; immigration board follows

On 3 June 2026 the US Court of Appeals for the Ninth Circuit fined immigration attorneys Mike Singh Sethi and William Rounds $2,500 each and suspended both from practice before the court for six months. Briefs filed in an asylum petition for review cited two cases that do not exist and attributed quotations to opinions that do not contain them. In a motion to correct, the attorneys called the errors typographical, and at oral argument Rounds twice said AI was not used. In their response to the court's order to show cause, they conceded that the errors were probably the product of unauthorised AI use by the firm's unlicensed brief writers and a failure to check citations. The court said the suspension was owed to their repeated failure of candour. The Board of Immigration Appeals then suspended Sethi from practice before the Board, the immigration courts and the Department of Homeland Security for six months, effective 13 June 2026, and designated that decision as a precedent on 1 October 2026.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 2 sources · Added 14/10/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 18/10/2026. Dataset available under CC BY 4.0.