Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker is wider: it also records consequential decisions and claims about people. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
2
Countries with reported events
1
Located 2 of 2 cases · 0 unknown
Languages in checked sources
2
Recorded for 2 of 2 cases

1 case has no reviewed AI-to-person relation yet: 0 not yet reviewed and 1 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity Medium
More filters: AI relation, use, setting, sources and responses
Clear filters

2 of 392 published cases

8 Oct 2025 to 2 Sept 2026IndiaUnidentified AI tool

Surat, India: a customs officer's ₹425 crore penalty order against a diamond trader relied on non-existent and misattributed case law that India's Supreme Court found 'appears to be a hallucination of AI'; the court set the order aside after the trader had lost in the Gujarat High Court

On 8 October 2025 the Additional Commissioner of Customs in Surat imposed a penalty of ₹425,27,99,100 (about ₹425 crore) on a diamond trader under Section 114 of the Customs Act, 1962, for allegedly misdeclaring a consignment of natural diamonds as lab-grown diamonds to pay a lower tariff. The trader's challenge was dismissed by the Gujarat High Court on 20 January 2026. Before the Supreme Court the trader argued that judgments and articles cited in the penalty order had been generated using artificial intelligence. On 2 September 2026 a bench of Justices Dipankar Datta and Sheel Nagu, after checking the material, found that the order relied on case law that was non-existent or carried fake citations, and on real cases that did not lay down the propositions attributed to them, which the court said 'appears to be a hallucination of AI'. Holding that the use of AI and reliance on this dubious material was fatal to the order, the court set aside both the penalty order and the High Court's order without deciding the merits, sent the matter for fresh adjudication by a different officer of the same rank, and left any action against the order's author to the appointing authority. The AI tool used is not named in the read reports.

AI relation unknown Medium reported severity Internal Action

AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026

24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system

Delhi: the police facial-recognition system logged at least 25 people who were in Tihar, Mandoli or Rohini jails as present at the Jantar Mantar student protests (20 to 26 July 2026), with timestamps on 24 to 26 July, on a sworn list of 2,873 persons with 'criminal antecedents' that the Supreme Court allowed police to register a fresh FIR against (Indian Express investigation, 4 September 2026)

In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/09/2026. Dataset available under CC BY 4.0.