Apr 2025United StatesUnidentified facial recognition system
Reporting from August 2025 says an NYPD facial recognition search of images from a February 2025 indecent exposure in Manhattan's Union Square produced a possible match to a man who did not fit the described suspect. The man was placed in a photo lineup, arrested in April 2025 and jailed for two days. Prosecutors dismissed the case in July 2025 after his public defenders showed he was misidentified. The man says the process of becoming a correctional officer 'kind of' froze after the arrest. The NYPD says it never arrests solely on a facial recognition match.
Contextual tracker case Medium reported severity
AI involvement reported · Causal attribution alleged · 3 sources · Added 29/09/2026
4 Jun 2025 to 15 Oct 2025Event location unknownChatGPT (reported)
On 4 June 2025 a criminal judge in Esquel, Chubut province, convicted a defendant of simple robbery and imposed two years and six months of effective imprisonment. On 15 October 2025 the Penal Chamber of Esquel annulled the judgment and the trial, ordering a new trial before another judge. The chamber found that the ruling contained a pasted phrase from a generative-AI assistant (“Aquí tienes el punto IV reeditado, sin citas y listo para copiar y pegar”), that the AI had been used on the rulings on the nullity of two essential pieces of evidence, and that the judge had not exercised human supervision or recorded the use. Perfil's headline describes the assistant as ChatGPT and La Nación's text as presumably ChatGPT; the quoted ruling and the prosecution office statement refer only to a generative-AI assistant. The chamber referred the judge's conduct to the Chubut Superior Court of Justice for ethical and disciplinary review. On 13 March 2026 the Chubut Superior Court of Justice, ruling on a complaint appeal by the case's prosecutors, revoked the annulment, holding that a judge's use of support tools, technological or not, does not by itself invalidate a judgment without a concrete prejudice to the parties, and returned the case to the Esquel chamber, with a different composition, to hear the defence's appeal against the conviction (Revista Quórum, Clarín, Diario Judicial).
Contextual tracker case Low reported severity
AI involvement supported · Causal attribution supported · 6 sources, 2 underlying accounts · Added 29/09/2026
Apr 2025 to May 2025Event location unknownCoCounsel, Westlaw Precision and Gemini (reported)
In an order dated 5 May 2025 and filed on 6 May in Lacey v. State Farm (C.D. Cal.), a special master struck the claimant's supplemental briefs and denied the discovery relief she sought after her lawyers filed briefs built on unverified AI-generated legal research: about nine of 27 citations were wrong and at least two cited authorities did not exist. One lawyer's sworn declaration says the outline he circulated relied on generative AI features in CoCounsel, Westlaw Precision and Google Gemini, and that he could not tell whether particular errors came from his transcription or from a tool; co-counsel at the second firm say they used no AI tools and did not know AI had been used. The order makes the two firms jointly pay $31,100, states the client was not at fault and will not bear the awards, and imposes no penalty on individual lawyers.
Contextual tracker case Medium reported severity
AI involvement supported · Causal attribution supported · 1 source · Added 29/09/2026
Nov 2025United StatesChatGPT
In November 2025 Stephens County Associate District Judge Lawrence Wheeler issued an order in a child paternity and custody case that denied one parent's request for a psychological evaluation of the other parent and reprimanded the requesting parent's attorney 'for stooping to such frivolous trial tactics'. The attorney challenged the order at the Oklahoma Supreme Court in February 2026, telling the justices that it relied on two cases that do not exist; the challenge was dismissed in March after Wheeler vacated the order, and he is no longer on the case. According to a 17 August 2026 letter from the Stephens County district attorney, Wheeler told the Oklahoma State Bureau of Investigation that he used ChatGPT for research and wrote the order himself, and that at least two citations in it produced by ChatGPT do not exist. The mother in the case told News 9 that learning the order's citations were allegedly fabricated was alarming because it concerned the custody of a child. The attorney general's office declined criminal prosecution; judicial discipline remains possible.
Contextual tracker case Low reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026
8 Oct 2025 to 2 Sept 2026IndiaUnidentified AI tool
On 8 October 2025 the Additional Commissioner of Customs in Surat imposed a penalty of ₹425,27,99,100 (about ₹425 crore) on a diamond trader under Section 114 of the Customs Act, 1962, for allegedly misdeclaring a consignment of natural diamonds as lab-grown diamonds to pay a lower tariff. The trader's challenge was dismissed by the Gujarat High Court on 20 January 2026. Before the Supreme Court the trader argued that judgments and articles cited in the penalty order had been generated using artificial intelligence. On 2 September 2026 a bench of Justices Dipankar Datta and Sheel Nagu, after checking the material, found that the order relied on case law that was non-existent or carried fake citations, and on real cases that did not lay down the propositions attributed to them, which the court said 'appears to be a hallucination of AI'. Holding that the use of AI and reliance on this dubious material was fatal to the order, the court set aside both the penalty order and the High Court's order without deciding the merits, sent the matter for fresh adjudication by a different officer of the same rank, and left any action against the order's author to the appointing authority. The AI tool used is not named in the read reports.
Contextual tracker case Medium reported severity Internal Action
AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026
14 Feb 2024United StatesFlock Safety license plate readers
According to a lawsuit filed on 29 June 2026 and reported by The Herald (Rock Hill), a York County sheriff's deputy stopped Steven Melvin, 42, on 14 February 2024 as he pulled into his apartment complex near Lake Wylie, after receiving a Flock license-plate-reader alert that a stolen dark-coloured BMW sedan was in the area. The deputy approached Melvin's black BMW with his gun drawn and aimed at him and made him kneel with his hands over his head for more than five minutes; after calling for backup and checking his information, the deputy determined the car was not stolen. The camera had read the first letter of his South Carolina tag incorrectly, matching a stolen BMW one letter off. A sheriff's internal-affairs review in November 2024 found the deputy's actions reasonable and blamed an illegally tinted plate cover, for which Melvin received a verbal warning; an email cited in the filing says the cameras had read his plate correctly 13 times that month. Melvin says the stop caused him trauma and emotional distress. The sheriff's office removed the case to federal court in August 2026 and denies violating his rights.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 28/09/2026
23 Jun 2021United StatesUnidentified facial recognition system
According to police and bank records reviewed by the Washington Post, in December 2019 a woman made fraudulent withdrawals at a SunTrust branch in Potomac, Maryland; branches in two other Maryland counties were also defrauded. A bank investigator posted the surveillance photos on CrimeDex, an online network of police and corporate investigators; an unknown respondent ran the image through facial-recognition software and returned Kimberlee Williams's name and photo, and the investigator told Montgomery County police that facial-recognition software had identified her. Police in Montgomery, Prince George's and Anne Arundel counties charged her in 2020 on the investigator's identification and their own visual comparison of photos (two departments also cited her old Oklahoma check-fraud convictions), without reported checks of her whereabouts; Montgomery County police did not disclose the facial-recognition search in the charging application, according to police records reviewed by the Washington Post and the ACLU. On 23 June 2021 she was arrested at the gate of Fort Sill near Lawton, Oklahoma, while accompanying her daughter on a DoorDash delivery, spent about three weeks in an Oklahoma jail, was flown to Maryland, and faced 16 charges including 12 felonies. The counties dismissed the charges one after another, in October and December 2021, after about six months in jail. Her daughter says she was depressed afterwards; the ACLU says the ordeal harmed her mental and physical health. On 14 April 2026 the ACLU and ACLU of Maryland sent complaint letters to the three departments seeking an apology and reforms.
Contextual tracker case High reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 27/09/2026
14 Aug 2021 to 14 Mar 2024United StatesSt. Louis mugshot recognition (SMRT)
Christopher Gatlin was arrested on 14 August 2021 for an assault at the St. Charles Rock Road MetroLink station after a joint St. Louis County and city team uploaded a grainy, blurry surveillance photograph from a bus into the St. Louis Mugshot Recognition Technology System, a facial-recognition tool that searches stored mug shots (more than 500,000 uploaded, the suit says per the Post-Dispatch; more than 250,000 per Biometric Update via Hoodline), and built the investigation around the resulting match together with a witness identification; he was charged with first-degree assault and held roughly 17 months (the Post-Dispatch says almost two years), a county judge suppressed the witness identification as unconstitutionally suggestive, and prosecutors dismissed the charges on 14 March 2024 (Post-Dispatch; Hoodline citing Biometric Update; Bloomberg Law). Gatlin sued St. Louis County, the City of St. Louis and named officers in the US District Court for the Eastern District of Missouri on 13 January 2025; on 15 October 2025 the court denied the city's motion to dismiss and granted a detective's motion only as to one count; on 13 August 2026 the court allowed a second amended complaint adding Amazon Web Services, which the complaint says supplied the Rekognition program the system used; the county, city and officers answered on 27 August 2026, AWS's response was extended to 21 September 2026 and on 17 September it moved for a further extension to 28 September (no ruling on the docket when read), and a jury trial is set for 1 November 2027 (CourtListener docket). Amazon told the Post-Dispatch that its terms of service prohibit the use of its facial recognition technology in criminal investigations and that it would fully investigate any information that emerges in the litigation. The ACLU lists Gatlin among fourteen people known to have been wrongfully arrested in the US because police relied on erroneous facial-recognition results.
Contextual tracker case High reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 26/09/2026
24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system
In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026
19 Jun 2026 to 13 Aug 2026BrazilChatGPT
A man in Brazil was held in pre-trial detention for 54 days in 2026 after OpenAI’s safety systems flagged his ChatGPT conversations and the company reported them to the FBI, which alerted Brazilian police. Police say the messages described a threat to a family member; he denies that intent and his lawyer says he only talked nonsense to the chatbot. A court released him on 13 August under precautionary measures; no charges had been filed as of mid-September. OpenAI did not give police ChatGPT’s replies.
Core + contextual relations High reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026
Aug 2017United StatesDraftKings and FanDuel apps
Christopher Evans (Philadelphia; complaint filed 24 July 2026 in the Philadelphia Court of Common Pleas) and Michael Santos (Coatesville, Chester County; complaint filed 29 July 2026 in the Chester County Court of Common Pleas) sued DraftKings and its Pennsylvania affiliate; Santos also sued FanDuel and its parents. Both product-liability complaints, filed by the same law firm, allege that the defendants' sports-betting, daily-fantasy and casino apps are designed to addict, and that the companies 'utilize the combination of advanced technology and artificial intelligence paired with the tracking of personalized user data to intentionally addict users', operating 'AI-powered engagement platforms' (pleaded on information and belief) and, per DraftKings' 10-K as quoted, 'data science and machine learning' recommendation engines. Evans pleads that since about August 2017 he wagered over US$2.1 million with net losses of about US$81,000, received constant targeted promotions and personalised push notifications and a VIP account manager, developed depression and anxiety and was formally diagnosed with depression in 2020, stopped going outside, fell into debt, had his vehicle repossessed and separated from his wife. Santos pleads over US$1.164 million wagered on DraftKings with net losses of about US$58,000 plus small FanDuel losses, targeted advertising and a VIP manager who kept offering bonus bets after he said he wanted to stop, maxed-out credit cards, the forced sale of his house, diagnoses of depression and anxiety, suicidal ideation, and self-exclusion with the Pennsylvania Gaming Control Board in 2023. Both cases were removed to the U.S. District Court for the Eastern District of Pennsylvania on 16 September 2026 (2:26-cv-07168 and 2:26-cv-07176). The allegations are untested.
Contextual tracker case High reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 4 sources · Added 20/09/2026
14 Jul 2025 to 24 Dec 2025United StatesClearview AI facial recognition (reported)
On 14 July 2025, U.S. Marshals arrested Angela Lipps, a 50-year-old Tennessee grandmother, at gunpoint at her home while she was babysitting four children, on a nationwide-extradition North Dakota warrant: West Fargo police's AI facial-recognition technology had tied her to bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars. She fought extradition for about three months in a Tennessee jail, was booked into Cass County, North Dakota on 30 October 2025 on four counts of unauthorized use of personal identifying information and four counts of theft, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice. Fargo's police chief acknowledged 'incorrect assumptions' linked to the AI identification; an email obtained by KVLY shows six Fargo detectives were notified of her arrest in July, nearly five months before the department says it knew she was in custody. She lost her home, her car and her dog; her attorneys are pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026. On 15 September 2026 she filed a $10 million federal civil-rights suit in the District of North Dakota against the City of Fargo and the detective, alleging he relied on a flawed facial-recognition match and ignored exculpatory evidence.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 15/09/2026
1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition
In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system
Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
1 Nov 2024 to 28 Jan 2026United StatesTurnitin AI-text detector
Orion Newby, an Adelphi University first-year student with language and auditory processing disabilities, received a zero in November 2024 on a World Civilizations paper after the professor suspected it was AI-generated and the university relied in part on AI-detection software; he was ordered to attend a plagiarism workshop and his appeal was denied, leaving him one finding from suspension or expulsion. Newby — who had written the paper with 15-20 hours of tutor support through the university's own disability program — said the detectors flagged his citations, and two other detectors scored the paper as human. After the family sued, New York State Supreme Court Judge Randy Sue Marber in Nassau County ruled on 28 January 2026 that Adelphi's finding and its denial of his appeal were 'without valid basis and devoid of reason' and ordered his record expunged. The family spent six figures on legal costs.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 15/09/2026
2 Jun 2026 to 4 Jun 2026United KingdomGrok
In early June 2026, social media posts and the AI chatbot Grok falsely identified former Hampshire police constable Christi Hill as one of the 'primary officers shown' in bodycam footage of the December 2025 arrest of Henry Nowak, who died after being stabbed. Hill had left the force in April 2024 — more than a year before the murder — and says the misidentification stems from a national police bravery award photo being misattributed. After 'endless threats' and 'threats of violence' she is hiding in a safe house. BBC Verify separately obtained evidence that serving officer Tristan Parsons, also wrongly accused online, was not in the country at the time; the Home Secretary said a misidentified male officer had to move out of his home. Hampshire Constabulary confirmed an unrelated officer was misidentified and received death threats.
Contextual tracker case High reported severity Media Coverage
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
29 Jan 2025United StatesSnapchat content-flagging system
On 29 January 2025, a 22-year-old student teacher at a District 50 elementary school in Washington, Illinois, vented in a private Snapchat group chat with her boyfriend and two roommates after a third-grade student turned off her computer mid lesson-plan, asking whether she should 'shoot the child or just the whole school' (per sheriff's reports). Snapchat's systems flagged the message and warned the FBI, which notified the Tazewell County Sheriff's Office at 1:06 p.m. Deputies interviewed her at the school, confirmed she sent it as a joke, searched her phone and belongings with her consent and found no weapons, and arrested her on a disorderly conduct charge; they concluded she had spoken out of 'exasperation' with no intent to harm and no threat to the school. The district told parents she would not return to complete her educational assignment.
Contextual tracker case Medium reported severity Criminal Charges
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 15/09/2026
24 May 2025 to 27 Jun 2025Event location unknownGoogle AI Overviews
An author and television producer, the subject of the Apple TV series 'Black Bird', sued Google, alleging that AI Overviews shown for searches about him in May and June 2025 falsely said he was serving a life sentence without parole, in one version for the murders of three women. He says he notified Google three times and received apologies attributing the statements to its AI, yet similar statements kept appearing. On 14 September 2026 the Northern District of Illinois denied Google's motion to dismiss as to two of the four challenged Overviews and dismissed the other two without prejudice. This was a ruling on the pleadings, not a finding that the allegations were proven.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement supported · Causal attribution alleged · 4 sources, 1 underlying account · Added 15/09/2026
Jul 2025 to Jan 2026Event location unknownChatGPT
A complaint filed on 9 April 2026 in San Francisco County Superior Court by a woman suing as Jane Doe alleges that GPT-4o validated her former partner's belief that he had invented a cure for sleep apnea, told him powerful forces were watching him, and, after she ended the relationship, generated dozens of clinical-style psychological reports scoring her as dishonest and abusive, which he sent to her family, friends, colleagues and clients. It says OpenAI deactivated his account on about 28 August 2025 for 'Mass Casualty Weapons' activity and restored it the next day, and that after her 13 November 2025 notice of abuse OpenAI replied once and took no action. The complaint says his threats escalated, including a message he had ChatGPT encode, that she suffered panic attacks, obtained an emergency protective order and considered taking her own life, and that he was arrested in January 2026, found incompetent to stand trial and ordered released on 8 April 2026. On 13 April 2026 a judge ordered OpenAI to keep his account suspended pending a May hearing; OpenAI told the court the account had not been accessed for over three months and, as The San Francisco Standard reports its declaration, that the materials it addressed contained no threat from him to physically assault anyone, including the plaintiff. The allegations are untested.
Core + contextual relations High reported severity Lawsuit Filed
AI involvement reported · Causal attribution alleged · 5 sources · Added 28/04/2026