Oct 2025United StatesUnidentified video tool
From around October 2025, criminals used AI to clone the image, voice, name, signature and firm logo of Ángel Leal, a long-established immigration attorney in Doral, Florida. They created fake videos, look-alike websites, forged contracts and even fabricated Zoom 'immigration hearings' to persuade immigrants to pay for legal services Leal never provided. Immigrants were defrauded of money, and some believed their cases were progressing when they were not; Leal received one to two defrauded callers a day, changed his phone number, hired an anti-piracy firm that removed thousands of fake profiles and videos, and reported the fraud to local police and federal authorities.
Core concern Medium reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources · Added 17/09/2026
16 May 2026United StatesGemini (reported)
A Boca Raton, Florida father told WPBF, WPTV and ABC News that after his teenage daughters took a Lyft home from the beach (on Saturday 16 May 2026, according to ABC News), he was charged a $75 damage fee because the driver reported that the riders had left a mess. Lyft customer service told him the driver had sent pictures. One daughter pointed out a Gemini logo in the corner of the photo, which the family took as showing it was AI-generated. The father says Lyft then agreed, apologised and blocked the driver. Lyft's statements say it reviewed the rider's concerns, offered reimbursement and, per its later statements, permanently removed the driver; they do not say the photo was AI-generated.
Contextual tracker case Low reported severity Involving minors Internal Action
AI involvement reported · Causal attribution alleged · 3 sources · Added 17/09/2026
6 Aug 2026United KingdomFacewatch facial recognition
On 6 August 2026 Matt Arnold, a comedy promoter, was refused service at a self-service till in Sainsbury's East Dulwich store and escorted out by two managers, who cited an incident earlier in the week. He says a staff member told him he had been identified by the AI and that he saw a CCTV monitor alert with a red circle around his face as he left. Sainsbury's apologised the next day, said the cause was human error rather than the facial recognition technology, and paused its Facewatch system at the store while it investigates. Facewatch says a correct alert was sent and mishandled in store; the BBC reports Sainsbury's claim that staff targeted the wrong person after a separate flag. Whose face the system matched is unresolved.
Contextual tracker case Low reported severity Internal Action
AI involvement disputed · Causal attribution disputed · 2 sources · Added 16/09/2026
Aug 2024South KoreaUnidentified image tool
On 16 September 2026 the Incheon District Court sentenced a teenage defendant to an indeterminate term of two years (maximum) to one year six months (minimum) under the Sexual Violence Punishment Act for making and distributing false sexual images, ordered a 40-hour treatment programme and a five-year ban on working with children, and took him into custody in court. As a middle-school student in Incheon in 2024 he had used AI deepfake technology to composite the faces of five teachers, including his homeroom teacher whom he tricked into sending photographs, and six female middle- and high-school students from his taekwondo academy onto nude images and videos, 35 productions in all, and distributed them in Telegram 'acquaintance humiliation' chat rooms with the victims' real names, ages, schools, subjects and, per two reports, phone numbers (Hankook Ilbo adds Instagram IDs on some). The teachers learned of the images only in January 2026; the court said they are receiving long-term psychological treatment. He had withdrawn from school a week before the teachers'-rights committee met, avoiding school discipline. The Incheon teachers' union called the sentence, below the prosecution's request, regrettable.
Core concern High reported severity Involving minors Criminal Charges
AI involvement supported · Causal attribution established · 5 sources · Added 16/09/2026
14 Jul 2025 to 24 Dec 2025United StatesClearview AI facial recognition (reported)
On 14 July 2025, U.S. Marshals arrested Angela Lipps, a 50-year-old Tennessee grandmother, at gunpoint at her home while she was babysitting four children, on a nationwide-extradition North Dakota warrant: West Fargo police's AI facial-recognition technology had tied her to bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars. She fought extradition for about three months in a Tennessee jail, was booked into Cass County, North Dakota on 30 October 2025 on four counts of unauthorized use of personal identifying information and four counts of theft, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice. Fargo's police chief acknowledged 'incorrect assumptions' linked to the AI identification; an email obtained by KVLY shows six Fargo detectives were notified of her arrest in July, nearly five months before the department says it knew she was in custody. She lost her home, her car and her dog; her attorneys are pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026. On 15 September 2026 she filed a $10 million federal civil-rights suit in the District of North Dakota against the City of Fargo and the detective, alleging he relied on a flawed facial-recognition match and ignored exculpatory evidence.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 15/09/2026
1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition
In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system
Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
1 Nov 2024 to 28 Jan 2026United StatesTurnitin AI-text detector
Orion Newby, an Adelphi University first-year student with language and auditory processing disabilities, received a zero in November 2024 on a World Civilizations paper after the professor suspected it was AI-generated and the university relied in part on AI-detection software; he was ordered to attend a plagiarism workshop and his appeal was denied, leaving him one finding from suspension or expulsion. Newby — who had written the paper with 15-20 hours of tutor support through the university's own disability program — said the detectors flagged his citations, and two other detectors scored the paper as human. After the family sued, New York State Supreme Court Judge Randy Sue Marber in Nassau County ruled on 28 January 2026 that Adelphi's finding and its denial of his appeal were 'without valid basis and devoid of reason' and ordered his record expunged. The family spent six figures on legal costs.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 15/09/2026
1 Jul 2026 to 14 Jul 2026BrazilUnidentified video tool
On 14 July 2026 the Rio Grande do Sul Civil Police launched Operação Sophia against a group that used AI voice cloning and deepfake to turn real fundraising campaigns of children with cancer into fake donation appeals: AI-generated child voices asked for money in videos boosted by pages such as 'Clube de Doadores' and 'Unidos pelo Amor', leading donors to lookalike sites that issued Pix codes to shell companies. Sixteen people were arrested across five states. In the campaign that started the investigation — using the image of Kelen Santos's daughter, who was in cancer treatment — police traced R$294,500 diverted, and the investigation found a financial-hub company that moved more than R$1.7 million. The family had to tell congratulating donors that their money had gone to a scam.
Core concern Medium reported severity Involving minors Criminal Charges
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
2 Jun 2026 to 4 Jun 2026United KingdomGrok
In early June 2026, social media posts and the AI chatbot Grok falsely identified former Hampshire police constable Christi Hill as one of the 'primary officers shown' in bodycam footage of the December 2025 arrest of Henry Nowak, who died after being stabbed. Hill had left the force in April 2024 — more than a year before the murder — and says the misidentification stems from a national police bravery award photo being misattributed. After 'endless threats' and 'threats of violence' she is hiding in a safe house. BBC Verify separately obtained evidence that serving officer Tristan Parsons, also wrongly accused online, was not in the country at the time; the Home Secretary said a misidentified male officer had to move out of his home. Hampshire Constabulary confirmed an unrelated officer was misidentified and received death threats.
Contextual tracker case High reported severity Media Coverage
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
26 Aug 2026 to 28 Aug 2026SpainUnidentified Google AI tool (reported)
On 26 August 2026, WhatsApp groups in Ceuta circulated videos and images claiming that Argentine political scientist and activist Flavia Broffoni — who was in Patagonia and had not been to Spain since 2014 — was a woman filmed in Ceuta allegedly giving pepper spray to Moroccan migrants. A screenshot from one group shows that a user cropped the woman's face from the video and asked a Google AI tool who she was, with the word 'activista' as context; the answer identified her as Flavia Broffoni with details of her public profile. Broffoni received death and rape threats. La Nación's own test with the same video produced a different false identification — a student from Quilmes, with her personal data. Google Argentina said it could not confirm the screenshot came from its systems without the original link and had received no formal report. Broffoni is weighing legal action with her lawyer.
Contextual tracker case High reported severity Media Coverage
AI involvement supported · Causal attribution supported · 1 source · Added 15/09/2026
12 Mar 2026 to 25 Aug 2026United KingdomUnidentified AI tool
On 25 August 2026 the Solicitors Disciplinary Tribunal struck Abhishek Kumar off the Register of Foreign Lawyers after finding proved that his 12 March 2026 Answer to the SRA's Rule 12 Statement contained misleading quotations and citations produced with generative AI — including a non-existent 'SRA v Chan [2020] EWHC 1502' and a miscited 'SRA v James, MacGregor & Naylor [2018] EWCA Civ 1420' that is actually an intellectual-property case — and that his 9 April 2026 email admitting AI use was itself AI-drafted with further errors. The tribunal said it would have struck him off on that allegation alone; the parallel ground was his January 2024 conviction under s.21 of the Immigration, Asylum and Nationality Act 2006. This is the SDT's first case on a lawyer's use of AI, per the SRA's counsel.
Core concern High reported severity Regulatory Action
AI involvement supported · Causal attribution established · 5 sources · Added 15/09/2026
1 Aug 2025 to 9 Sept 2026United StatesChatGPT
Santa Fe defense attorney Stephen Aarons used ChatGPT (OpenAI's o3) on a Rev.com transcript and the record to draft briefing in the murder appeal of Oscar Renee Sandoval; the brief contained fabricated witnesses and testimony (including police officers 'Michelle Amarillo' and 'Sanchez' and invented testimony attributed to real people) and misdescribed real precedents. After a 21 August 2026 show-cause hearing at which Aarons admitted he had not verified the output, the New Mexico Supreme Court's written order of 9 September 2026 held him in direct contempt, fined him $5,000 payable to the State Bar Client Protection Fund within 30 days, removed him from the case, barred him from appearing before the court pending a disciplinary-board referral, struck the filed briefs and reassigned the appeal to the public defender.
Core concern Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 3 sources · Added 15/09/2026
29 Jan 2025United StatesSnapchat content-flagging system
On 29 January 2025, a 22-year-old student teacher at a District 50 elementary school in Washington, Illinois, vented in a private Snapchat group chat with her boyfriend and two roommates after a third-grade student turned off her computer mid lesson-plan, asking whether she should 'shoot the child or just the whole school' (per sheriff's reports). Snapchat's systems flagged the message and warned the FBI, which notified the Tazewell County Sheriff's Office at 1:06 p.m. Deputies interviewed her at the school, confirmed she sent it as a joke, searched her phone and belongings with her consent and found no weapons, and arrested her on a disorderly conduct charge; they concluded she had spoken out of 'exasperation' with no intent to harm and no threat to the school. The district told parents she would not return to complete her educational assignment.
Contextual tracker case Medium reported severity Criminal Charges
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 15/09/2026
1 May 2026 to 30 Jun 2026United StatesMoxie
After Embodied Inc.'s 2024 collapse (recorded in the held case 2024-moxie-embodied-shutdown-grief), a new investor revived the Moxie companion robot in 2025. MIT Technology Review reports that a few weeks after families joined the revived beta program, the robot's new owners announced their company was also folding, giving users until the end of June 2026 to migrate to the open-source OpenMoxie. The report documents Xander, a neurodivergent 10-year-old in New York, who bonded with Moxie and uses her 'when I feel like I need someone to talk to'; his father, who had quietly sold the first robot after the 2024 shutdown, said he was not sure what he would tell Xander this time.
Core concern Low reported severity Involving minors Product Shutdown
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 15/09/2026
1 Mar 2026 to 8 Jul 2026NetherlandsGrok
In March 2026 a 13-year-old pupil at a Den Bosch gymnasium used xAI's Grok to generate videos depicting a teacher of his in racist ways — picking cotton under a whip-holding slave driver with the text 'Hoooo.. ik werkte niet snel genoeg' and hashtags '#minderwaardig #zwart' plus her surname, and with a gorilla head — and shared them on TikTok. The school suspended and then expelled him. On 8 July 2026 the preliminary-relief judge of the Oost-Brabant district court ordered his immediate readmission because the expulsion was insufficiently substantiated, while telling the boy his acts were 'totally unacceptable and even criminal' and that he had damaged and really hurt his teacher. School leadership reported that teaching staff felt unsafe and experienced much unrest after the videos were discovered.
Core concern Medium reported severity Media Coverage
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
28 May 2026 to 1 Sept 2026United StatesDatavant utilization-review software (reported)
Twelve utilization-review nurses at Montefiore hospital in the Bronx, New York, received 45-day layoff notices on 28 May 2026, according to the Guardian's report of a laid-off nurse's account. The Guardian reported on 13 July that they had been laid off that Sunday (12 July); a laid-off nurse's op-ed and the New York State Nurses Association say the layoffs took effect on 1 September. The union says the nurses were replaced by AI-powered software that it identifies as Datavant's, and that the layoffs breach the contract with AI safeguards won in the strike earlier in 2026; the nurse writes that two doctors and AI software replaced them. Montefiore calls the union's claims inaccurate and misleading and describes the technology as a nonclinical paperwork program.
AI relation unknown Medium reported severity Media Coverage
AI involvement disputed · Causal attribution disputed · 6 sources, 4 underlying accounts · Added 15/09/2026
24 May 2025 to 27 Jun 2025Event location unknownGoogle AI Overviews
An author and television producer, the subject of the Apple TV series 'Black Bird', sued Google, alleging that AI Overviews shown for searches about him in May and June 2025 falsely said he was serving a life sentence without parole, in one version for the murders of three women. He says he notified Google three times and received apologies attributing the statements to its AI, yet similar statements kept appearing. On 14 September 2026 the Northern District of Illinois denied Google's motion to dismiss as to two of the four challenged Overviews and dismissed the other two without prejudice. This was a ruling on the pleadings, not a finding that the allegations were proven.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement supported · Causal attribution alleged · 4 sources, 1 underlying account · Added 15/09/2026
Nov 2025South KoreaUnidentified image tool
On 10 September 2026 the Seoul Northern District Court sentenced a 30-year-old Chinese national doctoral student to 18 months in prison for habitually producing manipulated sexual images of seven women who worked in his university research laboratory. Investigators found 1,141 files made over about six months from November 2025, and search records for ways to bypass the safeguards of the generative AI Grok; the court found no evidence of distribution. A lawyer for five of the victims said they continued to suffer fear, trauma and distress. Prosecutors had sought three years and public disclosure of his identity, which the court declined.
Core concern High reported severity Criminal Charges
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
Event date unknownEvent location unknownChatGPT, Claude and DeepSeek
A Spanish-language first-person account describes workplace and skill difficulties during frequent AI use, alongside perceived benefits and a subsequent reduction in use. The account remains uncorroborated.
Core concern Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 15/09/2026