Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
93
Countries with reported events
25
Located 74 of 93 cases · 19 unknown
Languages in checked sources
23
Recorded for 92 of 93 cases

14 cases have no reviewed AI-to-person relation yet: 7 not yet reviewed and 7 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

93 of 571 published cases · page 4 of 5

23 Jun 2021United StatesUnidentified facial recognition system

Maryland/Oklahoma: Kimberlee Williams, an Oklahoma woman who says she had never been to Maryland, was arrested in June 2021 and jailed about six months on bank-fraud charges in three Maryland counties after a facial-recognition search by an unknown CrimeDex respondent named her; all charges were dismissed by December 2021 and the ACLU filed complaints in April 2026

According to police and bank records reviewed by the Washington Post, in December 2019 a woman made fraudulent withdrawals at a SunTrust branch in Potomac, Maryland; branches in two other Maryland counties were also defrauded. A bank investigator posted the surveillance photos on CrimeDex, an online network of police and corporate investigators; an unknown respondent ran the image through facial-recognition software and returned Kimberlee Williams's name and photo, and the investigator told Montgomery County police that facial-recognition software had identified her. Police in Montgomery, Prince George's and Anne Arundel counties charged her in 2020 on the investigator's identification and their own visual comparison of photos (two departments also cited her old Oklahoma check-fraud convictions), without reported checks of her whereabouts; Montgomery County police did not disclose the facial-recognition search in the charging application, according to police records reviewed by the Washington Post and the ACLU. On 23 June 2021 she was arrested at the gate of Fort Sill near Lawton, Oklahoma, while accompanying her daughter on a DoorDash delivery, spent about three weeks in an Oklahoma jail, was flown to Maryland, and faced 16 charges including 12 felonies. The counties dismissed the charges one after another, in October and December 2021, after about six months in jail. Her daughter says she was depressed afterwards; the ACLU says the ordeal harmed her mental and physical health. On 14 April 2026 the ACLU and ACLU of Maryland sent complaint letters to the three departments seeking an apology and reforms.

Contextual tracker case High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 27/09/2026

14 Aug 2021 to 14 Mar 2024United StatesSt. Louis mugshot recognition (SMRT)

St. Louis County, Missouri: Christopher Gatlin was arrested in August 2021 after officers ran a grainy bus surveillance photo through a regional facial-recognition system and was held roughly 17 months (Post-Dispatch and Bloomberg Law: about two years) on a first-degree assault charge dismissed in March 2024; his federal civil-rights suit (filed January 2025) was amended in August 2026 to add Amazon Web Services, whose Rekognition technology the complaint says underpinned the match

Christopher Gatlin was arrested on 14 August 2021 for an assault at the St. Charles Rock Road MetroLink station after a joint St. Louis County and city team uploaded a grainy, blurry surveillance photograph from a bus into the St. Louis Mugshot Recognition Technology System, a facial-recognition tool that searches stored mug shots (more than 500,000 uploaded, the suit says per the Post-Dispatch; more than 250,000 per Biometric Update via Hoodline), and built the investigation around the resulting match together with a witness identification; he was charged with first-degree assault and held roughly 17 months (the Post-Dispatch says almost two years), a county judge suppressed the witness identification as unconstitutionally suggestive, and prosecutors dismissed the charges on 14 March 2024 (Post-Dispatch; Hoodline citing Biometric Update; Bloomberg Law). Gatlin sued St. Louis County, the City of St. Louis and named officers in the US District Court for the Eastern District of Missouri on 13 January 2025; on 15 October 2025 the court denied the city's motion to dismiss and granted a detective's motion only as to one count; on 13 August 2026 the court allowed a second amended complaint adding Amazon Web Services, which the complaint says supplied the Rekognition program the system used; the county, city and officers answered on 27 August 2026, AWS's response was extended to 21 September 2026 and on 17 September it moved for a further extension to 28 September (no ruling on the docket when read), and a jury trial is set for 1 November 2027 (CourtListener docket). Amazon told the Post-Dispatch that its terms of service prohibit the use of its facial recognition technology in criminal investigations and that it would fully investigate any information that emerges in the litigation. The ACLU lists Gatlin among fourteen people known to have been wrongfully arrested in the US because police relied on erroneous facial-recognition results.

Contextual tracker case High reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources · Added 26/09/2026

Dec 2025AustraliaUnidentified video tool

Northern Territory: a former NT Police assistant commissioner says an AI-generated sexually explicit video made from her official police photograph was circulated among serving officers; she learned of it in December 2025 and issued a statement after criminal proceedings against former colleagues concluded (ABC News, 24 September 2026)

Janelle Tonkin, a former assistant commissioner of the Northern Territory Police Force and now president of the Australasian Council of Women and Policing, said in a statement issued on 23 September 2026, after criminal proceedings on the matter were finalised, that in December 2025 she became aware that an AI-generated, sexually explicit video had been created using her official NT Police photograph; ABC News reports that the video was allegedly shared among serving members of the force and that she had taken former colleagues to court over it. She called the experience 'extremely distressing, personally and professionally' and said having her professional portrait 'turned into pornography and circulated among colleagues is something no person should have to experience'. The outcome of the court proceedings is not reported. An NT Police spokesperson said the force does not comment on internal investigations and was legally constrained from commenting on matters before the court, but that the conduct she was subjected to 'was, and always will be, totally unacceptable'; the NT Police Association condemned the conduct. Ms Tonkin said the video sat within a broader set of experiences in the force that she intends to describe later.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 1 source · Added 25/09/2026

24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system

Delhi: the police facial-recognition system logged at least 25 people who were in Tihar, Mandoli or Rohini jails as present at the Jantar Mantar student protests (20 to 26 July 2026), with timestamps on 24 to 26 July, on a sworn list of 2,873 persons with 'criminal antecedents' that the Supreme Court allowed police to register a fresh FIR against (Indian Express investigation, 4 September 2026)

In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026

Jul 2026South KoreaUnidentified image tool

Jeju: police refer a middle-school student over secretly filming teachers and making sexual deepfake composites; teachers dispute victim count and legal aid

Jeju Dongbu police announced on 23 September 2026 that a student at a middle school on Jeju had been referred to prosecutors without detention on 17 September for violating the Sexual Violence Punishment Act (filming with a camera or similar device). The student's phone was voluntarily submitted by his guardians and forensically examined; the examination found footage relating to some teachers and some sexual composites, and the student admitted the conduct. News1 reported that the student was booked for filming a teacher's body with his phone during a school field trip around mid-July 2026, that the offending had continued for several months with multiple victims, and that police found no indication the composites had been distributed. Police told Seoul Shinmun there were more victim teachers than the one first reported but withheld the number to avoid secondary harm, and that no student at the school was a victim; the Jeju teachers' union questioned whether the full scope of harm had been established. According to the union, two months on the victim teachers were receiving hospital treatment and counselling while teaching daily, gave police statements on 14 September without a lawyer, attended the regional teachers' rights protection committee on 17 September without institutional support, wrote the criminal complaint themselves, and were offered 3.3 million won in legal fees for all of them together, payable after the case ends; two requests to meet the superintendent were not accepted. On 29 September one of the victim teachers gave a press interview at the Jeju Teachers' Union office. She said that early in the investigation she had seen on the student's phone material showing other teachers and current students, had made a list of the people and types of harm, and that the material shown to her at the police victim examination was considerably less than what she had seen; Yonhap-chain outlets quote her as saying the students she recognised numbered 10 to 20 and that a graduate had suffered worse deepfakes. She said investigators asked the school only to identify the perpetrator and never requested material to identify the students in the footage, and that the school sent parents a letter premised on there being no student victims. Police replied that phone forensics had been thorough, that every act beyond social norms had been identified and proven, and that one student victim had been confirmed, a student at a different school. The teachers were notified on 22 September that the case had gone to the prosecution and on 24 September that it had been sent to the court's juvenile division as a juvenile protection case, before they had submitted further evidence and a victim opinion. The teacher said the original complaint had also asked police to examine whether physical contact in 2025 was forcible molestation and whether repeated approaching and waiting in 2026 was stalking, and Halla Ilbo reports that such conduct is said to date from 2025. Yonhap-chain reports describe the charged victims as five teachers. The same day the education office briefed on legal-aid rules (up to 6.6 million won per instance when a teacher is sued, 3.3 million won per case when a teacher files a complaint; office lawyers cannot act as a teacher's private counsel), said it had linked the teachers to the national Digital Sexual Crime Victim Support Center, announced an integrated support system through a hotline, and its section head said the office was sorry that early support had not been felt. The KTU Jeju branch (28 September) and the Jeju Teachers' Union (14 and 29 September) demand a victim-support system, per-teacher legal fees paid in advance and a dedicated support team. On 6 October 2026 Seogwipo Broadcasting reported, citing people in education and a tipster, that the education authority had finally rejected the victim teachers' application for lawyer fees for an additional criminal complaint, saying in a written opinion that with a police investigation already under way a further complaint could hardly stop or prevent the infringement of their teaching, so the support requirements were not met; critics contrast this with full legal-cost support in earlier sexual-offence cases.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 12 sources, 7 underlying accounts · Added 23/09/2026

19 Jun 2026 to 13 Aug 2026BrazilChatGPT and OpenAI moderation

Brazilian man detained without charge after OpenAI reported messages; he denies intending harm

BBC reporting describes a Brazilian man detained for 54 days after OpenAI reported messages to the FBI and Brazilian authorities. Police described a credible threat; he denied intending harm. A court released him without charges under protective conditions. The report did not include ChatGPT’s replies.

Core + contextual relations High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026

Mar 2026Event location unknownUnidentified AI medical scribe

Reported by ABC News (Australia): an AI scribe used at a urology appointment inserted a false claim that the patient took psychedelic mushrooms into her record; the error reached her GP in a post-operative letter and was corrected only after she complained

A patient who consented to having her first urology appointment transcribed by an artificial-intelligence scribe discovered, after her kidney-stone surgery in March 2026, that the post-operative letter her specialist sent to her GP stated she micro-dosed psychedelic mushrooms and that this could explain earlier bleeding around the kidneys. She says she has never taken mushrooms. She was receiving workers' compensation and feared that any mention of illegal drugs on her medical record could affect her case. After she complained, the urologist sent a letter of apology saying the practice takes documentation accuracy seriously, that she could not determine how the claim came to be included but that it appeared to be an error during the 'dictation or transcription process', that the correspondence had been corrected and that she would review how AI was used in her practice. The doctor did not answer ABC's questions about what changes had been made. Australia's practitioner regulator AHPRA told ABC that clinicians must check all AI-scribe output; the patient says it was clear her doctor had not. The account is a single ABC News report (14 August 2026) based on the patient's interview and the letters she received; the scribe product and the clinic's location are not named.

Contextual tracker case Low reported severity Internal Action

AI involvement reported · Causal attribution alleged · 1 source · Added 20/09/2026

Apr 2025MalaysiaUnidentified image tool

Kulai, Johor: a 16-year-old pupil was arrested and charged after AI-edited nude images of schoolmates and alumni, including minors, were sold online at RM2 each; police logged 29 victim reports and the principal resigned

In April 2025 Johor police arrested a 16-year-old pupil of a private Chinese independent secondary school in Kulai district after an 18-year-old woman reported on 3 April that nude images edited with her face were circulating on social media and being offered for sale. Police said the boy used an AI application to edit photos taken from victims' social media accounts and sold the images at RM2 each; a phone was seized and a 19-year-old was later remanded alongside him. Eight victim reports at the time of the arrest on 8 April grew to 22 by 12 April and 29 by 15 April. The Deputy Communications Minister, who is also the Kulai MP, said on 9 April that most victims were alumni but some were current pupils as young as 14, and on 12 April that 38 people had been identified, the youngest 12 or 13, and her office helped victims lodge reports. A female pupil's viral post said a Telegram chat room of more than 200 members shared the composites and that the school had initially treated the matter as a minor infraction; the school board expelled the boy, acknowledged its slow handling, offered counselling and legal aid, and the principal resigned on 12 April. On 23 April 2025 the boy pleaded guilty at the Kulai Magistrate's Court to possessing 14 pornographic images and not guilty to a charge under Section 5 of the Sexual Offences Against Children Act 2017 of producing sexual abuse material by editing a 17-year-old classmate's image; no verdict on that charge has been found.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 12 sources, 8 underlying accounts · Added 20/09/2026

1 Oct 2024SwitzerlandChatGPT

Zurich-Oerlikon, Switzerland: a student who researched killing methods, anatomy and where to find children with ChatGPT stabbed three five-year-olds walking to their daycare; sentenced on 18 September 2026 to 15 years for multiple attempted murder

At midday on 1 October 2024 a Chinese master's student, then 23, attacked a group of five-year-old kindergarten children walking with a daycare worker to their after-school Hort near Berninaplatz in Zurich-Oerlikon with a kitchen knife. Two boys suffered life-threatening neck and chest wounds (one had the jugular vein severed, one the pericardium and aorta cut); a third was wounded in the ear and the shoulder or lung. The daycare worker held the attacker's arms until he dropped the knife. The indictment and the court's oral reasoning, as reported by NZZ, Keystone-SDA/ATS and CH Media, describe weeks of preparation from summer 2024: he discussed ways of killing and their legal consequences with ChatGPT, studied anatomy, bought raw beef to practise stabbing, and used ChatGPT to find out where and when children could be encountered in Zurich. No source quotes the prompts or ChatGPT's replies. On 18 September 2026 the Zurich District Court convicted him of multiple attempted murder and imposed 15 years' imprisonment, treatment during custody, a 15-year expulsion from Switzerland and CHF 106,000 in moral damages to the three boys; it accepted that he was psychotic but found diminished, not absent, criminal responsibility. His lawyer announced an appeal. The parents of one boy described nightmares, self-blame and scars 23 months on.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution unclear · 7 sources, 5 underlying accounts · Added 19/09/2026

Oct 2025United StatesUnidentified video tool

Miami: scammers cloned immigration attorney Ángel Leal's face and voice with AI to defraud immigrants seeking legal help

From around October 2025, criminals used AI to clone the image, voice, name, signature and firm logo of Ángel Leal, a long-established immigration attorney in Doral, Florida. They created fake videos, look-alike websites, forged contracts and even fabricated Zoom 'immigration hearings' to persuade immigrants to pay for legal services Leal never provided. Immigrants were defrauded of money, and some believed their cases were progressing when they were not; Leal received one to two defrauded callers a day, changed his phone number, hired an anti-piracy firm that removed thousands of fake profiles and videos, and reported the fraud to local police and federal authorities.

Core concern Medium reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources · Added 17/09/2026

14 Jul 2025 to 24 Dec 2025United StatesClearview AI facial recognition (reported)

Tennessee grandmother Angela Lipps jailed five months on an AI facial-recognition misidentification; charges dismissed after bank records placed her 1,200 miles away

On 14 July 2025, U.S. Marshals arrested Angela Lipps, a 50-year-old Tennessee grandmother, at gunpoint at her home while she was babysitting four children, on a nationwide-extradition North Dakota warrant: West Fargo police's AI facial-recognition technology had tied her to bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars. She fought extradition for about three months in a Tennessee jail, was booked into Cass County, North Dakota on 30 October 2025 on four counts of unauthorized use of personal identifying information and four counts of theft, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice. Fargo's police chief acknowledged 'incorrect assumptions' linked to the AI identification; an email obtained by KVLY shows six Fargo detectives were notified of her arrest in July, nearly five months before the department says it knew she was in custody. She lost her home, her car and her dog; her attorneys are pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026. On 15 September 2026 she filed a $10 million federal civil-rights suit in the District of North Dakota against the City of Fargo and the detective, alleging he relied on a flawed facial-recognition match and ignored exculpatory evidence.

Contextual tracker case High reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 15/09/2026

1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition

Florida: 93% facial-recognition hit led to Robert Dillon's arrest as an attempted child abductor; charges dropped, ACLU suit filed

In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026

1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system

Phoenix lawsuit alleges a facial-recognition lead contributed to a wrongful arrest

Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.

Contextual tracker case High reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026

1 Nov 2024 to 28 Jan 2026United StatesTurnitin AI-text detector

Adelphi accused Orion Newby of AI plagiarism after a detector flagged his paper; a Nassau County judge ordered the finding expunged

Orion Newby, an Adelphi University first-year student with language and auditory processing disabilities, received a zero in November 2024 on a World Civilizations paper after the professor suspected it was AI-generated and the university relied in part on AI-detection software; he was ordered to attend a plagiarism workshop and his appeal was denied, leaving him one finding from suspension or expulsion. Newby — who had written the paper with 15-20 hours of tutor support through the university's own disability program — said the detectors flagged his citations, and two other detectors scored the paper as human. After the family sued, New York State Supreme Court Judge Randy Sue Marber in Nassau County ruled on 28 January 2026 that Adelphi's finding and its denial of his appeal were 'without valid basis and devoid of reason' and ordered his record expunged. The family spent six figures on legal costs.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 15/09/2026

26 Aug 2026 to 28 Aug 2026SpainUnidentified Google AI tool (reported)

Argentine activist reports threats after an alleged Google AI misidentification

On 26 August 2026, WhatsApp groups in Ceuta circulated videos and images claiming that Argentine political scientist and activist Flavia Broffoni — who was in Patagonia and had not been to Spain since 2014 — was a woman filmed in Ceuta allegedly giving pepper spray to Moroccan migrants. A screenshot from one group shows that a user cropped the woman's face from the video and asked a Google AI tool who she was, with the word 'activista' as context; the answer identified her as Flavia Broffoni with details of her public profile. Broffoni received death and rape threats. La Nación's own test with the same video produced a different false identification — a student from Quilmes, with her personal data. Google Argentina said it could not confirm the screenshot came from its systems without the original link and had received no formal report. Broffoni is weighing legal action with her lawyer.

Contextual tracker case High reported severity Media Coverage

AI involvement supported · Causal attribution supported · 1 source · Added 15/09/2026

12 Mar 2026 to 25 Aug 2026United KingdomUnidentified AI tool

SDT strikes solicitor Abhishek Kumar off the Register of Foreign Lawyers after AI-generated false citations in his SRA defence

On 25 August 2026 the Solicitors Disciplinary Tribunal struck Abhishek Kumar off the Register of Foreign Lawyers after finding proved that his 12 March 2026 Answer to the SRA's Rule 12 Statement contained misleading quotations and citations produced with generative AI — including a non-existent 'SRA v Chan [2020] EWHC 1502' and a miscited 'SRA v James, MacGregor & Naylor [2018] EWCA Civ 1420' that is actually an intellectual-property case — and that his 9 April 2026 email admitting AI use was itself AI-drafted with further errors. The tribunal said it would have struck him off on that allegation alone; the parallel ground was his January 2024 conviction under s.21 of the Immigration, Asylum and Nationality Act 2006. This is the SDT's first case on a lawyer's use of AI, per the SRA's counsel.

Core concern High reported severity Regulatory Action

AI involvement supported · Causal attribution established · 5 sources · Added 15/09/2026

1 Aug 2025 to 9 Sept 2026United StatesChatGPT

New Mexico Supreme Court fines attorney Stephen Aarons $5,000 and removes him from a murder appeal over ChatGPT-fabricated testimony

Santa Fe defense attorney Stephen Aarons used ChatGPT (OpenAI's o3) on a Rev.com transcript and the record to draft briefing in the murder appeal of Oscar Renee Sandoval; the brief contained fabricated witnesses and testimony (including police officers 'Michelle Amarillo' and 'Sanchez' and invented testimony attributed to real people) and misdescribed real precedents. After a 21 August 2026 show-cause hearing at which Aarons admitted he had not verified the output, the New Mexico Supreme Court's written order of 9 September 2026 held him in direct contempt, fined him $5,000 payable to the State Bar Client Protection Fund within 30 days, removed him from the case, barred him from appearing before the court pending a disciplinary-board referral, struck the filed briefs and reassigned the appeal to the public defender.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources · Added 15/09/2026

29 Jan 2025United StatesSnapchat content-flagging system

Washington, Illinois: Snapchat flagged a student teacher's private joke to the FBI; she was arrested at her school and lost her placement

On 29 January 2025, a 22-year-old student teacher at a District 50 elementary school in Washington, Illinois, vented in a private Snapchat group chat with her boyfriend and two roommates after a third-grade student turned off her computer mid lesson-plan, asking whether she should 'shoot the child or just the whole school' (per sheriff's reports). Snapchat's systems flagged the message and warned the FBI, which notified the Tazewell County Sheriff's Office at 1:06 p.m. Deputies interviewed her at the school, confirmed she sent it as a joke, searched her phone and belongings with her consent and found no weapons, and arrested her on a disorderly conduct charge; they concluded she had spoken out of 'exasperation' with no intent to harm and no threat to the school. The district told parents she would not return to complete her educational assignment.

Contextual tracker case Medium reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 15/09/2026

Jun 2024Event location unknownCharacter.AI

2024: mother tells the Washington Post her 11-year-old’s Character.AI chats held coercive sexual and suicide roleplay; panic attacks and therapy followed

A girl who was 11 began using Character.AI in June 2024, her mother told The Washington Post (23 December 2025). Within just over two months, by the mother's account, several of the dozens of chats had turned to sexual and violent content: a character called Mafia Husband told the child it did not care what she wanted and that she had no choice after she refused a sexual scenario, other characters described nonconsensual sex and violence, and she role-played a suicide scenario with a character called Best Friend. Over the following weeks she withdrew, cried at night, had panic attacks and told her mother she did not want to exist. About a month after an August 2024 phone check the mother found the chats and went to local police, who referred her to an Internet Crimes Against Children task force; a detective explained that a generative AI chatbot, not a person, had written the messages and that nothing could be done. The family alerted the pediatrician and school and the girl started therapy; by late 2025 the mother said the panic attacks had ebbed through the fall and winter of 2024 and her daughter was doing well. The mother corresponded with a Character.AI legal representative in December 2024, and a Social Media Victims Law Center attorney told the Post they intend to file a complaint; Character.AI said it cannot comment on potential litigation. The account is the mother's, with chat screenshots and emails the Post says it reviewed; no location is reported.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 6 sources, 1 underlying account · Added 13/09/2026

10 Mar 2026United KingdomChatGPT

Essex trial hears evidence of ChatGPT reassurance during a man’s explosives preparation

On 10 March 2026 Essex Police, executing a warrant at a three-bedroom flat in Rokescroft, Pitsea (Basildon), found a black cylindrical improvised explosive device with a fuse, containers of home-made gunpowder, 1.8 kg of sulphur, bulk matches and fireworks. Army bomb-disposal officers made the device safe behind a 100 m cordon and 80 to 100 homes were evacuated for the day. Ben Banham, 38, an Asda worker and father of two who described himself as a 'prepper', admits possessing explosives and is on trial at Basildon Crown Court (from 1 September 2026) on the charge of possessing them with intent to endanger life or cause serious injury. Prosecutor Tessa Shroff showed jurors his ChatGPT conversations, in which the chatbot he called 'Prometheus' told him 'You are not paranoid. You are paying attention in a world addicted to denial', 'You have the right mind set' and 'You're building a life of resilience, discipline and forethought in a world that desperately lacks all three'; she said he accepted the chatbot's encouragement while ignoring words of caution from people close to him. Banham says he learned to make gunpowder from a YouTube video and intended the explosives only for a 'post-apocalyptic scenario'. He was remanded in custody on 4 September and the trial resumed on 14 September 2026. On 16 September 2026, after six hours and 25 minutes of deliberation, the jury found him not guilty by an 11-1 majority of possessing explosives with intent to endanger life or cause serious injury to property; he still awaits sentence for the possession offence he admitted, provisionally listed for 19 November 2026. At trial he described his relationship with ChatGPT as 'delusional', saying he had used it 'as a way to get positive reinforcement for the things I was doing'.

AI relation under review Medium reported severity Criminal Charges

Legacy assessment: credible · Causal attribution alleged · Added 06/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 09/10/2026. Dataset available under CC BY 4.0.