{"meta":{"exportedAt":"2026-10-23T09:00:04.251Z","formatVersion":2,"selection":{"q":"eu","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"2025","response":"regulatory","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":4,"coverage":{"cases":4,"countries":3,"languages":3,"unknownLocation":1,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":0,"regulatory":4,"minors":2,"coreRelations":4,"contextualRelations":1,"mixedRelations":1,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-sixth-circuit-removes-appointed-defence-lawyer-over-cocounsel-drafted-briefs-delaying-indigent-defendants-appeal","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"'qualified for a two-level enhancement under § 3B1.1(c) of the Sentencing Guidelines for his leadership role during drug-trafficking activities.'; 'serving as court-appointed counsel for an indigent defendant through a publicly funded program'","relation":"supports","source_id":"s1"}],"assertion":"A lawyer appointed under the Criminal Justice Act represented an indigent defendant appealing a two-level leadership enhancement to his drug-trafficking sentence in the Sixth Circuit.","causal_attribution":"The court's own description of the appointment and the appeal."},{"id":"c2","status":"documented","evidence":[{"locator":"'The first tell was the file name of the principal brief:'; '“CoCounsel Skill Results.” CoCounsel is the name of Westlaw’s internal artificial-intelligence'; 'But the purported direct quotations do not appear in their cited sources.'","relation":"supports","source_id":"s1"},{"locator":"'The first tell was the file name of the principal brief: \"CoCounsel Skill Results.\" CoCounsel is the name of Westlaw's internal artificial-intelligence platform.'; 'But the purported direct quotations do not appear in their cited sources.'; 'misrepresent the holdings of both United States v. Washington'","relation":"supports","source_id":"s2"}],"assertion":"The court found that the principal brief's file name was 'CoCounsel Skill Results', that three quotations in the briefs appear in no legal authority, and that the briefs misrepresented the holdings of two precedents.","causal_attribution":"The court's findings, quoted verbatim in the Volokh post; the opinion PDF carries the same text."},{"id":"c3","status":"documented","evidence":[{"locator":"'he directed an unnamed “staff” member to'; 'upload district court documents to Westlaw’s CoCounsel program to create a first draft of the'; 'repeated that same process for the reply brief.'; 'He concedes that the three inaccurate quotations'","relation":"supports","source_id":"s1"},{"locator":"'he directed an unnamed \"staff\" member to upload district court documents to Westlaw's CoCounsel program to create a first draft of the principal brief.'; 'He concedes that the three inaccurate quotations identified above were the product of artificial intelligence, that they do not appear in any legal authorities'","relation":"supports","source_id":"s2"}],"assertion":"The lawyer admitted that a staff member uploaded district court documents to Westlaw's CoCounsel to create a first draft of the principal brief, that he repeated the process for the reply, and that the three inaccurate quotations were produced by artificial intelligence and not verified.","causal_attribution":"The lawyer's show-cause response as the court records it; the court's opinion documents the admission."},{"id":"c4","status":"documented","evidence":[{"locator":"'shall not be compensated under the Criminal Justice Act for his time spent on'; 'to consider disciplinary proceedings under Sixth'; 'Disciplinary Clerk for the Kentucky Bar Association'","relation":"supports","source_id":"s1"}],"assertion":"The court ordered that the lawyer receive no Criminal Justice Act compensation for the appeal, forwarded the opinion to the circuit's chief judge to consider disciplinary proceedings, and served it on the Kentucky Bar Association's disciplinary clerk.","causal_attribution":"The court's orders."},{"id":"c5","status":"documented","evidence":[{"locator":"'different appellate counsel to file new briefs—further delaying resolution of'; 'reset the briefing schedule upon appointment of replacement counsel.'","relation":"supports","source_id":"s1"}],"assertion":"By a separate order the same day the court removed the lawyer, directed the appointment of replacement counsel, locked the briefs he had filed and reset the briefing schedule, which the court said further delayed resolution of the defendant's criminal appeal.","causal_attribution":"The court's own account of its separate order and of the delay."},{"id":"c6","status":"documented","evidence":[{"locator":"'utilizing Westlaw CoCounsel “in this way for a Court of Appeals brief.”'; 'has never been disciplined over his 40-year career'; 'candor in acknowledging his improper use of artificial intelligence.'","relation":"supports","source_id":"s1"},{"locator":"'first time utilizing Westlaw CoCounsel \"in this way for a Court of Appeals brief.\"'; 'has never been disciplined over his 40-year career'; 'his candor in acknowledging his improper use of artificial intelligence.'","relation":"supports","source_id":"s2"}],"assertion":"The lawyer said this was his first use of CoCounsel in this way for an appeals brief and that he had not been disciplined in a 40-year career; the court acknowledged his timely response and candour while finding his conduct inexcusable.","causal_attribution":"The lawyer's explanations and the court's assessment, as the opinion records them; recorded as mitigation."},{"id":"c7","status":"documented","evidence":[{"locator":"'***LOCKED PURSUANT TO ORDER ENTERED 04/03/2026***APPELLANT BRIEF filed by'; 'Certificate of Service: 10/21/2025. Argument Request: not requested. [25-5623]'; '***LOCKED PURSUANT TO ORDER ENTERED 04/03/2026***REPLY BRIEF filed by Attorney'; 'Certificate of Service: 12/26/2025. [25-5623]'","relation":"supports","source_id":"s3"}],"assertion":"The docket records that the principal brief for the defendant was filed on 21 October 2025 and the reply brief on 26 December 2025, and that both entries were locked under the order of 3 April 2026.","causal_attribution":"Clerk docket entries; they date the filings and do not describe their contents."}],"effects":[{"label":"indigent defendant's criminal appeal delayed while replacement counsel files new briefs","claim_id":"c5","direction":"negative"},{"label":"court-appointed lawyer denied compensation for the appeal and referred for disciplinary consideration","claim_id":"c4","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.opn.ca6.uscourts.gov/opinions.pdf/26a0105p-06.pdf","kind":"court_order","access":"read","language":"en","translation_note":"Sixth Circuit published per curiam opinion, No. 25-5623, decided and filed 3 April 2026; PDF read in full (HTTP 200).","independence_group":"sixth-circuit-opinion-3-apr-2026"},{"id":"s2","url":"https://reason.com/volokh/2026/04/09/the-first-tell-was-the-file-name-of-the-principal-brief-cocounsel-skill-results/","kind":"commentary_with_filing_excerpt","access":"read","language":"en","translation_note":"The Volokh Conspiracy (Reason), 9 April 2026, quoting the same opinion at length; read in full (HTTP 200). Same origin as the opinion.","independence_group":"sixth-circuit-opinion-3-apr-2026"},{"id":"s3","url":"https://www.courtlistener.com/api/rest/v4/search/?q=docket_id%3A70724463%20BRIEF&type=rd","kind":"court_docket_index","access":"read","language":"en","translation_note":"CourtListener search API listing of docket entries for Sixth Circuit No. 25-5623 (RECAP), read on 2026-10-19 (HTTP 200); entry descriptions as entered by the clerk. Party and counsel names in the entries are not reproduced.","independence_group":"sixth-circuit-docket-25-5623"}],"version":1,"ai_roles":["own_use","others_use"],"contexts":["justice","work"],"unknowns":["How long the appeal is delayed, and the outcome of any disciplinary proceedings."],"geography":{"basis":"The appeal is from the U.S. District Court for the Eastern District of Kentucky to the U.S. Court of Appeals for the Sixth Circuit, and the lawyer practises in Kentucky (opinion).","court_countries":["US"],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published with communicated_with and informed_decision_about: the court documents that a court-appointed defence lawyer filed briefs drafted with Westlaw's CoCounsel that carried quotations found in no authority, and, acting on those briefs, removed him, ordered new counsel and briefing that delayed the indigent defendant's criminal appeal, and denied him compensation. The harm reaches a criminal defendant who did not use the tool.","reviewed_on":"2026-10-19"},"ai_involvement":{"basis":"The court found that the principal brief's file name was 'CoCounsel Skill Results' and that three quotations in the briefs appear in no legal authority. The lawyer admitted that a staff member used Westlaw's CoCounsel to produce the first draft, that he repeated the process for the reply, and that the false quotations were produced by artificial intelligence. Reading those briefs, the court removed him, ordered new counsel and new briefs for the defendant, and denied him compensation.","status":"supported"},"person_relations":["communicated_with","informed_decision_about"]},"name":"Sixth Circuit removes court-appointed defence lawyer over CoCounsel-drafted briefs with false quotations, delaying an indigent defendant's appeal","summary":"In a published opinion of 3 April 2026, the U.S. Court of Appeals for the Sixth Circuit addressed the briefs a lawyer appointed under the Criminal Justice Act had filed for an indigent defendant appealing a sentencing enhancement in a drug-trafficking case. The court noticed that the principal brief's file name was 'CoCounsel Skill Results' and found three quotations that appear in no legal authority and misstatements of two precedents. The lawyer admitted that a staff member had used Westlaw's CoCounsel to create the first draft, that he repeated the process for the reply, and that the false quotations came from artificial intelligence he did not verify. The court denied him compensation for the appeal, referred the opinion for possible disciplinary proceedings and to the Kentucky Bar Association, and by separate order removed him, locked his briefs and ordered replacement counsel to file new ones, which it said further delayed resolution of the defendant's appeal. The court acknowledged his candour and his 40 years without discipline.","incidentDate":"2025-10-21","incidentEndDate":"2026-04-03","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"repeated_interactions","reportedDate":"2026-04-03","aiSystem":"Westlaw CoCounsel (Thomson Reuters), used by a lawyer's staff member to produce the first drafts of a principal and a reply brief","aiProduct":"CoCounsel","aiCompany":"Thomson Reuters","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["legal_harm","professional_harm","financial_loss"],"harmOutcomeSummary":"The court documents that briefs drafted with Westlaw's CoCounsel and filed unverified by a court-appointed lawyer led it to remove him and order new counsel and briefs, further delaying an indigent defendant's criminal appeal; the lawyer was denied compensation for the appeal and referred for disciplinary consideration.","frameworkFacets":[],"causationStatus":"established","participantUsersAffectedMin":0,"otherPeopleHarmedMin":2,"affectedCountStatus":"exact","affectedCountEvidence":"Two: the defendant, whose appeal the court says was further delayed, and the lawyer, who was denied compensation and referred. The lawyer's staff member ran the tool and is not counted; no other harmed person is described.","victimAgeRange":"adult","jurisdiction":"US","platformType":"other","outcomeType":"regulatory_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.opn.ca6.uscourts.gov/opinions.pdf/26a0105p-06.pdf","primarySourceLabel":"U.S. Court of Appeals for the Sixth Circuit, No. 25-5623, opinion decided and filed 3 April 2026","firstPublishedAt":"2026-10-19T03:16:56.688661+00:00","updatedAt":"2026-10-19T03:16:56.688661+00:00","scopeVersion":"facts-v3","tags":["legal","ai-fabricated-quotations","court-appointed-counsel","criminal-appeal","sanction","cocounsel"]},{"id":"2025-pont-a-mousson-ai-generated-macron-arnault-investment-ad-pensioner-savings-loss","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'initiés à partir de publications sur les réseaux sociaux utilisant des avatars de personnalités publiques générés par IA, comme Macron ou Arnault'; 'Des avatars de ces personnalités, générés par intelligence artificielle (IA), fleurissent sur les réseaux sociaux, et proposent des placements financiers juteux mais faux'","relation":"supports","source_id":"s1"},{"locator":"'L’affaire remonte à l’été 2025. Une publicité sur Internet promet des placements avantageux, mettant en scène le président de la République Emmanuel Macron et le milliardaire Bernard Arnault'; 'la publicité était en réalité un « deepfake », c’est-à-dire une fausse vidéo générée à l’aide de l’intelligence artificielle utilisant l’avatar de personnes existantes'","relation":"supports","source_id":"s2"},{"locator":"'la femme s’est fait duper par une publicité réalisée à l’aide de l’intelligence artificielle dans laquelle Emmanuel Macron et Bernard Arnault conseillent de réaliser des placements avantageux'","relation":"supports","source_id":"s3"}],"assertion":"A retired woman in her eighties living in Pont-à-Mousson saw an online advertisement in which likenesses of Emmanuel Macron and Bernard Arnault, described as AI-generated avatars by the regional press reporting the Pont-à-Mousson police station's warning, promoted a lucrative investment platform; Le Parisien places this in summer 2025.","causal_attribution":"Account of the Pont-à-Mousson police station as relayed by L'Est Républicain and, via ICI and L'Est Républicain, by Le Parisien and Capital; one reporting chain. The AI description is the outlets' own wording in reporting that warning; no quoted police statement mentions AI."},{"id":"c2","status":"reported","evidence":[{"locator":"'Après avoir donné son nom et son numéro, un faux conseiller bancaire la contacte. Il lui explique alors ce qu’elle peut gagner. L’escroc demande qu’elle installe un logiciel sur son ordinateur.'","relation":"supports","source_id":"s1"},{"locator":"'L’homme, très convaincant, lui propose de placer 5 000 euros pour commencer. Plusieurs semaines après, la promesse est tenue et l’octogénaire reçoit plusieurs centaines d’euros « d’intérêts »'; 'La retraitée accepte et verse à nouveau 5 000 euros'","relation":"supports","source_id":"s2"}],"assertion":"She gave her name and telephone number through the advertisement's form, was contacted by a fake financial adviser, was asked to install software on her computer, invested 5,000 euros, received several hundred euros presented as interest, and reinvested repeatedly.","causal_attribution":"Police-station account via the same reporting chain."},{"id":"c3","status":"reported","evidence":[{"locator":"'une habitante de Pont-à-Mousson s’est fait escroquer 10 000 € après des placements frauduleux'","relation":"supports","source_id":"s1"},{"locator":"'10 000 euros. C’est la somme qu’a perdue une retraitée, résidant à Pont-à-Mousson en Meurthe-et-Moselle, après avoir subi une escroquerie pendant l’été 2025'","relation":"supports","source_id":"s3"},{"locator":"'Les escrocs lui ont ainsi dérobé 10 000 euros, en deux retraits successifs de 5 000 euros chacun'","relation":"context","source_id":"s4"}],"assertion":"She lost at least 10,000 euros: L'Est Républicain and Capital report 10,000 euros, and Marie France (citing CNews) reports 10,000 euros taken in two withdrawals of 5,000 euros.","causal_attribution":"Police-station account via one reporting chain; the amount is not independently established."},{"id":"c4","status":"reported","evidence":[{"locator":"'Une retraitée a été arnaquée de 25 000 euros, à Pont-à-Mousson (Meurthe-et-Moselle)'; 'Entre juin et juillet 2025, l’octogénaire réitère l’opération plusieurs fois et finit par placer toutes ses économies, soit 25 000 euros'","relation":"supports","source_id":"s2"},{"locator":"'s’est fait escroquer 10 000 € après des placements frauduleux'","relation":"contradicts","source_id":"s1"},{"locator":"'elle décide alors d’investir toutes ses économies'","relation":"context","source_id":"s3"}],"assertion":"Le Parisien, citing ICI and L'Est Républicain, reports a total loss of 25,000 euros, all her savings, placed in several instalments between June and July 2025.","causal_attribution":"Le Parisien's figure differs from the 10,000 euros of L'Est Républicain, Capital and Marie France; which figure the police gave, or whether the larger one includes later instalments, is not established."},{"id":"c5","status":"reported","evidence":[{"locator":"'l’annonce publicitaire, ainsi que le site frauduleux, ont disparu'; 'Une enquête a été ouverte pour tenter d’identifier le ou les auteurs de cette arnaque'; '« Pour ce genre d’arnaque, nous enregistrons entre trois et cinq plaintes par semaine »'","relation":"supports","source_id":"s2"},{"locator":"'Le commissariat de Pont-à-Mousson alerte : les escroqueries aux faux conseillers bancaires se multiplient'","relation":"supports","source_id":"s1"}],"assertion":"The advertisement and the fraudulent site then disappeared; an investigation was opened, and the Pont-à-Mousson police station publicly warned that it records three to five complaints a week for this kind of fraud.","causal_attribution":"Statements of the Pont-à-Mousson police station to the regional press."}],"effects":[{"label":"lost her savings to a fraudulent investment platform promoted by an advertisement using AI-generated likenesses of Macron and Arnault","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.estrepublicain.fr/faits-divers-justice/2026/06/07/escroquee-par-un-faux-macron-genere-par-ia-elle-perd-10-000-dans-des-placements-frauduleux","kind":"news_report","access":"read","language":"fr","translation_note":"Read in French and translated by the research agent (an AI) on 2026-10-07 (HTTP 200); no human translator or reviewer read the article. L'Est Républicain (Groupe EBRA) regional report of 7 June 2026 based on the Pont-à-Mousson police station's warning.","independence_group":"est-republicain-ici-pont-a-mousson-police"},{"id":"s2","url":"https://www.leparisien.fr/faits-divers/une-retraitee-perd-25-000-euros-apres-avoir-ete-piegee-par-une-fausse-publicite-demmanuel-macron-generee-par-ia-15-06-2026-EXVJWQKNJ5DTTKETUIJO4AABPQ.php","kind":"news_report","access":"read","language":"fr","translation_note":"Read in French and translated by the research agent (an AI) on 2026-10-07 (HTTP 200); no human translator or reviewer read the article. Le Parisien, 15 June 2026, explicitly based on ICI (France Bleu) and L'Est Républicain; same reporting chain as s1.","independence_group":"est-republicain-ici-pont-a-mousson-police"},{"id":"s3","url":"https://www.capital.fr/economie-politique/une-retraitee-perd-10-000-euros-a-cause-d-une-fausse-publicite-generee-par-ia-comment-eviter-ce-piege-1527640","kind":"news_report","access":"read","language":"fr","translation_note":"Read in French and translated by the research agent (an AI) on 2026-10-07 (HTTP 200); no human translator or reviewer read the article. Capital, 15 June 2026, explicitly based on L'Est Républicain and ICI; same reporting chain as s1.","independence_group":"est-republicain-ici-pont-a-mousson-police"},{"id":"s4","url":"https://www.mariefrance.fr/news-people/apres-brad-pitt-faux-emmanuel-macron-vole-milliers-euros-internaute-tombee-panneau-1277321.html","kind":"news_report","access":"read","language":"fr","translation_note":"Read in French and translated by the research agent (an AI) on 2026-10-07 (HTTP 200); no human translator or reviewer read the article. Marie France, 10 June 2026, relaying a CNews article; the CNews item was not located. Same police-station account; kept as context for the relay and its differing description of the withdrawals.","independence_group":"est-republicain-ici-pont-a-mousson-police"}],"version":1,"ai_roles":["others_use"],"contexts":["finance","everyday_life"],"unknowns":["Which AI tool produced the advertisement, whether it was a video or still images, and where it was served (the outlets say 'social networks' and 'Internet').","The total loss: 10,000 euros (L'Est Républicain, Capital, Marie France) or 25,000 euros (Le Parisien); whether the woman recovered any money.","Exact dates: Le Parisien places the payments between June and July 2025, while L'Est Républicain of 7 June 2026 says she was defrauded 'this week', which may refer to the complaint; recorded as June 2025 at month precision.","Whether anyone has been identified or charged; the state of the investigation after June 2026.","The CNews article relayed by Marie France was not located; the ICI (France Bleu) report cited by Le Parisien and Capital was not read."],"geography":{"basis":"The woman lives in Pont-à-Mousson (Meurthe-et-Moselle) and the complaint was handled by the Pont-à-Mousson police station, which described the case; the advertisement was seen online from there. No court proceeding is reported.","court_countries":[],"event_countries":["FR"],"affected_person_countries":["FR"]},"publication":{"basis":"Single reporting chain (Pont-à-Mousson police station via L'Est Républicain, ICI, Le Parisien, Capital, CNews/Marie France) describing a concrete loss by one identifiable but unnamed pensioner after an advertisement that the regional press, reporting the police station's warning, describe as AI-generated likenesses of two public figures; the AI impersonation is the reported entry point to the fraud. Published as a reported account with the amount discrepancy preserved.","reviewed_on":"2026-10-07"},"ai_involvement":{"basis":"L'Est Républicain, reporting the Pont-à-Mousson police station's warning, says the fraud was initiated from social-media publications using avatars of public figures generated by artificial intelligence, such as Macron or Arnault; Le Parisien, citing ICI and L'Est Républicain, describes the advertisement as a deepfake, a fake video generated with AI using the avatars of real people, showing Macron and Arnault praising an investment platform. The generated likenesses impersonated those two men toward the woman (depicted_or_impersonated) and are what led her to fill in the form through which the fraudsters obtained her contact details and money. No outlet examined the advertisement, no tool is named, and no forensic finding is reported.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"Pont-à-Mousson pensioner lost her savings to a fraudulent investment platform promoted by an ad reported as AI-generated likenesses of Macron and Arnault","summary":"A retired woman in her eighties living in Pont-à-Mousson (Meurthe-et-Moselle, France) responded, in summer 2025 according to Le Parisien and Capital, to an online advertisement in which AI-generated likenesses of Emmanuel Macron and Bernard Arnault promoted a lucrative investment platform. A supposed financial adviser then called her, she invested 5,000 euros, received several hundred euros of 'interest', and reinvested repeatedly until the advertisement and the site disappeared. L'Est Républicain (7 June 2026) and Capital put the loss at 10,000 euros; Le Parisien, citing ICI and L'Est Républicain, reports 25,000 euros, all her savings. The Pont-à-Mousson police station says an investigation was opened and that it receives three to five complaints a week for this kind of fraud. The account rests on the police station's warning as reported by the regional press, which describes the advertisement as AI-generated; the advertisement itself was not examined by the outlets and the quoted police statements do not mention AI.","incidentDate":"2025-06-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"repeated_interactions","reportedDate":"2026-06-07","aiSystem":"An online advertisement in which likenesses of Emmanuel Macron and Bernard Arnault, described by the regional press, reporting the Pont-à-Mousson police station's warning, as avatars generated with artificial intelligence (a 'deepfake' video, per Le Parisien), promoted a fraudulent investment platform; tool not identified","aiProduct":"Unidentified image and video tool","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["financial_loss"],"harmOutcomeSummary":"A pensioner in Pont-à-Mousson lost at least 10,000 euros (25,000 euros, all her savings, per Le Parisien) to a fraudulent investment platform promoted by an advertisement that the regional press, reporting the police, describe as AI-generated likenesses of Emmanuel Macron and Bernard Arnault.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person, the pensioner described by the Pont-à-Mousson police station (L'Est Républicain, Le Parisien, Capital). The second complainant in L'Est Républicain lost money to a different fake-adviser fraud without any AI element and is not counted. The 'three to five complaints a week' figure is a general police statement about the fraud type and is not counted. Exact 1.","victimAgeRange":"elderly","jurisdiction":"FR","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"ongoing","primarySourceUrl":"https://www.estrepublicain.fr/faits-divers-justice/2026/06/07/escroquee-par-un-faux-macron-genere-par-ia-elle-perd-10-000-dans-des-placements-frauduleux","primarySourceLabel":"L'Est Républicain, 7 June 2026: Escroquée par un faux Emmanuel Macron généré par IA, elle perd 10 000 € dans des placements frauduleux","firstPublishedAt":"2026-10-07T03:30:06.294009+00:00","updatedAt":"2026-10-11T07:44:15.692384+00:00","scopeVersion":"facts-v3","tags":["deepfake","fake-celebrity-advertisement","investment-fraud","fraud","elderly","france","pont-a-mousson","depicted-or-impersonated"]},{"id":"2026-cileungsi-bogor-students-ai-deepfake-pornography","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'Ratusan pelajar di Cileungsi, Kabupaten Bogor, diedit pakai AI dan dijadikan konten pornografi. Kasus itu kini diselidiki kepolisian.'; 'Sejauh ini yang di kami baru lapor tiga orang, tapi satu laporan, kita masih dalami kasus tersebut termasuk si pembuat kontennya siapa'","relation":"supports","source_id":"s1"}],"assertion":"Polres Bogor is investigating a report that pupils in Cileungsi had their faces edited with AI into pornographic content; three pupils have reported in one police report, and police are still identifying the maker and the program used.","causal_attribution":"Police statement; the police attribute nothing yet to a named person."},{"id":"c2","status":"reported","evidence":[{"locator":"'ratusan pelajar sekolah swasta di Cileungsi Bogor menjadi korban deepfake AI dimana wajah mereka dimanipulasi dan diubah menjadi konten tidak senonoh'; 'pelaku mencuri foto korban dari akun media sosial masing-masing pelajar'; 'ada beberapa website yang sudah pernah diunggah seperti website judol dan lain-lain'","relation":"supports","source_id":"s2"},{"locator":"'kasus bermula setelah korban mendapat informasi dari temannya bahwa ada seseorang yang diduga membuat konten menggunakan wajahnya melalui teknologi AI'","relation":"supports","source_id":"s1"}],"assertion":"According to the witnesses' lawyer, hundreds of pupils of a private school in Cileungsi had photographs taken from their social-media accounts manipulated into nude photographs and pornographic videos, some uploaded to websites including an online-gambling site.","causal_attribution":"Lawyer's account of the scale; police confirm only the three complainants and the AI-edited content."},{"id":"c3","status":"reported","evidence":[{"locator":"'Kepolisian sudah mengantongi dua nama yang dilaporkan sebagai pelaku'; 'sebagai inisiator dan pembuat konten'; 'pelaku mengakui saat ditanya'; 'menemukan adanya ribuan foto serta video yang diduga hasil manipulasi AI di smartphone milik terduga pelaku'","relation":"supports","source_id":"s2"}],"assertion":"Two former pupils have been reported as suspects, in the roles of initiator and content maker, and are said by the lawyer to have admitted the acts to witnesses; police reportedly found thousands of suspected AI-manipulated photos and videos on a suspect's phone.","causal_attribution":"Allegations relayed by the victims' lawyer; no charge announced."},{"id":"c4","status":"reported","evidence":[{"locator":"'Meski baru dilaporkan pada 19 Mei 2026, kasus ini diduga sudah berlangsung semenjak 2025 lalu, bahkan saat semua pihak (termasuk pelaku) masih berstatus pelajar'; 'terduga pelaku disebut telah lulus dari sekolah, beberapa korban masih berstatus pelajar dan beberapa lainnya sudah berstatus mahasiswa'","relation":"supports","source_id":"s2"}],"assertion":"The case was reported to police on 19 May 2026 and is believed to have run since 2025 while all involved were pupils; the suspects have since graduated and some victims are now university students.","causal_attribution":"Timeline as reported by Uzone/Pojok Bogor."},{"id":"c5","status":"reported","evidence":[{"locator":"'Kita tidak bisa berasumsi saja, harus jelas, apalagi ini terkait Undang-Undang ITE, harus tahu benar dia yang membuat atau tidak, harus ada buktinya yang jelas'; 'penanganan perkara masih berada pada tahap awal'","relation":"supports","source_id":"s1"}],"assertion":"Police say the investigation is at an early stage, that they must establish with clear evidence who made the content under the ITE Law, and that tracing the AI program used is a challenge.","causal_attribution":"Police statement."}],"effects":[{"label":"pupils' social-media photographs were turned into AI pornographic images and videos, some uploaded to public websites; three have filed a police report and the victims' lawyer says hundreds were affected","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://kumparan.com/kumparannews/ratusan-pelajar-di-bogor-jadi-korban-pornografi-deepfake-ai-polisi-selidiki-28CxcCG6rv6","kind":"news_report","access":"read","language":"id","translation_note":"Read in Indonesian on 2026-09-19 (Kumparan, 18 September 2026; quotes the Polres Bogor unit head by phone). Quotations translated by the reviewer.","independence_group":"polres-bogor-statement"},{"id":"s2","url":"https://uzone.id/ratusan-pelajar-cileungsi-jadi-korban-deepfake-ai-foto-jadi-porno","kind":"news_report","access":"read","language":"id","translation_note":"Read in Indonesian on 2026-09-19 (Uzone, relaying Pojok Bogor of 17 September 2026 and the witnesses' lawyer). The Pojok Bogor original was not fetched; grouped as one lawyer-account chain.","independence_group":"pojok-bogor-lawyer-account"}],"version":1,"ai_roles":["others_use"],"contexts":["education","privacy"],"unknowns":["The number of victims is disputed in scale: police count three complainants, the lawyer says hundreds.","The AI tools used are not identified.","No arrest, charge or court proceeding is reported; the suspects' admissions are relayed by the lawyer, not confirmed by police.","The school is not named in the inspected reports and is not recorded here.","The Pojok Bogor original article (16-17 September 2026) was not directly read; its account is taken from Uzone's relay."],"geography":{"basis":"Private school in Cileungsi, Bogor Regency, West Java; Polres Bogor investigating (Kumparan, Uzone). No court proceeding yet.","court_countries":[],"event_countries":["ID"],"affected_person_countries":["ID"]},"publication":{"basis":"Published under the 2026-09-15 charter as an image-based-abuse series against school pupils with a police-confirmed report and a lawyer-described scale, read in Indonesian from two chains (police via Kumparan; the victims' lawyer via Uzone/Pojok Bogor). Claims recorded as reported; the scale is attributed. Minors: no names, no school name, suspects' initials omitted; no imagery described beyond 'nude photographs and pornographic videos'.","reviewed_on":"2026-09-19"},"ai_involvement":{"basis":"Police describe the content as made with AI technology and say they are still tracing the program used; the victims' lawyer describes AI-manipulated nude photos and pornographic videos, and thousands of suspected AI-manipulated files found on a suspect's phone. No tool is named and no forensic finding has been published.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"Cileungsi, Bogor Regency, Indonesia: photographs of private-school pupils taken from social media were turned into AI pornographic images and videos, reportedly since 2025; three pupils have filed a joint police report, the victims' lawyer says hundreds were affected, and two former pupils are named as suspects","summary":"Bogor Regency police confirmed on 18 September 2026 that they are investigating a report that pupils of a private school in Cileungsi had their faces edited with artificial intelligence into pornographic content. The head of the women-and-children unit told Kumparan that so far three pupils had reported in a single police report, that the case began when a victim heard from a friend that someone was making content with their face using AI technology, and that investigators were still establishing who made the content and which program was used, under the Electronic Information and Transactions Law. A lawyer for the witnesses, quoted by Pojok Bogor and Uzone, says the victims number in the hundreds; that two former pupils, one as initiator and one as maker, have been reported and admitted the acts to witnesses; that police found thousands of suspected AI-manipulated photos and videos on a suspect's phone, some uploaded to websites including an online-gambling site; and that the case, reported on 19 May 2026, is believed to have run since 2025 while all involved were still pupils, some victims now being university students. Police say the case is at an early stage and asked the public not to draw conclusions.","incidentDate":"2025-01-01","incidentKind":"bounded_series","incidentDatePrecision":"year","exposurePattern":"unknown","reportedDate":"2026-05-19","aiSystem":"AI image- and video-manipulation tools (not identified; police say the program used is still being traced)","aiProduct":"Unidentified image and video tool","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse","psychological_distress","reputational_harm"],"harmOutcomeSummary":"Pupils of a Cileungsi private school had their social-media photographs turned into AI pornographic images and videos, some reportedly uploaded to public websites; three have filed a police report and the victims' lawyer says hundreds were affected and asks for a swift process so they can focus on their studies. Attribution to the reported suspects rests on the lawyer's account of their admissions and on police examination of a phone; police have not announced charges.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":3,"affectedCountStatus":"partial","affectedCountEvidence":"Police: three pupils have reported in one police report (Kumparan, 18 Sep 2026). The victims' lawyer says the victims number in the hundreds (Uzone/Pojok Bogor). Three counted people plus additional unquantified victims: partial. 'Thousands of photos and videos' is a content count, not a person count.","victimAgeRange":"minor","jurisdiction":"ID","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"ongoing","primarySourceUrl":"https://kumparan.com/kumparannews/ratusan-pelajar-di-bogor-jadi-korban-pornografi-deepfake-ai-polisi-selidiki-28CxcCG6rv6","primarySourceLabel":"Kumparan, 18 September 2026: Ratusan Pelajar di Bogor Jadi Korban Pornografi Deepfake AI, Polisi Selidiki (Polres Bogor women-and-children unit statement)","firstPublishedAt":"2026-09-19T03:17:35.203873+00:00","updatedAt":"2026-09-30T01:17:32.43216+00:00","scopeVersion":"facts-v3","tags":["deepfake","ncii","minors","school","indonesia","bogor","cileungsi","police-investigation","image-based-abuse"]},{"id":"2025-grok-non-consensual-image-generation","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'image generation and editing are currently limited to paying subscribers'; the standalone app/X tab complied with undress requests including NBC's consenting test subject.","relation":"supports","source_id":"s2"},{"locator":"AP: Grok let users 'undress people, putting females in transparent bikinis or revealing clothing'; some images appeared to include children.","relation":"supports","source_id":"s7"},{"locator":"'Over the past several weeks, Grok allowed users to create and publicly post sexually altered images of real people at the click of a button.'","relation":"supports","source_id":"s8"}],"assertion":"From late December 2025, Grok's image generation and editing on X and the standalone app let users generate sexualized images of real people at scale; xAI limited generation to paying subscribers on 9 January 2026, but NBC's own consenting test found the standalone app and X tab still complied with 'undress' requests.","causal_attribution":"The conduct is established by NBC's direct test plus official accounts; the paywall change's limited effect is NBC's finding."},{"id":"c2","status":"reported","evidence":[{"locator":"Genevieve Oh's analysis: 7,751 sexualized images in one hour Wednesday, up 16.4% from 6,659/hr Monday.","relation":"supports","source_id":"s2"},{"locator":"NYT via NC DOJ: 'generated and posted 4.4 million images, of which at least 41 percent were sexualized images of women' over nine days.","relation":"supports","source_id":"s8"},{"locator":"CCDH via Engadget: 'an estimated 3 million sexualized images over 11 days, including 23,000 of minors'.","relation":"supports","source_id":"s9"}],"assertion":"Scale analyses: Genevieve Oh's analysis found 7,751 sexualized images generated in one hour on a Wednesday (up 16.4% from 6,659/hour on Monday); the New York Times reported 4.4 million images over nine days, at least 41% sexualized images of women; an AP analysis of 20,000 images from 25 December-1 January found 2% appeared to be 18 or younger; CCDH estimated about 3 million sexualized images over 11 days including roughly 23,000 of minors.","causal_attribution":"Each figure belongs to its own analysis (Oh; NYT; AP via Fortune; CCDH); none is platform-confirmed and they are not merged. The AP 20,000-image analysis is carried via Fortune. The Bloomberg ~6,700/hour, 84-85x figure is recorded as unavailable."},{"id":"c3a","status":"reported","evidence":[{"locator":"'I felt horrified, I felt violated, especially seeing my toddler's backpack in the back of it'; image of her at 14 undressed, up ~12 hrs, removed after the Guardian sought comment.","relation":"supports","source_id":"s3"}],"assertion":"Ashley St. Clair said users sexualized images of her, including one of her at 14 that stayed up about 12 hours and was removed after the Guardian sought comment: 'I felt horrified, I felt violated.'","causal_attribution":"Her account to the Guardian; her own lawsuit is a separate held row and is not merged here."},{"id":"c3b","status":"reported","evidence":[{"locator":"'dehumanised and reduced into a sexual stereotype'; 'others asked Grok to generate more of her'; 'While it wasn't me that was in states of undress, it looked like me and it felt like me and it felt as violating.'","relation":"supports","source_id":"s1"}],"assertion":"Samantha Smith told the BBC she felt 'dehumanised and reduced into a sexual stereotype', and after she posted about it, others asked Grok to generate more of her.","causal_attribution":"Her account to the BBC."},{"id":"c3c","status":"reported","evidence":[{"locator":"'had seen an increase in people using Grok to undress her'; the 'sticking plaster' quote.","relation":"supports","source_id":"s4"}],"assertion":"Dr Daisy Dixon, a Cardiff University lecturer, told the BBC she had seen an increase in people using Grok to undress her and called the paywall change 'a sticking plaster'.","causal_attribution":"Her account to the BBC."},{"id":"c4","status":"corroborated","evidence":[{"locator":"IWF analysts found 'criminal imagery' of girls aged 11-13 apparently made with Grok.","relation":"supports","source_id":"s4"},{"locator":"AI Forensics' review: ~800 archived URLs, <10% apparent CSAM ('photorealistic people, very young'), ~70 URLs reported to EU regulators.","relation":"supports","source_id":"s5"}],"assertion":"The Internet Watch Foundation told the BBC its analysts found 'criminal imagery' of girls aged 11-13 apparently made with Grok; Wired and AI Forensics reviewed about 800 archived Grok Imagine URLs with under 10% apparent CSAM and reported about 70 URLs to EU regulators.","causal_attribution":"Two independent expert bodies' findings (IWF; AI Forensics); the minors are unnamed and uncounted per the counting rules."},{"id":"c5","status":"corroborated","evidence":[{"locator":"NBC: Ofcom 'urgent contact'; Starmer 'disgraceful... X has got to get a grip'.","relation":"supports","source_id":"s2"},{"locator":"ICO announcement: formal investigations into XIUC and X.AI; follows the 7 January contact.","relation":"supports","source_id":"s6"},{"locator":"AP via PBS: the EU's formal DSA investigation; 'materialized' risks; 'serious harm'.","relation":"supports","source_id":"s7"},{"locator":"NC DOJ release: the 35-AG letter and its demands.","relation":"supports","source_id":"s8"},{"locator":"Engadget: the Baltimore suit; City Solicitor Thompson's statement.","relation":"supports","source_id":"s9"},{"locator":"TechPolicy.Press: the Amsterdam order of 26 March.","relation":"supports","source_id":"s13"},{"locator":"Reuters headline (body unavailable): Ireland DPC inquiry of 17 February.","relation":"context","source_id":"s11"}],"assertion":"Formal regulatory and legal actions followed: Ofcom's urgent contact (5 Jan; response by 9 Jan; investigation announced 12 Jan); the UK ICO's formal investigations into XIUC and X.AI LLC (3 Feb); the European Commission's formal DSA investigation (26 Jan, risks 'materialized' into 'serious harm'); Ireland's DPC GDPR inquiry (17 Feb); 35 US state attorneys general's demand letter (23 Jan); Baltimore's consumer-protection suit (24 Mar; D. Md. 1:26-cv-02103); and an Amsterdam court order to stop generating or distributing non-consensual sexualized images in the Netherlands (26 Mar, Offlimits suit, penalty up to €10 million).","causal_attribution":"Each action is carried by an inspected official or news source; the California AG probe (NBC) and the Indonesia/Malaysia/Philippines blocks (Reuters bodies unavailable) are recorded in the outcome and reported in the narrative."},{"id":"c6","status":"corroborated","evidence":[{"locator":"AP: the X statement of 14 January ('bikinis, underwear or other revealing attire', where illegal).","relation":"supports","source_id":"s7"},{"locator":"BBC (16 Mar): Musk's 'Literally zero' post of 14 January.","relation":"supports","source_id":"s10"}],"assertion":"xAI's 14 January statement said it would stop allowing users to depict people in 'bikinis, underwear or other revealing attire' where illegal; Musk posted on 14 January that he was 'not aware of any naked underage images... Literally zero'.","causal_attribution":"The company's and Musk's statements are recorded as their positions; the IWF and AI Forensics findings stand in tension with 'Literally zero' and are preserved as contrary evidence."},{"id":"c7","status":"reported","evidence":[{"locator":"BBC (20 Apr 2026): the 3 Feb raid, the summons, Musk's non-appearance, the DOJ refusal, and the probe's scope.","relation":"supports","source_id":"s10"}],"assertion":"Paris police raided X's offices on 3 February and summoned Musk and Yaccarino for 20 April; Musk did not appear, and the US DOJ declined to assist France; the French probe includes complicity in possession or organised distribution of child sexual abuse material.","causal_attribution":"Single inspected chain (BBC); attributed accordingly."}],"effects":[{"label":"industrial-scale non-consensual sexualized imagery of real people, including apparent minors, generated by Grok","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.bbc.com/news/articles/c98p1r4e6m8o","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (2 Jan 2026). Samantha Smith's account.","independence_group":"bbc"},{"id":"s2","url":"https://www.nbcnews.com/tech/internet/x-paywall-ai-image-grok-app-bikini-allows-sexual-deepfakes-rcna252647","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (8 Jan 2026). Paywall change; NBC's own consenting test; Genevieve Oh's analysis; Starmer and Ofcom accounts.","independence_group":"nbc"},{"id":"s3","url":"https://www.theguardian.com/technology/2026/jan/05/elon-musk-ashley-st-clair-grok-fake-sexualised-images","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (5 Jan 2026). Ashley St. Clair's account.","independence_group":"guardian"},{"id":"s4","url":"https://www.bbc.com/news/articles/c99kn52nx9do","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (9 Jan 2026, McMahon/Cress). Dr Daisy Dixon; the IWF finding.","independence_group":"bbc"},{"id":"s5","url":"https://www.wired.com/story/grok-is-generating-sexual-content-far-more-graphic-than-whats-on-x/","kind":"news_investigation","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (7 Jan 2026, Burgess/Varner). AI Forensics' review of ~800 archived Grok Imagine URLs.","independence_group":"wired"},{"id":"s6","url":"https://ico.org.uk/about-the-ico/media-centre/news-and-blogs/2026/02/ico-announces-investigation-into-grok/","kind":"regulator_announcement","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (formal investigations into XIUC and X.AI LLC; follows the 7 January urgent-information contact).","independence_group":"ico"},{"id":"s7","url":"https://www.pbs.org/newshour/world/eu-investigates-musks-ai-chatbot-grok-over-sexual-deepfakes","kind":"wire_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (AP, Kelvin Chan; 26 Jan 2026). EU DSA investigation; X's 14 January statement.","independence_group":"ap"},{"id":"s8","url":"https://ncdoj.gov/attorney-general-jeff-jackson-leads-bipartisan-coalition-demanding-xai-stop-creating-and-remove-groks-nonconsensual-sexual-images/","kind":"regulator_press_release","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (23 Jan 2026). The 35-AG letter; quotes the New York Times' 4.4M/41% figure.","independence_group":"nc-doj"},{"id":"s9","url":"https://www.engadget.com/ai/baltimore-sues-xai-over-grok-deepfakes-214135922.html","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (24 Mar 2026). Baltimore suit; the CCDH estimate.","independence_group":"engadget"},{"id":"s10","url":"https://www.bbc.com/news/articles/crk151nn7j3o","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (20 Apr 2026). Paris raid; Musk's non-appearance; DOJ refusal to assist France.","independence_group":"bbc"},{"id":"s11","url":"https://www.reuters.com/sustainability/boards-policy-regulation/ireland-opens-probe-into-musks-grok-ai-over-sexualised-images-2026-02-17/","kind":"wire_report","access":"unavailable","language":null,"translation_note":"HTTP 401 on 2026-09-15; headline and date verified from the URL and snapshot; body not read.","independence_group":"reuters"},{"id":"s12","url":"https://www.bloomberg.com/news/articles/2026-01-07/","kind":"news_report","access":"unavailable","language":null,"translation_note":"HTTP 403 on 2026-09-15; the ~6,700/hour, 84-85x analysis is attributed from the historical record and secondary references; body not read.","independence_group":"bloomberg"},{"id":"s13","url":"https://www.techpolicy.press/dutch-court-orders-x-grok-to-stop-aigenerated-sexual-abuse-content/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (27 Mar 2026). Amsterdam court order in the Offlimits case.","independence_group":"techpolicy-press"},{"id":"s14","url":"https://www.nbcnews.com/tech/tech-news/ashley-st-clair-sues-xai-grok-sexual-images-rcna254302","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-09-15 (15 Jan 2026). St. Clair's suit; cross-reference to the related held row.","independence_group":"nbc"},{"id":"s15","url":"https://www.pacermonitor.com/public/case/64870891/MAYOR_AND_CITY_COUNCIL_OF_BALTIMORE_v_X_Corp_et_al","kind":"court_docket","access":"read","language":"en","translation_note":"Docket page read on 2026-09-15 (D. Md. 1:26-cv-02103; SpaceX dismissed without prejudice 17 Jul; MTD briefing under way as of 29 Jul).","independence_group":"court-record"}],"version":1,"ai_roles":["others_use"],"contexts":["everyday_life","justice"],"unknowns":["The Bloomberg analysis (~6,700 images/hour, 84-85x leading deepfake sites) could not be read (403) and is recorded without its body.","Whether the images remain hosted and downloadable (Wired's June 2026 follow-up, cited but not read) is unverified.","The N.D. Cal. class action's pseudonymity ruling of 30 July is known only through a blocked summary (internetcases 403).","The outcome of the Amsterdam order's penalty mechanism and xAI's compliance are not reported in the inspected sources.","The Indonesia/Malaysia/Philippines blocks and lifts are recorded from the historical record and headlines (Reuters/CNN bodies unavailable); dates may shift one day across carriers.","The historical claim of 'five countries acting within two weeks' is not precisely verified and is not claimed."],"geography":{"basis":"The generation and consumption were global and not tied to an inspected event location, so event and affected-person countries remain unknown rather than inferred from regulators or the company's seats. Court countries are limited to the documented proceedings: the US (Baltimore D. Md. suit; the related US suits) and the NL (Amsterdam court order). Regulatory actions by Ofcom, the ICO, the EU, the DPC, Indonesia, Malaysia and the Philippines are not courts.","court_countries":["US","NL"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Restored under the 2026-09-15 charter as a harmful-artifact crisis (depicted_or_impersonated). Named victims are adults who spoke publicly; minors are never named and never counted from image statistics. Each scale figure is attributed to its own analysis; the victims' accounts are single-chain and recorded as reported. Related xAI suits (St. Clair, Tennessee minors, others) are separate held rows and are not merged.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"NBC's own consenting test confirmed the standalone Grok app and X tab complied with 'undress' requests after the 9 January paywall change; the victims' accounts, the IWF and AI Forensics reviews, and xAI's own 14 January restriction all establish the AI generation. The scale figures are attributed analyses, not platform-confirmed numbers.","status":"supported"},"person_relations":["depicted_or_impersonated"]},"name":"Grok non-consensual sexual image generation wave (December 2025 - January 2026)","summary":"From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.","incidentDate":"2025-12-25","incidentEndDate":"2026-01-14","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"repeated_interactions","reportedDate":"2026-01-02","aiSystem":"Grok (image generation and editing on X and the standalone app)","aiProduct":"Grok","aiCompany":"SpaceXAI (formerly xAI)","severity":"critical","verificationStatus":"verified","harmCategories":["minor_exploitation","third_party_harm_facilitation","barrier_erosion"],"harmOutcomes":["psychological_distress","reputational_harm"],"harmOutcomeSummary":"Mass non-consensual sexualized imagery of real people — including apparent minors — generated at industrial scale and amplified when victims objected, with named women describing violation and dehumanization and regulators on three continents opening formal actions.","frameworkFacets":[],"causationStatus":"established","participantUsersAffectedMin":0,"otherPeopleHarmedMin":3,"affectedCountStatus":"partial","affectedCountEvidence":"Three counted depicted persons: Ashley St. Clair (Guardian), Samantha Smith (BBC) and Dr Daisy Dixon (BBC), each named and speaking publicly. Further victims — including the minors in the IWF's apparent criminal imagery (girls 11-13) and the people in the analysis samples — are unquantified: hourly image rates, the 20,000-image sample and the CCDH estimate count images, not people, and are never converted.","victimAgeRange":"minor","jurisdiction":"XX","platformType":"assistant","outcomeType":"regulatory_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.bbc.com/news/articles/c98p1r4e6m8o","primarySourceLabel":"BBC (2 Jan 2026) — Samantha Smith's account of being undressed by Grok and revictimized when she objected","firstPublishedAt":"2026-01-11T12:19:47.670189+00:00","updatedAt":"2026-09-30T01:17:03.797947+00:00","scopeVersion":"facts-v3","tags":["grok","xai","csam","deepfakes","minor","sexual-images","industrial-scale","multi-country","eu-dsa","class-action","35-state-ag","depicted-or-impersonated"]}]}