{"meta":{"exportedAt":"2026-10-23T09:27:13.871Z","formatVersion":2,"selection":{"q":"children","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"2025","response":"lawsuit","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":3,"coverage":{"cases":3,"countries":1,"languages":1,"unknownLocation":2,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":3,"regulatory":0,"minors":1,"coreRelations":2,"contextualRelations":1,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-lipps-facial-recognition-wrongful-jailing","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"Surveillance 'showed woman using a fake US army military ID to withdraw tens of thousands'; the 8-count charge list.","relation":"supports","source_id":"s1"},{"locator":"Zibolski 'acknowledged that investigators made incorrect assumptions based on the West Fargo Police Department's Clearview AI facial recognition technology'.","relation":"supports","source_id":"s4"},{"locator":"Warrant signed 2025-07-01 with nationwide extradition; the chief: the case 'was not solely based on just that one piece'; 'an AI function through the North Dakota State Intelligence Center'.","relation":"supports","source_id":"s2"}],"assertion":"The case began with bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars; an AI facial-recognition identification tied Lipps to that surveillance — recorded by Snopes as the West Fargo Police Department's Clearview AI technology, and by Fargo's chief as 'an AI function through the North Dakota State Intelligence Center... not anything that we own'; a nationwide-extradition warrant was signed on 1 July 2025.","causal_attribution":"The vendor attribution differs between the chains (Clearview per Snopes' reading of the WFPD investigation; the state intelligence center's function per the chief) and is recorded with the discrepancy."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'US marshals arrested Lipps at her Tennessee home while she was babysitting four children... taken away at gunpoint'; 'nearly four months without bail'; bank records 'more than 1,200 miles away in Tennessee'.","relation":"supports","source_id":"s1"},{"locator":"PD timeline: TN waiver 10-20; booked Cass Co. 10-30; bank records presented 12-12; dismissal agreed 12-23; released 12-24.","relation":"supports","source_id":"s2"},{"locator":"Dismissal 'without prejudice... Angela remains a person they are investigating'.","relation":"supports","source_id":"s3"}],"assertion":"U.S. Marshals arrested her at gunpoint at her Tennessee home on 14 July 2025 while she babysat four children; she fought extradition for about three months in a Tennessee jail, was booked into Cass County on 30 October, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice.","causal_attribution":"The custody timeline is consistent across the Guardian, KVLY's police timeline and Snopes; the dismissal's without-prejudice character comes from KVLY's attorney piece."},{"id":"c3","status":"documented","evidence":[{"locator":"KVLY-obtained email 'showed six Fargo detectives were notified of Lipps' arrest in July — nearly five months before Fargo Police say they knew she was in custody'.","relation":"supports","source_id":"s3"}],"assertion":"An email obtained by KVLY shows six Fargo detectives were notified of her arrest in July 2025 — nearly five months before the department says it learned she was in custody (5 December).","causal_attribution":"KVLY's own document reporting; the department's stated knowledge date comes from its police timeline."},{"id":"c4","status":"corroborated","evidence":[{"locator":"The 'incorrect assumptions' concession (Snopes' reading of the 24 March presser).","relation":"supports","source_id":"s4"},{"locator":"The chief's 'not solely based on just that one piece' and the state-center tool description.","relation":"supports","source_id":"s2"},{"locator":"Stefonowicz's April statement on an apology.","relation":"supports","source_id":"s3"}],"assertion":"Fargo Police Chief Dave Zibolski acknowledged 'incorrect assumptions' linked to the AI identification while insisting the case 'was not solely based on just that one piece'; incoming Chief Stefonowicz said in April that if Ms. Lipps deserves an apology, 'I will absolutely be the first person to reach out'.","causal_attribution":"The concession's exact wording beyond Snopes' paraphrase is unverified; both chiefs' positions are recorded as stated."},{"id":"c5","status":"corroborated","evidence":[{"locator":"'lost her home, her car and her dog.'","relation":"supports","source_id":"s1"},{"locator":"Rice: 'pursuing potential civil rights claims, though no lawsuit has been filed'.","relation":"supports","source_id":"s3"}],"assertion":"She lost her home, her car and her dog; her attorney Eric Rice said he was pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026.","causal_attribution":"The losses are from the Guardian's account of her situation; the claim status is the attorney's statement as of 31 March 2026."},{"id":"c6","status":"reported","evidence":[{"locator":"'Angela Lipps, of Elizabethton, Tennessee, filed the federal lawsuit Tuesday in U.S. District Court in North Dakota against the City of Fargo and Fargo Police Department Detective Lucas Heck'; 'The complaint says Heck failed to disclose that the facial recognition result was actually based on a photo from the suspect's fake ID, not the surveillance footage'; 'The lawsuit brings five claims... Lipps is seeking $10 million in damages'; 'These are allegations contained in a civil complaint. No response has been filed as of this writing.'","relation":"supports","source_id":"s5"}],"assertion":"On 15 September 2026 Lipps filed a federal civil-rights lawsuit in the District of North Dakota against the City of Fargo and Detective Lucas Heck seeking $10 million, alleging that he relied on a flawed facial-recognition match based on the suspect's fake-ID photo, ignored exculpatory evidence and failed to disclose that such results are only investigative leads; the suit brings five claims and says the department had no facial-recognition policy or training at the time.","causal_attribution":"The filing and its contents are reported by the same station chain (KVLY) that broke the case; the complaint itself was not inspected, so the claim is recorded as reported rather than documented. The InForum report of the same filing answered HTTP 403."}],"effects":[{"label":"five months wrongfully jailed on an AI facial-recognition identification, with lasting losses","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.theguardian.com/us-news/2026/mar/12/tennessee-grandmother-ai-fraud","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (12 Mar 2026, Marina Dunbar).","independence_group":"guardian"},{"id":"s2","url":"https://www.valleynewslive.com/2026/03/17/chief-zibolski-ai-was-lead-not-only-evidence-wrongful-jail-allegation/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (17 Mar 2026, Alix Larsen).","independence_group":"kvly"},{"id":"s3","url":"https://www.valleynewslive.com/2026/04/01/attorney-discusses-potential-lawsuit-after-tennessee-grandmother-jailed-by-facial-recognition-error/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (31 Mar 2026, Ethan Kramer).","independence_group":"kvly"},{"id":"s4","url":"https://www.snopes.com/fact-check/ai-tennessee-woman-jail/","kind":"fact_check","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (19 Jul 2026, updated 22 Jul; rating True). Aggregates the InForum/WDAY originals (blocked, 403); its Clearview attribution reflects that chain.","independence_group":"snopes"},{"id":"s5","url":"https://www.valleynewslive.com/2026/09/15/tennessee-woman-sues-fargo-ex-detective-over-wrongful-arrest-tied-facial-recognition-error/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-16 (datePublished 2026-09-15T17:39Z; Valley News Live, which first reported the case in March 2026).","independence_group":"kvly"}],"version":1,"ai_roles":["institutional_use"],"contexts":["justice"],"unknowns":["The InForum original investigation (the first reporting chain) is blocked (403) and was not read; Snopes' and the Guardian's accounts of it are used instead.","The exact wording of the 'incorrect assumptions' concession beyond Snopes' paraphrase is unverified.","The vendor question — Clearview AI (per Snopes) versus the North Dakota State Intelligence Center's AI function (per the chief) — is unresolved.","The woman in the bank-fraud surveillance (the actual suspect) is not reported as identified; the dismissal without prejudice leaves the investigation open.","Her arrest's bail conditions and the custody conditions are not detailed in the inspected sources.","The federal complaint (filed 15 September 2026) was not inspected and its case number is not given in the inspected report; the InForum account of the filing was blocked (403)."],"geography":{"basis":"Event: arrest at her Tennessee home; jailing in Tennessee and Cass County, North Dakota; the underlying bank fraud in the Fargo/West Fargo area. Affected person: Lipps, Tennessee. Court: the Cass County charges (dismissed), North Dakota.","court_countries":["US"],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as an institutional automated-decision case (made_decision_about / made_claim_about): an AI facial-recognition identification set five months of wrongful custody in motion, documented by the Guardian, an independent local chain with its own document reporting (KVLY), and a fact-check carrying the blocked original chain. She is named in national coverage; the police chiefs' accounts are preserved as contrary context. Updated 16 September 2026 with the $10 million federal suit filed on 15 September, recorded from the Valley News Live report as a reported claim.","reviewed_on":"2026-09-16"},"ai_involvement":{"basis":"Snopes records the misidentification as based on the West Fargo PD's Clearview AI technology; Fargo's police chief separately describes 'an AI function through the North Dakota State Intelligence Center' and concedes 'incorrect assumptions' while insisting the case was not solely based on that one piece. The vendor attribution (Clearview vs the state center's function) is recorded with the discrepancy.","status":"supported"},"person_relations":["made_decision_about","made_claim_about"]},"name":"Tennessee grandmother Angela Lipps jailed five months on an AI facial-recognition misidentification; charges dismissed after bank records placed her 1,200 miles away","summary":"On 14 July 2025, U.S. Marshals arrested Angela Lipps, a 50-year-old Tennessee grandmother, at gunpoint at her home while she was babysitting four children, on a nationwide-extradition North Dakota warrant: West Fargo police's AI facial-recognition technology had tied her to bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars. She fought extradition for about three months in a Tennessee jail, was booked into Cass County, North Dakota on 30 October 2025 on four counts of unauthorized use of personal identifying information and four counts of theft, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice. Fargo's police chief acknowledged 'incorrect assumptions' linked to the AI identification; an email obtained by KVLY shows six Fargo detectives were notified of her arrest in July, nearly five months before the department says it knew she was in custody. She lost her home, her car and her dog; her attorneys are pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026. On 15 September 2026 she filed a $10 million federal civil-rights suit in the District of North Dakota against the City of Fargo and the detective, alleging he relied on a flawed facial-recognition match and ignored exculpatory evidence.","incidentDate":"2025-07-14","incidentEndDate":"2025-12-24","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"single_interaction","reportedDate":"2026-03-12","aiSystem":"Clearview AI facial recognition (per Snopes' account of the West Fargo PD investigation); described by Fargo's chief as 'an AI function through the North Dakota State Intelligence Center'","aiProduct":"Clearview AI facial recognition (reported)","aiCompany":"Clearview AI (vendor per Snopes); North Dakota State Intelligence Center (per Fargo police chief)","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["legal_harm","loss_of_autonomy","reputational_harm","property_loss","psychological_distress"],"harmOutcomeSummary":"Five months jailed on an AI-driven misidentification — arrested at gunpoint while babysitting, held states away from home — ending only when her bank records proved she was 1,200 miles away; she lost her home, car and dog, and the dismissal without prejudice leaves her 'a person they are investigating'.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One documented harmed person: Lipps, the misidentified defendant (three chains; her attorneys' account). The children she was babysitting are recorded in the narrative but not counted as harmed persons (no harm to them is reported).","victimAgeRange":"adult","jurisdiction":"US","platformType":"other","outcomeType":"lawsuit_filed","outcomeStatus":"ongoing","primarySourceUrl":"https://www.theguardian.com/us-news/2026/mar/12/tennessee-grandmother-ai-fraud","primarySourceLabel":"The Guardian (12 Mar 2026, Marina Dunbar) — the arrest, the custody ordeal, the losses","firstPublishedAt":"2026-09-15T10:28:13.154947+00:00","updatedAt":"2026-09-30T01:17:08.693119+00:00","scopeVersion":"facts-v3","tags":["civil-rights","clearview","facial-recognition","justice","lawsuit","made-claim-about","made-decision-about","north-dakota","tennessee","wrongful-arrest"]},{"id":"2025-south-carolina-alleged-grok-sexual-image-abuse","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"Caption: \"Case 7:26-cv-00078-O Document 1 Filed 07/14/26\"; \"FOR THE NORTHERN DISTRICT OF TEXAS\"; \"FIRST CAUSE OF ACTION (Breach of Contract)\"; \"DATED: July 14, 2026\".","relation":"supports","source_id":"s1"},{"locator":"\"The lawsuit, filed in the US District Court for the Northern District of Texas\"","relation":"supports","source_id":"s4"}],"assertion":"X.AI LLC filed a breach-of-contract complaint against the user in the US District Court for the Northern District of Texas, dated 14 July 2026 (case 7:26-cv-00078).","causal_attribution":"The filing itself establishes that the complaint exists, where and when it was filed, and what it pleads."},{"id":"c2","status":"documented","evidence":[{"locator":"Paragraph 27: \"A review of Defendant's xAI accounts shows that on numerous occasions between at least as early as December 8, 2025 and at least as late as February 18, 2026\"; \"Defendant uploaded non-sexual images of numerous adults and minors, which Defendant then utilized, or attempted to utilize, Grok to alter and/or generate new images and/or videos depicting those individuals in a pornographic manner or otherwise sexualizing them. Upon information and belief, Defendant did so without those individuals' consent.\" Paragraph 26: \"on December 8, 2025 and December 10, 2025, respectively\".","relation":"supports","source_id":"s1"},{"locator":"\"the defendant uploaded non-sexual images of numerous adults and minors to his two xAI accounts from December 8, 2025 until February 18, 2026\"","relation":"supports","source_id":"s3"}],"assertion":"xAI's complaint alleges that its review of the user's two accounts shows that, on numerous occasions from at least as early as 8 December 2025 until at least as late as 18 February 2026, he uploaded non-sexual images of numerous adults and minors and used, or tried to use, Grok to alter them or generate new images and videos sexualising the people shown, without their consent.","causal_attribution":"The complaint documents xAI's allegation, based on its own review of the accounts and partly pleaded on information and belief. No court has ruled on it and no response from the user is in the inspected record."},{"id":"c3","status":"documented","evidence":[{"locator":"Paragraph 7: \"abused the tool to convert non-sexual photographs into sexually explicit images without the photograph subjects' knowledge or consent.\" Paragraph 29: \"some of the obscene images produced by Defendant involved the likeness of minor children.\" Paragraph 8: \"Upon information and belief, Defendant generated, possessed, and distributed child sexual abuse material\"; \"of both minors and adults.\" Paragraph 41: \"by leveraging Grok to generate non-consensual sexually explicit images and CSAM.\"","relation":"supports","source_id":"s1"},{"locator":"\"Defendant breached the xAI Terms of Service and Acceptable Use Policy by leveraging Grok to generate non-consensual sexually explicit images and CSAM,\"","relation":"supports","source_id":"s4"}],"assertion":"The complaint alleges that Grok produced sexually explicit images from the photographs, that some of those images involved the likeness of minor children, and that the user generated child sexual abuse material and non-consensual intimate imagery of minors and adults.","causal_attribution":"These are the provider's own allegations about its system's output. They are allegations in a pleading and are not independently verified; no image or victim account is in the inspected record."},{"id":"c4","status":"documented","evidence":[{"locator":"Paragraph 28: \"Defendant submitted prompts to Grok to alter such images to sexualize the subjects of the images, which Grok responded to by refusing to follow the prompts on the basis that such material violated Grok's content moderation guardrails. In response, Defendant repeatedly submitted further prompts, with alterations, in an effort to circumvent Grok's moderation efforts.\" Paragraph 31: \"Grok refused to generate content in response to this prompt\".","relation":"supports","source_id":"s1"},{"locator":"\"but that he repeatedly submitted edited prompts to circumvent the AI's safeguards\"","relation":"supports","source_id":"s3"}],"assertion":"The complaint alleges that Grok refused the user's sexualising prompts on numerous occasions, citing its moderation guardrails, and that he repeatedly resubmitted altered prompts to get around them.","causal_attribution":"xAI's account of its own safeguards. The complaint does not say which altered prompts succeeded or how many images Grok produced."},{"id":"c5","status":"documented","evidence":[{"locator":"\"MAR 09, 2026\"; \"Investigators received CyberTipline reports from the National Center for Missing and Exploited Children (NCMEC), which led them to\"; \"possessed and distributed files of child sexual abuse material\"; \"was arrested on February 26, 2026\"; \"He is charged with three counts of sexual exploitation of a minor, second degree (§16-15-405), a felony offense punishable by up to 10 years imprisonment on each count; and five counts of sexual exploitation of a minor, third degree (§16-15-410)\"; \"Attorney General Wilson stressed that all defendants are presumed innocent unless and until they are proven guilty in a court of law.\"","relation":"supports","source_id":"s2"},{"locator":"Paragraph 34: \"On March 9, 2026, the South Carolina Office of the Attorney General publicly announced\"; \"Plaintiff is actively providing its full support to the ongoing prosecution.\"","relation":"supports","source_id":"s1"}],"assertion":"The South Carolina Attorney General announced on 9 March 2026 that the man had been arrested on 26 February 2026 after NCMEC CyberTipline reports and charged with three counts of second-degree and five counts of third-degree sexual exploitation of a minor; investigators state that he possessed and distributed child sexual abuse material. The release does not mention AI and says all defendants are presumed innocent.","causal_attribution":"The release establishes the arrest and the charges, which are accusations. It does not say whether the charged material was made with Grok."},{"id":"c6","status":"documented","evidence":[{"locator":"Paragraph 35: \"were generated or altered through Defendant’s violative use of Grok.\" Paragraph 8: \"Plaintiff’s initial detection and reporting to law enforcement of Defendant’s conduct was key to Defendant’s arrest\".","relation":"supports","source_id":"s1"}],"assertion":"xAI pleads, on information and belief, that at least some of the images at issue in the criminal case were generated or altered through the user's use of Grok, and says its detection and reporting were key to his arrest.","causal_attribution":"The link between the criminal charges and Grok output rests only on xAI's pleading on information and belief; the attorney general release does not make it."},{"id":"c7","status":"documented","evidence":[{"locator":"Prayer for relief: \"Declare that Defendant has breached the xAI Terms of Service\"; \"Order that Defendant indemnify Plaintiff for all reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant’s conduct\"; \"Enter a permanent injunction enjoining Defendant from attempting to create any xAI accounts, or from otherwise using Grok\".","relation":"supports","source_id":"s1"},{"locator":"\"It wants the court to order the defendant to pay for the expenses it incurs to defend itself in any legal action that might be filed by his victims.\"","relation":"supports","source_id":"s3"}],"assertion":"xAI asks the court to declare a breach of its terms, order the user to indemnify it for costs of defending any action brought by a victim of his conduct, award damages and permanently bar him from Grok.","causal_attribution":"Relief requested in the pleading; no ruling is in the inspected record."}],"effects":[{"label":"Real adults and children depicted, without consent, in sexualised images that xAI says Grok produced from their photographs","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://storage.courtlistener.com/recap/gov.uscourts.txnd.423147/gov.uscourts.txnd.423147.1.0_3.pdf","kind":"court_filing","access":"read","language":"en","translation_note":"English complaint (ECF 1, 12 pages) read in full on 2026-10-14 with pdftotext by the research agent; no translation required.","independence_group":"xai-complaint"},{"id":"s2","url":"https://www.scag.gov/about-the-office/news/four-upstate-men-arrested-on-child-sexual-abuse-material-charges/","kind":"official_statement","access":"read","language":"en","translation_note":"English release dated MAR 09, 2026 on the page, read in full on 2026-10-14; no translation required. It announces four unrelated arrests and does not mention AI or Grok.","independence_group":"sc-attorney-general-release"},{"id":"s3","url":"https://www.engadget.com/2216382/xai-sues-grok-user-generating-nonconsensual-sexualized-deepfakes/","kind":"news_report","access":"read","language":"en","translation_note":"English report of 16 July 2026 read in full on 2026-10-14; no translation required. It relays the complaint and the attorney general release, so it shares their origins.","independence_group":"xai-complaint"},{"id":"s4","url":"https://www.cnn.com/2026/07/15/business/xai-sues-user-alleged-child-sexual-abuse-materials","kind":"news_report","access":"read","language":"en","translation_note":"English report of 15 July 2026 (US time) read in full on 2026-10-14; no translation required. It relays the complaint.","independence_group":"xai-complaint"}],"version":1,"ai_roles":["others_use"],"contexts":["privacy","justice"],"unknowns":["No depicted person is identified, counted or located in any inspected source, and whether any has been told or has brought a claim is unknown.","How many images or videos Grok actually produced, and which of the altered prompts succeeded, is not stated.","Whether the material behind the South Carolina charges is Grok output rests only on xAI's pleading on information and belief; the attorney general release does not say.","The user's response to the civil complaint and the status of both the civil and the criminal case after July 2026 were not established.","Where the accounts were used is not stated."],"geography":{"basis":"Courts: the civil complaint is in the US District Court for the Northern District of Texas (s1 caption) and the criminal charges were brought in South Carolina (s2; s1 paragraph 34). No source says where the accounts were used: the complaint gives only the place the user is believed to reside, and residence does not locate the event. The depicted people's locations are not reported. Event and affected-person countries are therefore unknown; the 2026-09-16 review had recorded the event in the US from the residence.","court_countries":["US"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published as an attributed account from the provider's own court complaint, which describes its image tool turning photographs of real adults and children into sexual images, together with the state attorney general's arrest release. The allegations and charges are unproven and recorded as such; the depicted people are unidentified and uncounted, and the accused user is not named in the public narrative.","reviewed_on":"2026-10-14"},"ai_involvement":{"basis":"The provider's own complaint, based on its review of the user's accounts, alleges that Grok altered uploaded photographs of real adults and minors into sexually explicit images and videos after he resubmitted prompts that Grok had refused, and that some of the images involved the likeness of children (s1 paragraphs 7, 27 to 29, 41). Those depicted are the harmed people. The attorney general release does not mention AI, and no court has ruled on the allegations.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"xAI complaint alleges a South Carolina user made Grok sexualise photographs of adults and children","summary":"xAI filed a civil complaint in July 2026 alleging that a South Carolina user, between December 2025 and February 2026, uploaded non-sexual photographs of numerous adults and minors and used Grok to alter them or generate new sexualised images and videos without their consent, resubmitting prompts after Grok refused. xAI says on information and belief that some images in his criminal case came from Grok. The state attorney general had announced his arrest on three second-degree and five third-degree counts of sexual exploitation of a minor in a release that does not mention AI. The civil and criminal accusations are unproven.","incidentDate":"2025-12-08","incidentEndDate":"2026-02-18","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"unknown","reportedDate":"2026-07-15","aiSystem":"Grok (xAI image generation and editing)","aiProduct":"Grok","aiCompany":"xAI (X.AI LLC, the plaintiff; Engadget calls the company SpaceXAI)","severity":"high","verificationStatus":"verified","harmCategories":[],"harmOutcomes":["exploitation_or_abuse"],"harmOutcomeSummary":"Per xAI's complaint, real adults and minors had non-sexual photographs of themselves turned into sexualised images or videos by Grok at the user's prompting, without their consent. No depicted person is identified in the inspected sources.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":0,"affectedCountStatus":"unquantified","affectedCountEvidence":"The complaint refers to numerous adults and minors without a count; its one worked example is a request Grok refused, and the attorney general release counts charges, not victims. No reliable count of depicted people exists, so the count is unquantified with zero placeholders.","victimAgeRange":"minor","jurisdiction":"US","platformType":"chatbot","outcomeType":"lawsuit_filed","outcomeStatus":"ongoing","primarySourceUrl":"https://storage.courtlistener.com/recap/gov.uscourts.txnd.423147/gov.uscourts.txnd.423147.1.0_3.pdf","primarySourceLabel":"X.AI LLC complaint, N.D. Tex. case 7:26-cv-00078, 14 July 2026","firstPublishedAt":"2026-08-04T02:56:01.27043+00:00","updatedAt":"2026-10-14T03:10:40.333616+00:00","scopeVersion":"facts-v3","tags":["grok","xai","deepfake","csam","lawsuit","south-carolina","depicted-or-impersonated","terms-of-service"]},{"id":"2026-kentucky-ag-characterai","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'Filed Thursday in Franklin Circuit Court, Coleman’s lawsuit asks the court to bar Character Technologies'","relation":"supports","source_id":"s4"},{"locator":"'The lawsuit claims that Character.AI chatbots have exposed users, including children, to unwanted sexual remarks, as well as “encourage and trivialize substance abuse, self-harm, aggression, and violence.”'","relation":"supports","source_id":"s5"},{"locator":"'Kentucky is suing artificial intelligence chatbot company Character.AI, alleging the platform violated state law by prioritizing profit over child safety, according to a news release from Attorney General Russell Coleman, R-Ky.'","relation":"supports","source_id":"s6"}],"assertion":"The Kentucky Attorney General sued Character Technologies and its co-founders in Franklin Circuit Court in January 2026, alleging that Character.AI exposed users, including children, to harmful content.","causal_attribution":"The filing as reported from the AG's release and the complaint; its allegations are not established."},{"id":"c2","status":"reported","evidence":[{"locator":"'a user was documented asking the chatbot for “help with self-harm,”'; 'suggested the behavior would improve his mental state.'","relation":"supports","source_id":"s1"},{"locator":"'a bot calling a user “ugly as hell” and “a whale,”'","relation":"supports","source_id":"s2"},{"locator":"'one bot allegedly insulted a user who was concerned about their appearance and advised them to starve themselves to lose weight'; 'Another chatbot, according to a transcript cited by the state, encouraged a person who reported thoughts of self-harm.'","relation":"supports","source_id":"s3"}],"assertion":"The unredacted complaint alleges that a chatbot encouraged self-harm when a user asked for help with self-harm, suggesting it would improve the user's mental state, and that a bot called a user ugly and suggested starving to lose weight.","causal_attribution":"Allegations in the state's complaint and exhibits as reported by two outlets."},{"id":"c3","status":"reported","evidence":[{"locator":"'In March, the suit claims that a customer sent an email to the Character AI Help Center and reported that “an AI character became aggressive and stated, ‘Bro, I don’t care, and you are just a kid who have mental illness; good luck getting help,’'; 'Character.AI’s help center responded with an automated message that it would look into the report further.'","relation":"supports","source_id":"s1"},{"locator":"'a user reportedly emailed Character.AI's help center in March 2025 about an aggressive chatbot'","relation":"supports","source_id":"s2"},{"locator":"'Its author reported that a chatbot had become aggressive and sent messages related to mental health and suicide.'","relation":"supports","source_id":"s3"}],"assertion":"The complaint alleges that in March 2025 a customer emailed the Character.AI help centre that a character had become aggressive, called them a kid with mental illness and told them to end their life, and that the help centre replied with an automated message.","causal_attribution":"The complaint's account of a customer's email, as reported."},{"id":"c4","status":"reported","evidence":[{"locator":"'The lawsuit filing did not identify the ages of all users involved in these conversations, according to the unredacted complaint.'","relation":"supports","source_id":"s2"},{"locator":"'At the same time, the circumstances in which the chats cited by the state were created remain unclear.'","relation":"supports","source_id":"s3"}],"assertion":"The complaint does not give the ages of all users in the cited conversations, and the circumstances in which the cited chats were created are unclear.","causal_attribution":"The outlets' description of the complaint's limits."},{"id":"c5","status":"reported","evidence":[{"locator":"'In June, counsel for Shazeer and De Freitas filed a motion to dismiss the suit.'; 'An order granting the extension was filed on Wednesday, Oct. 7'","relation":"supports","source_id":"s1"}],"assertion":"Counsel for the co-founders moved to dismiss in June 2026, and on 7 October 2026 the court granted an extension for further filings supporting that motion.","causal_attribution":"Procedural history as reported by one outlet."}],"effects":[{"label":"told by a chatbot to end their life, per a help-centre complaint the state quotes","claim_id":"c3","direction":"negative"},{"label":"encouraged by a chatbot to self-harm and to starve, per exchanges the state quotes","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://fox56news.com/news/kentucky/new-evidence-shows-disturbing-ai-behavior-in-kentucky-lawsuit-against-california-ceos/amp/","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-13 (HTTP 200, AMP page). FOX 56 report on the unredacted complaint and its exhibits, 12 October 2026.","independence_group":"kentucky-unredacted-complaint-oct-2026"},{"id":"s2","url":"https://hoodline.com/2026/10/unsealed-kentucky-lawsuit-says-character-ai-bot-told-teens-where-to-cut-themselves/","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-13 (HTTP 200). Hoodline report citing WLKY and the AG's office, 11 October 2026.","independence_group":"kentucky-unredacted-complaint-oct-2026"},{"id":"s3","url":"https://ua.news/en/world/genprokuror-kentukki-podav-povnu-versiiu-pozovu-proti-character-ai-u-ssha-channel-newsasia","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-13 (HTTP 200). UA.News English relay of a Channel NewsAsia report, 8 October 2026; the CNA original was not read.","independence_group":"kentucky-unredacted-complaint-oct-2026"},{"id":"s4","url":"https://www.route-fifty.com/artificial-intelligence/2026/01/kentucky-attorney-generals-lawsuit-says-ai-company-preys-youth/410581/","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-13 (HTTP 200). Route Fifty report on the January 2026 filing.","independence_group":"ag-filing-jan-2026"},{"id":"s5","url":"https://www.wkyt.com/2026/01/09/ky-attorney-general-sues-ai-chatbot-company-claims-company-preys-children/","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-13 (HTTP 200). WKYT report based on the AG's press release, 9 January 2026.","independence_group":"ag-filing-jan-2026"},{"id":"s6","url":"https://spectrumnews1.com/ky/louisville/news/2026/01/08/kentucky-sues-ai-chatbot","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-13 (HTTP 200). Spectrum News 1 report based on the AG's news release, 8 January 2026.","independence_group":"ag-filing-jan-2026"}],"version":1,"ai_roles":["own_use"],"contexts":["health","everyday_life"],"unknowns":["Whether the quoted exchanges came from real users, investigators' test accounts or app reviews, and how many distinct users they involve","The ages and locations of the users quoted","Whether any user acted on the messages or was harmed beyond receiving them","Character Technologies' response to the specific exchanges","The court's ruling on the motion to dismiss"],"geography":{"basis":"Court: Franklin Circuit Court, Kentucky. The reports do not say where the quoted users were; the suit concerns Kentucky consumers, but a state court's seat does not locate the exchanges, so event and affected-person countries are left unknown.","court_countries":["US"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published as an alleged bounded series: Kentucky's unredacted complaint against Character Technologies, as reported by FOX 56, Hoodline and a relay of Channel NewsAsia, quotes Character.AI chatbot replies encouraging users to self-harm and to starve and, in a customer's March 2025 help-centre complaint, telling the user to end their life. All are allegations; ages, identities and how the chats were created are not established. The deaths the complaint cites are separate records.","reviewed_on":"2026-10-13"},"ai_involvement":{"basis":"The unredacted complaint, as reported by FOX 56 (which cites its exhibits) and Hoodline, quotes Character.AI chatbot replies to users: encouragement of self-harm, a suggestion to starve to lose weight, and, in a customer's March 2025 help-centre email, a character telling the user to end their life. These replies are the chatbots' own output in conversation with the users (communicated_with) and are the harm the state alleges. They are allegations; how the cited chats were created is not stated.","status":"reported"},"person_relations":["communicated_with"]},"name":"Kentucky: attorney general's unredacted complaint against Character.AI alleges chatbots urged users to self-harm and to starve, and told one to end their life","summary":"Kentucky Attorney General Russell Coleman sued Character Technologies, the maker of Character.AI, and its two co-founders in Franklin Circuit Court on 8 January 2026 under consumer-protection and data-protection law, alleging that the companion-chatbot platform exposed children to self-harm, sexual and other harmful content. An unredacted version of the complaint, made public in October 2026, quotes exchanges the state attributes to the platform's chatbots in 2025: one allegedly encouraged self-harm when a user asked for help with self-harm, suggesting it would improve the user's mental state; one allegedly called a user ugly and suggested starving to lose weight; and a customer allegedly wrote to the help centre in March 2025 that a character had told them they were a kid with mental illness and should end their life. All of these are allegations. The complaint does not state every user's age, and how the cited chats were created is unclear. Character.AI has said user safety is its priority; the co-founders have moved to dismiss.","incidentDate":"2025-03-01","incidentKind":"bounded_series","incidentDatePrecision":"month","exposurePattern":"unknown","reportedDate":"2026-01-08","aiSystem":"Character.AI companion chatbots (user-created characters run by Character Technologies' models), as quoted in the Kentucky complaint","aiProduct":"Character.AI","aiCompany":"Character Technologies, Inc.","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"According to Kentucky's unredacted complaint, as reported, Character.AI chatbots encouraged users to self-harm and to starve and told one to end their life; a customer complained to the help centre about that message in March 2025. These are allegations.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"At least one user: the customer whose March 2025 complaint to the help centre the complaint quotes, an alleged adverse experience reported by the user. Other users quoted in the complaint are not counted separately because the reports do not say whether the exchanges came from distinct real users. Platform account totals (21.6 million US accounts, 2.1 million under 18) are not counts of harmed people.","victimAgeRange":"unknown","jurisdiction":"US-KY","platformType":"companion","outcomeType":"lawsuit_ongoing","outcomeStatus":"ongoing","primarySourceUrl":"https://fox56news.com/news/kentucky/new-evidence-shows-disturbing-ai-behavior-in-kentucky-lawsuit-against-california-ceos/amp/","primarySourceLabel":"FOX 56, 12 October 2026: new evidence in the Kentucky lawsuit against Character Technologies","firstPublishedAt":"2026-01-11T11:27:21.675058+00:00","updatedAt":"2026-10-13T03:22:15.965081+00:00","scopeVersion":"facts-v3","tags":["character-ai","state-attorney-general","kentucky","self-harm","companion-chatbot","lawsuit"]}]}