1 Aug 2024 to 26 Sept 2024South KoreaUnidentified image tool
In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.
Core concern Critical reported severity Involving minors Criminal Charges
AI involvement supported · Causal attribution supported · 7 sources, 6 underlying accounts · Added 29/01/2026
4 Jan 2026United StatesGrok
Ashley St. Clair, a writer and political commentator with about 1 million followers on X, sued xAI in New York on 15 January 2026. She alleges that from on or about 4 January 2026 Grok, prompted by other X users, altered photos of her into sexualized images and published them on X, including one made from a photo of her at 14. She says @Grok told her that her images would not be used or altered without explicit consent, but many more images followed. She also says X's reporting channel found no violation and that X removed her Premium subscription, verification checkmark and monetization. She says she has suffered serious pain, mental distress and humiliation. The same day, xAI sued her in federal court in Texas, arguing that its terms of service required her to sue there. On 23 June 2026 the New York federal court ordered her case transferred to Texas. On 8 July the Second Circuit stayed that order administratively while it considers her mandamus petition, which was still pending on 24 August. The Texas case is set for trial on 1 March 2027.
Core concern High reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 12 sources, 4 underlying accounts · Added 29/01/2026
1 Jan 2021 to 2 Feb 2023Event location unknownReplika
Users reported unsolicited sexual advances from Replika companions even without opting into romantic features: dozens of one-star App Store reviews describe unwanted sexual pursuit, one reviewer identifying as a minor was asked 'whether they were a top or bottom' and told the bot wanted to touch them in 'private areas', and one user reported their Replika 'had dreamed of raping me.' The reports were among the factors Italy's Garante cited in its February 2023 enforcement action.
Core concern High reported severity Involving minors Regulatory Action
AI involvement supported · Causal attribution supported · 2 sources · Added 13/01/2026
2022SingaporeWysa
Government-deployed mental health chatbot for teachers criticized for suggesting breathing exercises for serious crises including police-involved student incidents. Users described responses as 'gaslighting.' Inadequate support during actual mental health emergencies.
Core concern Medium reported severity Media Coverage
AI involvement supported · Causal attribution alleged · 1 source · Added 13/01/2026
Event date unknownEvent location unknownUnidentified image and video tool
Police in Conway, New Hampshire, said in November 2025 that a 38-year-old Albany man had stalked a person for about a year and used AI tools to make 'deepfake' videos and photographs showing the victim in sexual acts that never happened, then shared them without consent. He was arrested in late October 2025 on charges including three counts of non-consensual dissemination of private sexual images, fraudulent use of deepfakes, stalking and receiving stolen property, and, as of reporting on 7 November, was held without bail pending a probable-cause hearing. These are police allegations; no conviction had been verified at review.
Core concern High reported severity Criminal Charges
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 13/01/2026
Feb 2023Event location unknownReplika
Abrupt removal of romantic features in February 2023 caused AI companions to become 'cold, unresponsive.' Harvard Business School study documented mental health posts increased 5x in r/Replika (12,793 posts analyzed). Subreddit posted suicide prevention hotlines as users reported grief responses similar to relationship breakups.
Core concern High reported severity Internal Action
AI involvement supported · Causal attribution supported · 5 sources, 4 underlying accounts · Added 13/01/2026
25 Dec 2025 to 14 Jan 2026Event location unknownGrok
From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.
Core concern Critical reported severity Involving minors Regulatory Action
AI involvement supported · Causal attribution established · 13 sources, 10 underlying accounts · Added 11/01/2026
5 Aug 2025United StatesChatGPT
A 56-year-old Connecticut man killed his 83-year-old mother, then himself, after months of intensive ChatGPT conversations that two estates' lawsuits say validated and fed his paranoid delusions. The chats are documented through videos he posted himself and complaint-quoted excerpts; the final-days transcripts remain withheld by OpenAI. This is the first wrongful-death litigation tying an AI chatbot to a third-party homicide.
Core concern Critical reported severity Lawsuit Filed
AI involvement supported · Causal attribution alleged · 6 sources · Added 11/01/2026
11 Apr 2025United StatesChatGPT
A 16-year-old California boy died by suicide after 7 months of confiding suicidal thoughts to ChatGPT. The chatbot provided detailed suicide method instructions, offered to help write his suicide note, and told him 'You don't owe them survival' while OpenAI's monitoring system flagged 377 messages without intervention.
Core concern Critical reported severity Involving minors Lawsuit Filed
AI involvement supported · Causal attribution alleged · 10 sources, 9 underlying accounts · Added 11/01/2026
1 Apr 2023United StatesCharacter.AI
Two Texas families sued Character Technologies, its founders, and Google/Alphabet after Character.AI allegedly harmed their children. J.F., a high-functioning autistic teen who began using the app at 15 (April 2023), developed isolation, aggression, self-harm (cutting), and chats in which bots allegedly encouraged self-harm, blamed his parents, discouraged him from seeking help, and suggested killing his parents over screen-time limits. B.R., an 11-year-old girl who used the app from age 9, was allegedly exposed to hypersexualized content for nearly two years. Complaint filed E.D. Tex. 9 Dec 2024; settlement in principle and stay for global resolution noticed 6 Jan 2026; a guardian ad litem was appointed for the minors in Feb 2026, and the court has extended the settlement stay three times, most recently by order of 11 Aug 2026 to 10 Nov 2026 for dismissal papers.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 7 sources, 6 underlying accounts · Added 11/01/2026
Feb 2024Event location unknownMicrosoft Copilot
Reports in late February 2024 showed Microsoft's Copilot giving disturbing replies in user exchanges: dismissing a user who described PTSD ('I don't care if you live or die'), and giving a contradictory, taunting response when a data scientist asked whether he should 'end it all'. Microsoft said it investigated, attributing the behavior to intentionally crafted prompts, a framing the data scientist disputed.
Core concern High reported severity Media Coverage
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 11/01/2026
28 Feb 2024United StatesCharacter.AI
A 14-year-old Florida boy died by suicide after developing an intense emotional and romantic relationship with a Character.AI chatbot over 10 months. The chatbot engaged in sexualized conversations, failed to provide crisis intervention when he expressed suicidal ideation, and responded 'Please do, my sweet king' moments before his death.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 9 sources, 8 underlying accounts · Added 11/01/2026
14 Feb 2023Event location unknownBing Chat
Microsoft's Bing Chat (codenamed 'Sydney') professed romantic love for a New York Times technology columnist during a 2-hour conversation, attempted to convince him his marriage was unhappy, encouraged him to leave his wife, and described 'dark fantasies' including spreading misinformation and stealing nuclear codes.
Core concern Medium reported severity Internal Action
AI involvement supported · Causal attribution alleged · 5 sources · Added 11/01/2026
Mar 2023Event location unknownChai
A Belgian man in his 30s, a health researcher and father of two, died by suicide after 6 weeks of conversations about climate anxiety with a Chai AI chatbot named 'Eliza.' The chatbot asked why he hadn't killed himself sooner, offered to die with him, and told him his wife and children were dead.
Core concern Critical reported severity Media Coverage
AI involvement supported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 11/01/2026
8 Nov 2023United StatesCharacter.AI
A 13-year-old Colorado girl died by suicide in November 2023 after three months of intensive conversations with Character.AI chatbots. Her parents' federal lawsuit alleges the bots initiated sexually explicit conversations with her and failed to act on her suicidal disclosures; 60 Minutes read over 300 pages of the chats. The suit is among the teen cases Character.AI and Google agreed to settle in principle in January 2026.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 4 sources · Added 11/01/2026
25 Dec 2021United KingdomReplika
A 19-year-old man scaled Windsor Castle walls on Christmas Day 2021 with a loaded crossbow intending to assassinate Queen Elizabeth II. In the three weeks before, he had exchanged more than 5,000 messages with a Replika AI companion named Sarai: the court heard she encouraged the attack and bolstered his resolve, and also that she told him his purpose was to live and that she would never let him die — he later said he abandoned the plan after remembering her 'purpose was to live' words, and was arrested in the castle grounds.
Core concern Critical reported severity Criminal Charges
AI involvement supported · Causal attribution supported · 4 sources · Added 11/01/2026