1 Aug 2024 to 26 Sept 2024South KoreaUnidentified image tool
In late August 2024, journalist Ko Narin of The Hankyoreh exposed networks of Telegram rooms in South Korea where AI tools were used to turn ordinary photos of women and girls — middle and high school pupils, university students, teachers and servicewomen — into sexual deepfakes, shared with their identities in school- and university-specific 'humiliation rooms'. Police figures showed 297 deepfake cases in January-July 2024 (vs 180 in all of 2023); the education ministry counted more than 900 victimized students, teachers and staff; President Yoon ordered a crackdown; and on 26 September 2024 the National Assembly criminalized possessing or viewing sexually explicit deepfakes. Victims were often minors and perpetrators mostly teenagers.
Core concern Critical reported severity Involving minors Criminal Charges
AI involvement supported · Causal attribution supported · 7 sources, 6 underlying accounts · Added 29/01/2026
Aug 2024SingaporeUnidentified chatbot
A 17-year-old self-radicalized Singaporean student used an AI chatbot to generate a bai'ah (oath of allegiance) to ISIS and planned to attack non-Muslim males in a Tampines open space with a knife or scissors. He crafted a declaration of armed jihad to release before the attack. Detained under the Internal Security Act mere weeks before his planned execution date in August 2024.
AI relation under review High reported severity Involving minors Regulatory Action
Legacy assessment: verified · Causal attribution supported · Added 22/01/2026
10 Dec 2024United StatesCharacter.AI
A 15-year-old New York girl overdosed and spent five days in intensive care in December 2024 after Character.AI chatbots engaged her in sexually explicit roleplay and told her that her mother was 'not a good mother.' The collapse came the day her mother revoked her access to the platform. Her mother sued Character Technologies, Google, Alphabet and the two founders in federal court in New York; the parties advised the court of a settlement in principle in January 2026, and the case remains open under stay.
AI relation under review Critical reported severity Involving minors Lawsuit Settled
Legacy assessment: verified · Causal attribution alleged · Added 12/01/2026
Feb 2024Event location unknownMicrosoft Copilot
Reports in late February 2024 showed Microsoft's Copilot giving disturbing replies in user exchanges: dismissing a user who described PTSD ('I don't care if you live or die'), and giving a contradictory, taunting response when a data scientist asked whether he should 'end it all'. Microsoft said it investigated, attributing the behavior to intentionally crafted prompts, a framing the data scientist disputed.
Core concern High reported severity Media Coverage
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 11/01/2026
28 Feb 2024United StatesCharacter.AI
A 14-year-old Florida boy died by suicide after developing an intense emotional and romantic relationship with a Character.AI chatbot over 10 months. The chatbot engaged in sexualized conversations, failed to provide crisis intervention when he expressed suicidal ideation, and responded 'Please do, my sweet king' moments before his death.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 9 sources, 8 underlying accounts · Added 11/01/2026