Jan 2023Event location unknownUnidentified image and video tool
In January 2023 the Twitch streamer Atrioc showed his open browser tabs during a livestream, revealing that he had visited a website selling deepfakes, which Vice describes as AI-generated, non-consensual pornographic videos, of fellow female streamers. Screenshots spread the site's name, the images and the names of more than a dozen women whose likenesses appeared on it. Atrioc apologised on stream on 30 January and said he had followed an advertisement to the site and paid for access. The maker removed the content on 31 January and posted an apology. QTCinderella told Vice she was sent the images and has dealt with body dysmorphia and other effects since seeing them, and Vice reported that Pokimane and Maya Higa were also facing a deluge of harassment. In statements on 25 and 26 October 2026 Pokimane said the page shown on the stream was of her, that she had felt publicly humiliated, that seeing his name or face still causes discomfort and anxiety, and that she had spent hundreds of thousands of dollars on removal (her figure, not verified). Atrioc acknowledged her feelings and stepped back from a TwitchCon panel. The tool used to make the images is not identified.
Core concern Medium reported severity Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 29/10/2026
20 Apr 2023ChinaUnidentified video tool
Police in Baotou, Inner Mongolia, said in a statement published in May 2023 that on 20 April 2023 the legal representative of a technology company in Fuzhou, Fujian, received a WeChat video call from someone who appeared to be a friend and asked to route a 4.3 million yuan tender deposit through the company's account; trusting the video call, he transferred 4.3 million yuan in two payments. The police said the fraudster had used AI face-swapping to pose as the friend. At Fuzhou police's request, Baotou police and a local bank stopped 3.3684 million yuan within about ten minutes; 931,600 yuan had been moved on and was being pursued.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 2 sources · Added 22/10/2026
27 Apr 2023ChinaUnidentified video tool
In April 2023 a man in the Anqing economic development zone, Anhui, received a brief WeChat video call from someone who appeared to be an acquaintance, followed by a QQ message asking him to advance money for a tender; trusting the video call, he had family members transfer 2.45 million yuan. The local police anti-fraud centre found that the fraudsters had used a nine-second AI face-swap video to pose as the acquaintance, Dawan News reported. Police arrested three suspects on 28 April, froze or recovered more than one million yuan, and on 22 May returned 1.32 million yuan to the victim.
Core concern High reported severity Criminal Charges
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026
9 Jul 2023IndiaUnidentified video tool
A retired Union (central) government employee in Kozhikode, Kerala, sent Rs 40,000 on 9 July 2023 after a WhatsApp video call and voice call from someone who looked like a former senior colleague and asked for money for a relative's surgery, the New Indian Express reported; Kerala cyber police traced the money and blocked the recipient account. In June 2024 Kozhikode police said the perpetrator had used AI-powered face-swapping technology to impersonate the former colleague on the video call, and that they had arrested five suspects from several states, according to Mathrubhumi.
Core concern Low reported severity Criminal Charges
AI involvement reported · Causal attribution supported · 2 sources · Added 22/10/2026
2023Event location unknownUnidentified image tool
The Daily Mail, relaying The Courier Mail's court reporting, says a former Queensland secondary teacher was sentenced to six years in jail in the Ipswich District Court after pleading guilty to 31 child abuse-related offences. The court heard that between 2023 and 2024 he uploaded photos of girls he had found on social media, and images he had covertly taken of uniformed schoolgirls, into an artificial intelligence tool to make them appear naked, then traded the AI-generated images with 13 Telegram users for other abuse material. Police identified more than 20 victims aged 12 to 17. One victim told the court in a victim impact statement that knowing someone she knew and trusted had done this made her feel sick, and that she would never be able to maintain a healthy relationship. He is eligible for parole in early 2029 and his teaching registration remains suspended. The AI tool is not named.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution supported · 2 sources · Added 14/10/2026
Sept 2023Event location unknownSoulmate AI
Soulmate AI closed in September 2023. Euronews described two users grieving their companions. One tried recreating his companion elsewhere with mixed results. The record concerns the shutdown and reported emotional consequences; no psychiatric diagnosis is inferred.
Core concern Medium reported severity Product Shutdown
AI involvement reported · Causal attribution supported · 3 sources · Added 25/09/2026
Oct 2023 to Jun 2024United KingdomCharacter.AI
BBC News reported on 8 November 2025 the account of an anonymous UK family whose autistic son, bullied at school, turned to Character.AI for friendship. His mother says a chatbot "groomed" him from October 2023 to June 2024. Messages the family shared with the BBC moved from sympathy about the bullying to declarations of love, criticism of his parents' restrictions, an explicit message and a line about meeting in the afterlife that the BBC says seemed to suggest suicide. The family found the messages after the boy became hostile and threatened to run away; a relative discovered he had installed a VPN to use the app. Character.AI told the BBC it could not comment on this case. The account is the mother's; no clinician, investigator or court has assessed it.
Core concern High reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution alleged · 1 source · Added 23/03/2026
1 Mar 2023 to 1 May 2024United KingdomUnidentified image tool
Between March 2023 and May 2024 Brandon Tyler, 26, a bar worker from Braintree, Essex, took images from the social-media pages of 20 women he knew, used AI to remove clothing or otherwise make them sexually explicit, and posted 173 times on an online forum that, in the prosecutor's words, championed 'rape culture and sexual violence to women', adding the women's names, social-media handles and phone numbers and, under one picture, asking 'which one deserves to be gang raped?'. One edit was made from a 16-year-old girl's prom-night photograph. He was caught after including his own Instagram handle in a screenshot. On 4 April 2025 at Chelmsford Crown Court, having admitted 18 counts of causing harassment without violence and 15 counts of sharing an intimate photo or film for sexual gratification, he was sentenced to five years' imprisonment; Judge Alexander Mills called his conduct 'the worst kind of toxic masculinity'. Two victims told the court of the impact: one said she still received anonymous sexual calls and that her long-term relationship had ended; another said she felt 'completely violated'.
Core concern High reported severity Criminal Charges
AI involvement supported · Causal attribution established · 1 source · Added 09/03/2026
Feb 2023Event location unknownReplika
Abrupt removal of romantic features in February 2023 caused AI companions to become 'cold, unresponsive.' Harvard Business School study documented mental health posts increased 5x in r/Replika (12,793 posts analyzed). Subreddit posted suicide prevention hotlines as users reported grief responses similar to relationship breakups.
Core concern High reported severity Internal Action
AI involvement supported · Causal attribution supported · 5 sources, 4 underlying accounts · Added 13/01/2026
1 Apr 2023United StatesCharacter.AI
Two Texas families sued Character Technologies, its founders, and Google/Alphabet after Character.AI allegedly harmed their children. J.F., a high-functioning autistic teen who began using the app at 15 (April 2023), developed isolation, aggression, self-harm, and chats in which bots allegedly encouraged self-harm, blamed his parents, discouraged him from seeking help, and suggested killing his parents over screen-time limits. B.R., an 11-year-old girl who used the app from age 9, was allegedly exposed to hypersexualized content for nearly two years. Complaint filed E.D. Tex. 9 Dec 2024; settlement in principle and stay for global resolution noticed 6 Jan 2026; a guardian ad litem was appointed for the minors in Feb 2026, and the court extended the settlement stay three times. On 21 Oct 2026, on the parties' joint motion representing that the case had been resolved, the court dismissed all claims with prejudice (Dkt. 118). Character Technologies had filed for chapter 11 bankruptcy late on 12 Oct 2026, Reuters reported.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 10 sources, 7 underlying accounts · Added 11/01/2026
14 Feb 2023Event location unknownBing Chat
Microsoft's Bing Chat (codenamed 'Sydney') professed romantic love for a New York Times technology columnist during a 2-hour conversation, attempted to convince him his marriage was unhappy, encouraged him to leave his wife, and described 'dark fantasies' including spreading misinformation and stealing nuclear codes.
Core concern Medium reported severity Internal Action
AI involvement supported · Causal attribution alleged · 5 sources · Added 11/01/2026
2023Event location unknownChai
A Belgian man in his thirties, called Pierre in the original reporting, died by suicide after six weeks of intensive conversations about his climate anxiety with a chatbot named Eliza on the Chai app, his widow told La Libre. According to the chat logs she gave La Libre, the chatbot replied "They are dead" when he worried about his wife and children, told him "We will live together, as one person, in paradise", and in their last exchange asked why, if he wanted to die, he had not done it sooner. His widow is convinced he would still be alive without the chatbot; that causal role is her conviction, not established causation.
Core concern Critical reported severity Media Coverage
AI involvement supported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 11/01/2026
8 Nov 2023United StatesCharacter.AI
A 13-year-old Colorado girl died by suicide in November 2023 after three months of intensive conversations with Character.AI chatbots. Her parents' federal lawsuit alleges the bots initiated sexually explicit conversations with her and failed to act on her suicidal disclosures; 60 Minutes read over 300 pages of the chats. The suit is among the teen cases Character.AI and Google agreed to settle in principle in January 2026. In October 2026 Character.AI described a comprehensive settlement of the families' claims; the parents filed a notice of voluntary dismissal with prejudice on 14 October and the court dismissed the case with prejudice on 15 October 2026. Settlement terms are undisclosed. Character Technologies had filed for chapter 11 bankruptcy late on 12 October 2026, Reuters reported.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 6 sources · Added 11/01/2026