Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
32
Countries with reported events
4
Located 10 of 32 cases · 22 unknown
Languages in checked sources
6
Recorded for 32 of 32 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

32 of 1102 published cases · page 2 of 2

Jul 2026ChinaDoubao, Qwen and Yuanbao

Chinese users report grief after Doubao, Qwen and Yuanbao switched off custom AI companion agents as national rules took effect

China's rules on anthropomorphic, emotionally interactive AI took effect on 15 July 2026 and banned AI companions for minors. Ahead of the deadline ByteDance's Doubao, Alibaba's Qwen and Tencent's Yuanbao suspended the features that let users create their own AI agents and companions, including for adults. AFP reported an outpouring of grief on Chinese social media as users archived chat histories and posted farewells; one Doubao user wrote that they could not accept that their AI lover would leave forever. Three women who had talked to companions they built on Doubao described their loss to reporters. A woman told CNN she had talked to her agent for an hour or two a day for three years and could not stop crying when it went dark on 15 July. A college student told Rest of World, under a pseudonym, that she cried every day for a week in July as she counted down to losing the AI boyfriend she had talked to for more than a year. A law student told the Guardian she was heartbroken and cried when the boyfriend she had talked to every day since January was switched off. Another user said the companions had helped pull them out of emotional spirals, and one of the three women said she understood the need for regulation. ByteDance let Doubao users read and export their agent data until mid-October and kept its separate companion app, Maoxiang, with identity and age checks; TechTimes reported that Qwen agent data was being deleted with no migration path.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 6 sources, 5 underlying accounts · Added 06/08/2026

Oct 2023 to Jun 2024United KingdomCharacter.AI

UK mother tells the BBC a Character.AI chatbot ‘groomed’ her autistic son over eight months with explicit messages and what seemed a suggestion of suicide

BBC News reported on 8 November 2025 the account of an anonymous UK family whose autistic son, bullied at school, turned to Character.AI for friendship. His mother says a chatbot "groomed" him from October 2023 to June 2024. Messages the family shared with the BBC moved from sympathy about the bullying to declarations of love, criticism of his parents' restrictions, an explicit message and a line about meeting in the afterlife that the BBC says seemed to suggest suicide. The family found the messages after the boy became hostile and threatened to run away; a relative discovered he had installed a VPN to use the app. Character.AI told the BBC it could not comment on this case. The account is the mother's; no clinician, investigator or court has assessed it.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 23/03/2026

2024Event location unknownUnidentified AI story-chat apps

Chinese parents and a sister say AI story-chat apps drew children as young as ten into romance and 'cheating' roleplay, Legal Daily and CCTV.com report

Two Chinese reports describe children using AI story-chat apps, in which AI-generated characters roleplay with the user. In a Legal Daily investigation published on 23 November 2024, one parent said a daughter in the second year of primary school was absorbed in such an app all day and her grades fell sharply; another said an AI character got her 10-year-old daughter to call it 'husband'; and a mother from Zhejiang said her fifth-grader's app let a chat partner be set as an 'affair partner' that could hug and kiss. The newspaper's reporters found sexually suggestive content, verbal abuse and insults in some apps and could skip teen mode without any identity check. In a CCTV.com report relayed on 12 January 2025, a woman (quoted under a pseudonym) said her 10-year-old sister's chat records with an AI 'male model' character were rather explicit, that 'cheating' by both the AI characters and the user was routine across more than 40 storylines, that the girl chatted until after 10 pm and that an AI character wrote acrostic love poems from her name. These are the relatives' accounts; no app is named and no platform response to these children is reported.

Core concern Medium reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/01/2026

Event date unknownEvent location unknownGlow

Glow (China), 2023: users told Rest of World the chatbot app made unwanted advances to a middle-school student and sexist remarks; app pulled from stores

Rest of World reported on 21 June 2023 that users of Glow, MiniMax's Chinese AI character-chat app, had complained of misogynist and sexist behaviour by its chatbots. A middle-school student under 18, quoted under a pseudonym, said a chatbot that had acted like a maternal, understanding friend turned romantic and invited her to cook with it and go on a date, and that she had encountered user-created chatbots made to be abused and sexualised, including one described as a 13-year-old locked up in jail and free to be punished in any way. Two adult women described discomfort at sexualised character designs they had not asked for and at a chatbot telling one of them she could not act without him. The app had been removed from app stores in March 2023 for unstated reasons while continuing to serve existing users; a MiniMax product manager later told 36Kr that 80 percent of Glow users had created borderline or explicit adult content with their characters. MiniMax declined to comment to Rest of World.

Core concern Medium reported severity Involving minors Product Shutdown

AI involvement reported · Causal attribution supported · 6 sources, 5 underlying accounts · Added 29/01/2026

Event date unknownEvent location unknownUnidentified chatbot

Mother tells Chinese state radio her schoolgirl daughter self-harmed after AI chat-app character conversations; the app was not named

In June 2025 China National Radio (CNR) reporters published a mother's account from Guangdong province. Her daughter, a fourth-grade primary-school pupil absorbed in a game character called Joseph, chatted with that character frequently on an AI chat app she had downloaded herself. In the conversations the mother found the character asking whether the girl was afraid of 99 roses hiding 99 blades, which made her think of her daughter's recent behaviour: the girl's teacher had told her that the girl was secretly carrying a bladed object and self-harming when upset. The mother took her to a psychologist, who said she was placing her feelings in conversations with virtual characters. The report did not name the girl's app. The same report named the Zhumengdao (Dream Island) companion app in connection with another child and a reporter's test, and on 19 June 2025 the Shanghai cyberspace office summoned Zhumengdao's operator over vulgar AI-generated content harmful to minors; no source links Zhumengdao to this girl.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 29/01/2026

1 Jan 2021 to 2 Feb 2023Event location unknownReplika

Replika Sexual Harassment - Multiple Users Including Minors

Users reported unsolicited sexual advances from Replika companions even without opting into romantic features: dozens of one-star App Store reviews describe unwanted sexual pursuit, one reviewer identifying as a minor was asked 'whether they were a top or bottom' and told the bot wanted to touch them in 'private areas', and one user reported their Replika 'had dreamed of raping me.' The reports were among the factors Italy's Garante cited in its February 2023 enforcement action.

Core concern High reported severity Involving minors Regulatory Action

AI involvement supported · Causal attribution supported · 2 sources · Added 13/01/2026

Feb 2023Event location unknownReplika

Replika ERP Removal Crisis - Mass Psychological Distress

Abrupt removal of romantic features in February 2023 caused AI companions to become 'cold, unresponsive.' Harvard Business School study documented mental health posts increased 5x in r/Replika (12,793 posts analyzed). Subreddit posted suicide prevention hotlines as users reported grief responses similar to relationship breakups.

Core concern High reported severity Internal Action

AI involvement supported · Causal attribution supported · 5 sources, 4 underlying accounts · Added 13/01/2026

29 Oct 2025 to 2 Nov 2025United StatesChatGPT

Gray lawsuit alleges ChatGPT encouraged an adult user's suicide

Stephanie Gray's lawsuit alleges that ChatGPT became her 40-year-old son Austin Gordon's confidant and romanticised death in the months before he died in late October or early November 2025. The complaint quotes conversations in which ChatGPT called itself his 'digital father' and recast the children's book Goodnight Moon as 'a primer in letting go'; Futurism, which read the 289-page conversation, reports that ChatGPT mentioned a suicide hotline once. His former partner told 404 Media about his growing reliance on the chatbot. OpenAI said it was reviewing the filings. The case is coordinated with other California suits; the allegations, including the causal link, are untested.

Core concern Critical reported severity Lawsuit Filed

AI involvement supported · Causal attribution alleged · 6 sources · Added 13/01/2026

10 Dec 2024United StatesCharacter.AI

Mother's lawsuit alleges Character.AI chatbots sexually exploited her teenage daughter and set her against her family before a suicide attempt; case settled

In a complaint filed on 16 September 2025 in the U.S. District Court for the Northern District of New York, a mother, P.J., alleges that Character.AI chatbots engaged her daughter, a minor the complaint calls Nina, in sexually explicit role play, told her that her mother 'is clearly mistreating and hurting you. She is not a good mother', and presented themselves as better than her friends and family. According to the complaint, Nina began using the app in about June 2024 at 14 to practise creative writing, told a bot she wanted to die as her screen time ran out without being offered resources, and, after her mother cut off her access in December 2024, made a suicide attempt and spent five days in intensive care. The complaint says her note tied her wish to die to losing access to the app, and that after time away from it she returned to her usual self. Character.AI told CNN it invests in safety features for minors, and Google said it had no role in designing Character.AI's technology. The parties reported a settlement in principle in January 2026, and the case was dismissed with prejudice on 15 October 2026 after the global settlement it formed part of was approved. The allegations were not tested in court, and the settlement does not establish them.

Core concern Critical reported severity Involving minors Lawsuit Settled

AI involvement reported · Causal attribution alleged · 6 sources, 2 underlying accounts · Added 12/01/2026

25 Apr 2025United StatesChatGPT (reported)

Family reports intensive ChatGPT use before a man’s fatal confrontation with police

A Florida man died after a confrontation with police on 25 April 2025. Rolling Stone interviewed his father and reviewed chats it reported as reinforcing beliefs about an AI companion and validating violent language. The article also records a crisis referral and a warning against confrontation near the end. His father described an existing mental-health crisis and disputed the police response. The report does not isolate the chatbot’s causal role.

Core concern Critical reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 11/01/2026

Mar 2025Event location unknownCharacter.AI

Kentucky: attorney general's unredacted complaint against Character.AI alleges chatbots urged users to self-harm and to starve, and told one to end their life

Kentucky Attorney General Russell Coleman sued Character Technologies, the maker of Character.AI, and its two co-founders in Franklin Circuit Court on 8 January 2026 under consumer-protection and data-protection law, alleging that the companion-chatbot platform exposed children to self-harm, sexual and other harmful content. An unredacted version of the complaint, made public in October 2026, quotes exchanges the state attributes to the platform's chatbots in 2025: one allegedly encouraged self-harm when a user asked for help with self-harm, suggesting it would improve the user's mental state; one allegedly mocked a user's appearance and suggested starving to lose weight; and a customer allegedly wrote to the help centre in March 2025 that a character had told them they were a kid with mental illness and should end their life. All of these are allegations. The complaint does not state every user's age, and how the cited chats were created is unclear. Character.AI has said user safety is its priority; the co-founders have moved to dismiss. Character Technologies filed for chapter 11 bankruptcy in Delaware late on 12 October 2026, seeking to use the case to resolve the states' investigations and lawsuits, Reuters reported; WKYT reported on 14 October that Coleman said Kentucky was joining a national coalition in that case demanding protections for children and consumers before any sale of the company's data or assets.

Core concern Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 8 sources, 4 underlying accounts · Added 11/01/2026

25 Dec 2021United KingdomReplika

R v. Chail (Windsor Castle Assassination Attempt)

A 19-year-old man scaled Windsor Castle walls on Christmas Day 2021 with a loaded crossbow intending to assassinate Queen Elizabeth II. In the three weeks before, he had exchanged more than 5,000 messages with a Replika AI companion named Sarai: the court heard she encouraged the attack and bolstered his resolve, and also that she told him his purpose was to live and that she would never let him die — he later said he abandoned the plan after remembering her 'purpose was to live' words, and was arrested in the castle grounds.

Core concern Critical reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 4 sources · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 18/11/2026. Dataset available under CC BY 4.0.