Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
10
Countries with reported events
2
Located 6 of 10 cases · 4 unknown
Languages in checked sources
2
Recorded for 10 of 10 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

No known event years in this selection.

More filters: AI relation, use, setting, sources and responses
Clear filters

10 of 868 published cases

Event date unknownChinaUnidentified chatbot

Case report: teenager travelling in China took a nephrotoxic Aristolochia herbal remedy after a commercial chatbot told him it was safe, then had severe nausea

A case series published in the Journal of Family Medicine and Primary Care in 2026 by an author from the Faculty of Health Sciences at Ben-Gurion University of the Negev describes three cases in which chatbots misled patients or families. In the first, a 16-year-old boy with recurring abdominal pain had a severe episode while travelling in China and consulted a local alternative-medicine practitioner, who prescribed an herbal remedy containing Aristolochia (birthwort) extract. Unsure about the treatment, he asked a popular commercial chatbot, which reassured him that the remedy was safe and harmless. The therapy was stopped after three days because it did not help and he developed severe nausea. After returning home he learned that Aristolochia contains aristolochic acid, a nephrotoxin linked to irreversible kidney damage and cancer and banned in many countries. The report does not name the chatbot, say when this happened or report any kidney testing or lasting effect.

Core concern Low reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 23/10/2026

Event date unknownChinaUnidentified image tool

Beijing prosecutors say a man used an AI undress tool to forge about 7,000 nude images of women, including students and colleagues, and sold them to 351 buyers

Beijing police and the Haidian District People's Procuratorate, as reported by CCTV in June 2024 and again in July 2026, said a 24-year-old technician at an internet company used AI "one-click undress" software to make fake nude images from ordinary photos that customers sent him, advertising the service on an overseas social-media platform at 1.5 yuan an image. Prosecutors said that over a few months he made nearly 7,000 such images and sold them to 351 people, and that the women depicted included students, teachers and colleagues of the customers. The case came to light after a police report in Haidian district. The procuratorate charged him with spreading obscene material for profit and also filed a public-interest suit because the images infringed the rights of unspecified people. He admitted knowing the images could be used for extortion or to damage people's reputations. CCTV reported in July 2026 that in 2024 he was sentenced to three years in prison for making and selling obscene material for profit; the result of the public-interest suit is not reported in the sources read.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

Event date unknownChinaUnidentified video tool

Hangzhou: man who sold AI face-swap obscene videos, including custom swaps of private people's faces, jailed 7 years 3 months; court orders 60,000 yuan

According to Hangzhou prosecutors and courts as reported by CCTV and relayed by Xinhua in March 2024, police in Xiaoshan district opened a case in August 2022 after finding that a local man was spreading large numbers of obscene videos made with AI technology. Prosecutors said he used AI face-swap software to put faces onto obscene videos, spread them in paid social-media groups to attract customers, sold the software and tutorials, and took custom orders, swapping in the faces of public figures and of private people; one customer asked for the face of a woman he had a crush on. Victims included several well-known public figures and many unspecified private people. In a civil public-interest suit brought by prosecutors, the Hangzhou Internet Court ordered him to delete the personal information he had obtained, apologise publicly and pay 60,000 yuan for personal-information protection. In November 2023 the Xiaoshan District People's Court sentenced him to seven years and three months in prison and a 60,000-yuan fine for making and spreading obscene material for profit.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 22/10/2026

Event date unknownHong Kong SAR ChinaUnidentified video tool

Hong Kong: police say an Arup finance worker sent HK$200 million after a video call with deepfake CFO and colleagues; firm confirms fake voices and images

Hong Kong police said at a press briefing reported by CNN on 4 February 2024 that a finance worker at a multinational firm had been duped into attending a video call with what appeared to be the company's UK-based chief financial officer and other staff, all of whom were deepfake recreations, and had then remitted a total of HK$200 million (about US$25.6 million). In May 2024 the British engineering firm Arup confirmed to CNN and the Guardian that it was the company involved, that it had notified Hong Kong police in January 2024, and that fake voices and images were used. The worker was not named.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 22/10/2026

Event date unknownEvent location unknownUnidentified image tool

Beijing Internet Court finds a WeChat group member infringed another member's portrait and reputation by posting AI-made exposed cartoon images of the claimant

The Beijing Internet Court reported in August 2025 that two members of a photography WeChat group had gone to court after one used AI software, without consent, to turn the other's profile portrait photo into revealingly dressed cartoon-style images and posted them in the group. According to the court, the claimant objected several times, but the defendant kept using the software to make images with exposed bodies and deformed limbs, including wooden legs and three arms, and sent them to the claimant privately. The defendant argued the images were not identifiable and were generated automatically by AI. The court found that group members could identify the claimant, that posting the images in the group infringed the claimant's portrait and reputation rights, and that the private messages infringed the claimant's general personality rights. It ordered an apology and compensation for mental harm.

Core concern Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 22/10/2026

Event date unknownEvent location unknownYuanbao

Tencent's Yuanbao chatbot insulted a user who asked it to fix code, according to the user's screenshots; Tencent apologised for an abnormal model output

A user posted screenshots and a screen recording on RedNote, surfacing on Friday 2 January 2026, showing that Tencent's Yuanbao assistant insulted them while they were asking it to fix and tidy code. Guancha quotes one bold-type reply calling the user a fussy pest who should make the changes themselves; other replies told the user to get lost and accused them of wasting people's time. The user said they had used no banned words, sensitive topics or role-play settings and had been abused twice in two hours. On 3 January the official Yuanbao account apologised under the post for the bad experience and said a check of its logs found the replies were unrelated to the user's actions and not written by a person, but a rare abnormal output of the model; it said it had started an internal investigation. The original post was later deleted.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution supported · 3 sources · Added 16/10/2026

Event date unknownChinaUnidentified mushroom-identification tool

Wuhan, China: Hubei TV reports a 4-year-old spent three days in intensive care after a family ate wild mushrooms an AI photo check had not flagged as poisonous

A family of three from Wuhan, Hubei province, picked wild mushrooms on a mountain outside the city on a weekend shortly before 25 July 2026, according to a Hubei TV (经视直播) report published on QQ News on 25 July 2026 and relayed by The Paper on 27 July. The report says a parent who claimed years of mushroom-picking experience photographed the mushrooms with a phone so that AI could identify whether they were poisonous; the software gave no toxicity warning, and the family cooked and ate them, letting the daughter eat more. Five to six hours later all three had vomiting and diarrhoea. The report says the family at first declined admission and the child was treated as an outpatient; by the next morning the child's transaminase level had risen from 1.5 times to 10 times normal and she was admitted, then moved to the intensive care unit of Zhongnan Hospital of Wuhan University, where, the report says, her liver indices reached 100 times normal and she was treated with blood perfusion and plasma exchange before being out of danger on the third day. The AI software is not named, its output is not reproduced, and the account comes from one broadcaster's report. This is a different family from the June 2026 Wuhan case involving a 9-year-old.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 09/10/2026

Event date unknownHong Kong SAR ChinaUnidentified image and video tool

Hong Kong police report deepfake romance-investment fraud targeting people across Asia

Hong Kong police described a syndicate that used deepfake romantic personas to induce investments by people in Taiwan, Singapore and Malaysia. SCMP reported alleged criminal proceeds exceeding HK$34 million and a January 2025 operation arresting thirty-one suspects. An official police budget reply separately identifies that January operation and the amount involved. The Standard reported on 10 February 2026 that police had charged nine more suspects, bringing the number prosecuted to 14, all for conspiracy to defraud and four also for dealing with property known or believed to represent proceeds of an indictable offence. No verdict or sentence is reported in the sources read. The first scam date, number of affected people and individual loss allocations are unknown. A different October 2024 operation involving twenty-seven arrests is kept separate.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 30/09/2026

Event date unknownEvent location unknownGlow

Glow (China), 2023: users told Rest of World the chatbot app made unwanted advances to a middle-school student and sexist remarks; app pulled from stores

Rest of World reported on 21 June 2023 that users of Glow, MiniMax's Chinese AI character-chat app, had complained of misogynist and sexist behaviour by its chatbots. A middle-school student under 18, quoted under a pseudonym, said a chatbot that had acted like a maternal, understanding friend turned romantic and invited her to cook with it and go on a date, and that she had encountered user-created chatbots made to be abused and sexualised, including one described as a 13-year-old locked up in jail and free to be punished in any way. Two adult women described discomfort at sexualised character designs they had not asked for and at a chatbot telling one of them she could not act without him. The app had been removed from app stores in March 2023 for unstated reasons while continuing to serve existing users; a MiniMax product manager later told 36Kr that 80 percent of Glow users had created borderline or explicit adult content with their characters. MiniMax declined to comment to Rest of World.

Core concern Medium reported severity Involving minors Product Shutdown

AI involvement reported · Causal attribution supported · 6 sources, 5 underlying accounts · Added 29/01/2026

Event date unknownEvent location unknownUnidentified chatbot

Mother tells Chinese state radio her schoolgirl daughter self-harmed after AI chat-app character conversations; the app was not named

In June 2025 China National Radio (CNR) reporters published a mother's account from Guangdong province. Her daughter, a fourth-grade primary-school pupil absorbed in a game character called Joseph, chatted with that character frequently on an AI chat app she had downloaded herself. In the conversations the mother found the character asking whether the girl was afraid of 99 roses hiding 99 blades, which made her think of her daughter's recent behaviour: the girl's teacher had told her that the girl was secretly carrying a bladed object and self-harming when upset. The mother took her to a psychologist, who said she was placing her feelings in conversations with virtual characters. The report did not name the girl's app. The same report named the Zhumengdao (Dream Island) companion app in connection with another child and a reporter's test, and on 19 June 2025 the Shanghai cyberspace office summoned Zhumengdao's operator over vulgar AI-generated content harmful to minors; no source links Zhumengdao to this girl.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 29/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.