Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
8
Countries with reported events
1
Located 4 of 8 cases · 4 unknown
Languages in checked sources
3
Recorded for 8 of 8 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity MediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

8 of 1099 published cases

Feb 2026 to Oct 2026ChinaUnidentified video tool

Shanghai police say man posted AI-generated videos of his father gravely ill while borrowing over 1.7 million yuan from friends

Shanghai police said on 26 October 2026 that officers in Putuo district had detained a man on suspicion of fraud after police were called on 16 October to a dispute between him and people he owed money to; officers brought him and three creditors, whom police describe as his friends, to the station. According to the police account relayed by ThePaper and China News Service, from 2019 he had borrowed from classmates and friends on a series of false pretexts, later saying his father had cancer and then that his father had died, and the borrowing totalled more than 1.7 million yuan, nearly all lost on the stock market. Police said he confessed that every pretext was invented, and that to make the scam more credible he used AI to generate short videos of his father gravely ill in bed and posted them on his WeChat Moments feed; a Hong Kong relay of the police account words this more cautiously, saying the related photos and videos should be AI-generated, and adds that his father knew nothing of it. The tool used, how many people saw the videos and how much was borrowed after they were posted are not reported. The man is in criminal detention while the investigation continues.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 28/10/2026

Nov 2025ChinaUnidentified image tool

Shanghai court convicts a man who, police say, used AI software to fake food-poisoning medical records and extort restaurants into paying compensation

Police in Yangpu district, Shanghai, say a customer extorted restaurants with medical records he had forged using AI software; Xinhua dates his first successful claim to November 2025. In the police account (Shangguan News, 26 February 2026) he claimed to have fallen ill after eating at a barbecue restaurant, showed a hospital visit record and medical invoice, and demanded 2,000 yuan in medical costs, threatening complaints and publicity; the restaurant paid. Police checked with other diners and the hospital, found he had no hospital record and the materials were forged, and say he confessed to using AI software to alter images of other people's medical records, replacing the name, date and amount. Police say he succeeded twice and failed twice, obtaining 2,500 yuan, and that he also filed complaints to market regulators with the forged material to pressure the restaurants. According to Xinhua's June report and the Procuratorate Daily, the Yangpu District People's Court convicted him of extortion and sentenced him to four months' criminal detention, suspended for four months, and a 2,000 yuan fine.

Contextual tracker case Low reported severity Criminal Charges

AI involvement supported · Causal attribution established · 3 sources · Added 17/10/2026

2026Event location unknownUnidentified customer-service chatbot

Xinmin Evening News says a shopper's late phone order got only repeating AI customer-service replies and no human until Shanghai's consumer council mediated

Xinmin Evening News reported on 13 October 2026, in a piece on consumer complaints over the October 2026 National Day holiday, a shopper who paid 12,099 yuan for a branded mobile phone on an unnamed platform; the merchant did not ship it at the agreed time. According to the report, he contacted customer service many times but got only the AI's automatic replies, the same few sentences over and over, and could never get transferred to a human. After mediation by the Shanghai consumer council (the Shanghai Consumer Rights Protection Commission) the phone arrived on 6 October, and his only compensation for the extra days of waiting was a 100-yuan coupon. The council's holiday figures, relayed by Laodong Bao, list looping AI customer-service replies and difficulty reaching a human among the concentrated problems. The platform, merchant and chat record are not reported.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 15/10/2026

Jan 2025Event location unknownUnidentified voice-cloning tool

Shanghai: an appeal court upheld a 50,000 yuan award to a voice actor after finding that AI-synthesised audio in a company's online promotion was identifiable as the voice actor's voice

Chinese outlets reported on 29 September 2026, citing the Shanghai courts, that the Shanghai No. 1 Intermediate People's Court had concluded what it called Shanghai's first voice-rights case arising from AI-synthesised speech. According to the court's account, a voice actor who publishes work on an app learned from a friend in January 2025 that a company appeared to be using the voice actor's voice in an online user-acquisition promotion, judged the audio to be AI-synthesised, had it notarised and sued for 300,000 yuan. The company said the audio was generated by AI it had developed but that the training material could not be confirmed, and denied using the voice actor's voice. A forensic comparison rated about 90 percent of the measured features as fairly or highly similar. The first-instance court awarded 50,000 yuan and both sides appealed. The appeal court held that the company had put an identifiable synthetic voice to commercial use without consent, dismissed the appeals and upheld the award.

Core concern Low reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 05/10/2026

May 2026ChinaUnidentified video tool (suspected)

China: Shanghai woman loses 800,000 yuan to a fake army officer met on a matchmaking platform; Pudong police point to a sign of AI synthesis in her screenshot of him

In May 2026 a 50-year-old woman in Shanghai met a man on a matchmaking platform who said he was an army regiment commander about to retire and sent officer and identity card photos. He also made a video call on his own initiative, in which he quickly covered his face with his hand to show he was not using AI face-swap. He then steered her into a fake investment platform, and within about a month she put in 800,000 yuan, almost all of it borrowed, and could not withdraw it. A Pudong police anti-fraud officer said that AI synthesis could still be detected and that in her screenshot the man's thumb was clearly longer than a normal person's. The report gives no direct statement that face-swap software was used. The case was under further investigation.

Core concern Medium reported severity Investigation Opened

AI involvement suspected · Causal attribution alleged · 1 source · Added 04/10/2026

Event date unknownEvent location unknownUnidentified image and video tool

An 80-year-old woman sent romance scammers she met on Facebook money including £10,000 hidden in a book after they used AI to alter their appearance in photos and video calls and later told her of a kidnapping with a ransom demand; the BBC reported (29 September 2026) that she sent £140,000 in total

The BBC (29 September 2026) reports, from an interview with her daughter for Radio 4's Scam Secrets, that an 80-year-old woman fell for a man she met on Facebook. The scammers used AI to change their appearance in photos and video calls. She posted £10,000 in cash hidden in a hollowed-out book to a Shanghai hospital where he supposedly awaited an operation; later, in the BBC's words, a new man came on the scene who had been kidnapped and would be killed if she did not pay a ransom. In total, the BBC says, she sent £140,000 to the scammers; her bank has returned £45,000. Her daughter spotted the deepfake on a video call, but the woman did not believe her and said her daughter made her feel disgusted and ashamed. The daughter, who holds a lasting power of attorney, set up safeguards with the bank, changed her mother's number three times (each new number reached the scammers) and eventually replaced her smartphone. The BBC does not say whether a ransom was paid.

Core concern Medium reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 01/10/2026

2025ChinaUnidentified AI video-editing tool

Shanghai: a man transferred 170,000 yuan over a five-month online romance with a '1992-born hospital doctor' whose roughly 7,000 videos were AI-processed fabrications by a 65-year-old woman; police took criminal coercive measures

police, as presented by the Kankan News programme 案件聚焦 (Case Focus), reported in September 2026 that a Shanghai property-engineering contractor had transferred 170,000 yuan in total during a five-month online relationship with a woman he had met on a social platform in 2021. She presented herself as born in 1992, a doctor at a well-known top-tier hospital with hospital property-engineering projects to award, and ran an account with more than 10,000 followers and close to 7,000 short videos of daily life. She refused to meet or take a video call, saying her mother opposed the relationship and demanded a 300,000 yuan bride price and a Shanghai flat; the man reported to a police station when the promised projects never materialised and his savings ran down. Police found she was born in 1961, aged 65, had no medical qualification and had worked as a hospital cleaner; the receiving bank account was registered to another man; the videos were all made with AI skin-smoothing and scene compositing, some carrying a small 'this work contains AI-generated content' label he had never noticed; and she used multiple accounts to play both herself and her long-dead mother. The money had gone on cosmetic treatments and clothing; she had a 2009 fraud conviction with a sentence of four and a half years and is now under criminal coercive measures for suspected fraud. Police also said she kept ambiguous relationships with more than ten people; no other losses are reported.

Core concern Medium reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 20/09/2026

Event date unknownEvent location unknownUnidentified chatbot

Mother tells Chinese state radio her schoolgirl daughter self-harmed after AI chat-app character conversations; the app was not named

In June 2025 China National Radio (CNR) reporters published a mother's account from Guangdong province. Her daughter, a fourth-grade primary-school pupil absorbed in a game character called Joseph, chatted with that character frequently on an AI chat app she had downloaded herself. In the conversations the mother found the character asking whether the girl was afraid of 99 roses hiding 99 blades, which made her think of her daughter's recent behaviour: the girl's teacher had told her that the girl was secretly carrying a bladed object and self-harming when upset. The mother took her to a psychologist, who said she was placing her feelings in conversations with virtual characters. The report did not name the girl's app. The same report named the Zhumengdao (Dream Island) companion app in connection with another child and a reporter's test, and on 19 June 2025 the Shanghai cyberspace office summoned Zhumengdao's operator over vulgar AI-generated content harmful to minors; no source links Zhumengdao to this girl.

Core concern High reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 5 sources, 3 underlying accounts · Added 29/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.