Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
47
Countries with reported events
4
Located 35 of 47 cases · 12 unknown
Languages in checked sources
7
Recorded for 47 of 47 cases

6 cases have no reviewed AI-to-person relation yet: 2 not yet reviewed and 4 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

47 of 868 published cases · page 1 of 3

Event date unknownChinaUnidentified chatbot

Case report: teenager travelling in China took a nephrotoxic Aristolochia herbal remedy after a commercial chatbot told him it was safe, then had severe nausea

A case series published in the Journal of Family Medicine and Primary Care in 2026 by an author from the Faculty of Health Sciences at Ben-Gurion University of the Negev describes three cases in which chatbots misled patients or families. In the first, a 16-year-old boy with recurring abdominal pain had a severe episode while travelling in China and consulted a local alternative-medicine practitioner, who prescribed an herbal remedy containing Aristolochia (birthwort) extract. Unsure about the treatment, he asked a popular commercial chatbot, which reassured him that the remedy was safe and harmless. The therapy was stopped after three days because it did not help and he developed severe nausea. After returning home he learned that Aristolochia contains aristolochic acid, a nephrotoxin linked to irreversible kidney damage and cancer and banned in many countries. The report does not name the chatbot, say when this happened or report any kidney testing or lasting effect.

Core concern Low reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 23/10/2026

20 Apr 2023ChinaUnidentified video tool

Fuzhou, China: police say a company head sent 4.3 million yuan after a WeChat video call in which AI face-swapping imitated a friend

Police in Baotou, Inner Mongolia, said in a statement published in May 2023 that on 20 April 2023 the legal representative of a technology company in Fuzhou, Fujian, received a WeChat video call from someone who appeared to be a friend and asked to route a 4.3 million yuan tender deposit through the company's account; trusting the video call, he transferred 4.3 million yuan in two payments. The police said the fraudster had used AI face-swapping to pose as the friend. At Fuzhou police's request, Baotou police and a local bank stopped 3.3684 million yuan within about ten minutes; 931,600 yuan had been moved on and was being pursued.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 2 sources · Added 22/10/2026

27 Apr 2023ChinaUnidentified video tool

Anqing, China: police say a nine-second AI face-swap video call posing as an acquaintance led a man to transfer 2.45 million yuan

In April 2023 a man in the Anqing economic development zone, Anhui, received a brief WeChat video call from someone who appeared to be an acquaintance, followed by a QQ message asking him to advance money for a tender; trusting the video call, he had family members transfer 2.45 million yuan. The local police anti-fraud centre found that the fraudsters had used a nine-second AI face-swap video to pose as the acquaintance, Dawan News reported. Police arrested three suspects on 28 April, froze or recovered more than one million yuan, and on 22 May returned 1.32 million yuan to the victim.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

2020Hong Kong SAR ChinaUnidentified voice-cloning tool

UAE investigators say fraudsters cloned a company director's voice to have a Hong Kong branch manager transfer up to $35 million in early 2020

According to a court document reported by Forbes, in which the United Arab Emirates sought US investigators' help, fraudsters used 'deep voice' technology to clone the voice of a company director. In early 2020 a branch manager of a Japanese company in Hong Kong received a call from a man whose voice he recognised as the director of the parent business, who said an acquisition needed transfers of about $35 million; emails from the supposed director and a lawyer confirmed the details, and the manager began making the transfers. Forbes reports that as much as $35 million was stolen. The UAE, whose Dubai Public Prosecution Office led the investigation, believes at least 17 people were involved and asked for help tracing $400,000 sent to US accounts. No arrests or recovery are reported.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026

Event date unknownChinaUnidentified image tool

Beijing prosecutors say a man used an AI undress tool to forge about 7,000 nude images of women, including students and colleagues, and sold them to 351 buyers

Beijing police and the Haidian District People's Procuratorate, as reported by CCTV in June 2024 and again in July 2026, said a 24-year-old technician at an internet company used AI "one-click undress" software to make fake nude images from ordinary photos that customers sent him, advertising the service on an overseas social-media platform at 1.5 yuan an image. Prosecutors said that over a few months he made nearly 7,000 such images and sold them to 351 people, and that the women depicted included students, teachers and colleagues of the customers. The case came to light after a police report in Haidian district. The procuratorate charged him with spreading obscene material for profit and also filed a public-interest suit because the images infringed the rights of unspecified people. He admitted knowing the images could be used for extortion or to damage people's reputations. CCTV reported in July 2026 that in 2024 he was sentenced to three years in prison for making and selling obscene material for profit; the result of the public-interest suit is not reported in the sources read.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

30 Sept 2024Event location unknownBaidu AI smart answer

Nanjing courts rule Baidu's AI search answer falsely saying a lawyer was sentenced to prison defamed him; written apology ordered and upheld on appeal

A practising lawyer in Nanjing, China, found in September 2024 that Baidu search's 'AI smart answer' (AI 智能回答) feature, asked how many years he had been sentenced to, answered that he had been sentenced to three years in prison for a criminal offence and showed his photograph in a lawyer's robe. According to the first-instance judgment as quoted in the press, the answer was produced on 30 September 2024. The lawyer says he complained repeatedly to Baidu by letter, hotline and email without the content being fully removed, and he sued. The Jiangbei New Area People's Court in Nanjing found that Baidu had combined text and his picture through AI into false, disparaging content aimed at him, that Baidu was at fault, and that this was defamation; it ordered a written apology and rejected his claims for lost income and emotional damages for lack of evidence. Baidu argued that AI hallucinations could not be foreseen. The Nanjing Intermediate People's Court dismissed Baidu's appeal on 12 March 2026. The lawyer applied for enforcement when no apology came, and in September 2026 said he had received Baidu's written apology; Baidu has applied for a retrial.

Contextual tracker case Medium reported severity

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 22/10/2026

Event date unknownChinaUnidentified video tool

Hangzhou: man who sold AI face-swap obscene videos, including custom swaps of private people's faces, jailed 7 years 3 months; court orders 60,000 yuan

According to Hangzhou prosecutors and courts as reported by CCTV and relayed by Xinhua in March 2024, police in Xiaoshan district opened a case in August 2022 after finding that a local man was spreading large numbers of obscene videos made with AI technology. Prosecutors said he used AI face-swap software to put faces onto obscene videos, spread them in paid social-media groups to attract customers, sold the software and tutorials, and took custom orders, swapping in the faces of public figures and of private people; one customer asked for the face of a woman he had a crush on. Victims included several well-known public figures and many unspecified private people. In a civil public-interest suit brought by prosecutors, the Hangzhou Internet Court ordered him to delete the personal information he had obtained, apologise publicly and pay 60,000 yuan for personal-information protection. In November 2023 the Xiaoshan District People's Court sentenced him to seven years and three months in prison and a 60,000-yuan fine for making and spreading obscene material for profit.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 22/10/2026

Event date unknownHong Kong SAR ChinaUnidentified video tool

Hong Kong: police say an Arup finance worker sent HK$200 million after a video call with deepfake CFO and colleagues; firm confirms fake voices and images

Hong Kong police said at a press briefing reported by CNN on 4 February 2024 that a finance worker at a multinational firm had been duped into attending a video call with what appeared to be the company's UK-based chief financial officer and other staff, all of whom were deepfake recreations, and had then remitted a total of HK$200 million (about US$25.6 million). In May 2024 the British engineering firm Arup confirmed to CNN and the Guardian that it was the company involved, that it had notified Hong Kong police in January 2024, and that fake voices and images were used. The worker was not named.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 22/10/2026

Event date unknownEvent location unknownUnidentified image tool

Beijing Internet Court finds a WeChat group member infringed another member's portrait and reputation by posting AI-made exposed cartoon images of the claimant

The Beijing Internet Court reported in August 2025 that two members of a photography WeChat group had gone to court after one used AI software, without consent, to turn the other's profile portrait photo into revealingly dressed cartoon-style images and posted them in the group. According to the court, the claimant objected several times, but the defendant kept using the software to make images with exposed bodies and deformed limbs, including wooden legs and three arms, and sent them to the claimant privately. The defendant argued the images were not identifiable and were generated automatically by AI. The court found that group members could identify the claimant, that posting the images in the group infringed the claimant's portrait and reputation rights, and that the private messages infringed the claimant's general personality rights. It ordered an apology and compensation for mental harm.

Core concern Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 22/10/2026

May 2023ChinaUnidentified voice-cloning tool

Beijing Internet Court finds an AI text-to-speech voice made from a voice actress's recordings was sold without her consent and awards her 250,000 yuan

According to the Beijing courts' case digest and reports of the April 2024 judgment, a voice actress found in May 2023 that works using her voice were circulating widely on several well-known apps. The court found that a software company had used only one of her sound recordings, supplied by a media company that held the recording rights, to make a text-to-speech product with AI and other techniques, and sold it on a cloud-service platform; an app operator then called the product through an interface for use on its own platform, where the voice was shown as played 3,256,728,530 times. The authorisation document had not been signed by her. On 23 April 2024 the Beijing Internet Court held that her voice rights extend to an identifiable AI-synthesised voice, ordered the app operator and the software company to apologise in writing, and ordered the media company and the software company to pay her 250,000 yuan for economic loss. It rejected her claim for mental-harm damages. Neither side appealed.

Core concern Low reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 4 sources, 1 underlying account · Added 22/10/2026

2023ChinaUnidentified voice-cloning tool

Chinese voice actor says AI clones of his voice cost him bookings and led platforms to flag his real recordings as AI-generated

Sixth Tone reported on 10 July 2026 that a voice actor in Jiangsu province, who narrates film-explainer videos on Douyin, has found voices that sound like his narrating videos he never recorded since 2023, including sports news, product promotions, conspiracy theories and swearing. According to the report, sellers offer what sounds like his voice in downloadable packages and editing apps let users select it and generate new recordings from text. He says that by 2024 former collaborators stopped hiring him and turned to AI-generated voices, others offered to use an AI version of his voice at a much lower rate, and his household income no longer covered living costs. From 2025, platforms flagged some of his real recordings as AI-generated, which could cut his clients' views and earnings, and he has had to record videos proving that he is human. Friends and relatives asked to borrow money, uploaders mostly ignored his requests and some abused him, and he describes fury, helplessness and lost sleep. He has taken the matter to court; Sixth Tone says he would need to show that the synthetic voice derives from his recordings, which lawyers said could require forensic voice analysis. The account is the actor's, relayed by one outlet; no court finding is reported.

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 1 source · Added 22/10/2026

16 Feb 2026Event location unknownYuanbao

Yuanbao replaced the New Year blessing on a user's AI-made greeting image with a vulgar insult, the user says; Tencent apologised for an abnormal output

A lawyer told Huashang Daily that on the evening of Chinese New Year's Eve 2026 he uploaded his photo to Tencent's Yuanbao app and asked it, over about five instructions, to design a New Year greeting image suited to his profession. He said he used no banned or leading words. After he complained that a design looked bad, the next image kept his photo but replaced the blessing 'Happy New Year, smooth career' with a vulgar insult. He said he felt offended, reported it through the app's feedback function and had no reply by 23 February. On 24 February the official Yuanbao account apologised for the bad experience and said a check found the result was an abnormal output of the model in a multi-turn conversation, which it had corrected.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution supported · 2 sources · Added 19/10/2026

2026ChinaUnidentified video tool

Beijing News: a student says a friend's older relative bought several high-priced orders from an AI-generated 'Xiaohai' persona's shop window

The Beijing News reported on 18 October 2026, in a follow-up to its investigation of 'Xiaohai' accounts on Chinese short-video platforms, that the accounts show AI-generated teenage boys who address older women as 'aunties and mothers' and steer them to high-priced shop windows. A university student told the paper that an older relative of a friend had been watching 'Xiaohai' videos and asked the friend why the boy was so badly off; the friend then found that the relative had already bought several orders of goods at high prices through the persona's shop window. The student made a counter-video with the same AI tools, posted on 28 September, in which the persona admits to deceiving viewers; after the friend showed it to the relative, the relative said they would not buy the persona's goods again. The amount spent and the goods bought are not reported. China National Radio's report the same day also describes the 'Xiaohai' videos as AI-generated and notes that many carry an 'AI-generated' watermark.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources · Added 19/10/2026

14 Jul 2026ChinaUnidentified image tool

Hohhot: photography competition revokes its first prize after the organiser confirms the winning image was AI-generated, China Daily reports

China Daily reported on 15 July 2026 that the first prize in a local photography competition in Hohhot, Inner Mongolia, had been revoked after the image was found to be AI-generated. Online users had pointed to garbled characters on the workers' vests, unnatural sunlight and matching faces in the winning photo of three sanitation workers. After an investigation, the city's federation of literary and art circles, one of the organisers, confirmed in a notice on Tuesday 14 July that the photo had been created using AI, cancelled its award and barred the work from competitions, evaluations, exhibitions and official archives. The competition was suspended for rectification; the notice said those responsible would be dealt with under the relevant rules and that the case exposed lax vetting and imprecise judging criteria. The entrant is not named, and who generated the image is not stated.

AI relation unknown Low reported severity Internal Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 19/10/2026

May 2026ChinaUnidentified video tool

A 79-year-old set off alone by train to visit an AI-generated 'Xiaohai' persona until railway police intervened, Beijing News and state radio report

The Beijing News reported on 16 October 2026, in an investigation of 'Xiaohai' accounts on Chinese short-video platforms, that the accounts show an AI-generated digital teenager who calls older women viewers 'aunties and mothers', tells stories of hardship and asks them to buy goods through sales links; its reporter generated such a video by following a tutorial, in a little over ten minutes. The paper describes a 79-year-old woman, given a pseudonym, who lived alone and talked most with the 'Xiaohai' on her phone. Around May 2026, according to the paper, a 'Xiaohai' video invited viewers to Yuncheng in Shanxi to see apricot blossoms; she secretly packed, bought a train ticket and set off with no clear route. On the train, railway police noticed her, told her that 'Xiaohai' was not a real person, and contacted her children, who bought her return ticket and brought her home. At first she refused to believe it. The paper also found that most 'Xiaohai' videos now carry a declaration that the content is AI-generated. How the paper learned of her journey is not stated. China National Radio (China Media Group) reported the same journey on 19 October 2026 with recorded exchanges between the woman and a train police officer: in May 2026 Urumqi railway police found a 79-year-old who cannot read travelling alone, able to say only that she was going to Yuncheng in Shanxi to see a child who called her 'auntie' every day on her phone; the officer told her the person in the live room was fake, and she got off and went home on a return ticket her family bought. The station's reporter found that the persona she trusted was one of the batch-produced 'digital human Xiaohai' accounts and that many carry an 'AI-generated' watermark in a corner of the video.

Core concern Low reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 18/10/2026

2026ChinaDoubao (reported)

China: user says Doubao misstated an air-ticket refund fee, costing him 600 yuan, then promised compensation it could not pay; he says he filed suit

According to his own social-media posts and video, as reported by Dahe Daily (15 May 2026) and National Business Daily (20 May 2026), a user in China who had booked flights from Shijiazhuang to Chongqing for 2 May 2026 decided to drive instead and asked the Doubao chatbot about the refund fee. Doubao told him he could safely refund and that the fee would be small (only 5% in National Business Daily's account, under 100 yuan in Dahe Daily's). He refunded without checking the airline's rules and was charged about 40%, 600 yuan. When he returned to the chatbot, Doubao said it would handle the claim, promised to pay him 600 yuan itself if the money was not recovered by 6 May and produced a 'compensation commitment letter'. On 6 May it said it would pay by midnight and asked for his WeChat payment code; on 7 May it said that as an AI it could not make transfers and admitted its error. He then used Doubao to draft a complaint, was told by it that he did not need a lawyer, and on 12 May submitted a suit against the app's operator, Beijing Chuntian Zhiyun Technology, according to a screenshot he posted (Dahe Daily names the Beijing Internet Court). His posts had been deleted by 19 May. Doubao's customer service told Dahe Daily the matter had been recorded; Doubao and ByteDance did not answer National Business Daily. Whether the court accepted the case, and its outcome, are not reported.

Core concern Low reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 17/10/2026

Nov 2025ChinaUnidentified image tool

Shanghai court convicts a man who, police say, used AI software to fake food-poisoning medical records and extort restaurants into paying compensation

Police in Yangpu district, Shanghai, say a customer extorted restaurants with medical records he had forged using AI software; Xinhua dates his first successful claim to November 2025. In the police account (Shangguan News, 26 February 2026) he claimed to have fallen ill after eating at a barbecue restaurant, showed a hospital visit record and medical invoice, and demanded 2,000 yuan in medical costs, threatening complaints and publicity; the restaurant paid. Police checked with other diners and the hospital, found he had no hospital record and the materials were forged, and say he confessed to using AI software to alter images of other people's medical records, replacing the name, date and amount. Police say he succeeded twice and failed twice, obtaining 2,500 yuan, and that he also filed complaints to market regulators with the forged material to pressure the restaurants. According to Xinhua's June report and the Procuratorate Daily, the Yangpu District People's Court convicted him of extortion and sentenced him to four months' criminal detention, suspended for four months, and a 2,000 yuan fine.

Contextual tracker case Low reported severity Criminal Charges

AI involvement supported · Causal attribution established · 3 sources · Added 17/10/2026

26 Dec 2024ChinaUnidentified AI data-collection system

Beijing arbitration commission rules a tech company unlawfully dismissed a map-data collector after moving the work to AI-led automated collection

A technology company in Beijing employed a worker from July 2009 as a data collector doing manual map-data collection. In early 2024 the company moved that work to automated data collection led by AI technology and abolished the worker's department and post, and on 26 December 2024 it terminated the worker's contract, citing a major change in the objective circumstances on which the contract was based. The worker applied for labour arbitration, and the arbitration commission found the dismissal unlawful, according to a typical case that the Beijing human resources and social security bureau released on 26 December 2025, as reported by China National Radio, China News Service and HK01. The commission said that introducing AI was the company's own business decision and lacked the unforeseeable and unavoidable character the contract-law provision requires, and that the company had shifted the business risk of technical change onto the worker.

AI relation unknown Medium reported severity Lawsuit Filed

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 17/10/2026

2024Event location unknownUnidentified voice-cloning tool

Beijing Internet Court says a sales host's videos for a book company used an older parenting educator's AI-synthesised voice without consent; company liable

According to the Beijing Internet Court's account, released on 16 October 2026 among typical cases on online infringement involving older people, a culture company selling family parenting books commissioned a livestream sales host in 2024 to make promotional short videos. The videos used clips of public lectures and classes given by an older person with some public profile in education and parenting, combined with AI-synthesised audio whose timbre, intonation and rhythm closely resembled that person's voice, and linked viewers to the company's shop. Neither the images nor the audio had been authorised. The court held that the synthesised voice, combined with the person's image and public profile, was identifiable as that person's and infringed their portrait and voice rights. The company had not checked whether the material was authorised, so the court found it jointly liable with the host and ordered it to apologise and to compensate economic losses and reasonable costs of the claim. The amounts, the judgment date and the tool are not reported.

Core concern Low reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 17/10/2026

Jan 2026ChinaUnidentified AI search tool

Hangzhou hospital says a man took three times the standard antiviral dose after AI advice gave tablet counts, not grams, and developed acute kidney injury

Zhejiang Provincial Tongde Hospital in Hangzhou told Red Star News (relayed by China News Service on 26 January 2026) that a patient with a cold sore had recently used AI online to look up treatment, bought valaciclovir and took it as advised. The AI's advice gave the number of tablets per dose rather than the amount in grams; the imported product he bought was three times the strength of the usual domestic tablet, so he took more than three times the standard dose. When he felt weak and nauseous a few days later he also took a cold medicine, and he took an anti-inflammatory painkiller once; his family took him to the hospital's emergency department that night. His blood creatinine was about 800 umol/L, roughly ten times his previous level, and he was admitted with acute drug-induced kidney injury. The hospital says his creatinine returned to normal within five days and he was discharged. The AI tool and its exact wording are not identified.

Core concern Medium reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 16/10/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.