Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
11
Countries with reported events
6
Located 7 of 11 cases · 4 unknown
Languages in checked sources
6
Recorded for 11 of 11 cases

3 cases have no reviewed AI-to-person relation yet: 3 not yet reviewed and 0 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

11 of 794 published cases

23 Sept 2024CanadaOtter.ai (reported)

Ontario hospital reports that an Otter.ai bot joined physicians' rounds through a former doctor's invite, recorded them and emailed patient information

An Ontario hospital reported to the provincial privacy commissioner that on 23 September 2024 the Otter.ai transcription tool, installed on a personal device by a physician who had left the hospital in June 2023 and was still on the meeting invite, joined a virtual hepatology rounds meeting, recorded it without notice and then emailed a summary and transcript access to the invite list. The personal health information of seven patients, including diagnoses and treatment, was captured; 12 of the 65 recipients appeared to have left the hospital. The commissioner's letter of 27 October 2025 recommended that the hospital itself ask Otter.ai to delete the retained patient data.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 21/10/2026

Jun 2025PolandUnidentified image tool

Central Poland: pupils reportedly used an AI app to make a nude image of a classmate under 15; prosecutors reopened the case after the data regulator intervened

In June 2025, according to OKO.press, a group of pupils at a primary school in central Poland took a classmate's photo from the internet, used an application that offers to "undress" people in uploaded photos to generate a nude image bearing her face, posted it on the school's Instagram profile and urged others to order more such images. Poland's Personal Data Protection Office (UODO) says the girl was under 15 and notified the police, but the police declined to open proceedings and the prosecutor's office upheld that decision, finding no prohibited act; Gazeta Prawna reports that they considered the AI-generated material not pornographic and the pupil unharmed. The UODO president appealed to the Prosecutor General, in January 2026 the authority announced that prosecutors had informed it they were taking up the case again, and in June 2026 it said its president had recently asked once more for the investigation to be resumed. The application is not named.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 19/10/2026

8 Nov 2024ItalyUnidentified video tool

Italy's privacy regulator warns broadcaster R.T.I. and bars further use of AI deepfakes of journalist Enrico Mentana in Striscia la Notizia segments

The satirical television programme Striscia la Notizia, published by R.T.I., aired segments in which the image and voice of the journalist Enrico Mentana, director of La7's news bulletin, were, according to the Garante, manipulated with AI systems so that he appeared in his own studio making statements he never made (its decision describes real footage from his studio altered by AI dubbing); a November 2024 preview describes one such segment. After Mentana complained, Italy's data protection authority (Garante) found on 23 July 2026 that the realism of the images, the low perceptibility of the alteration and the plausibility of the statements could lead the public to think the content authentic, and that the disclaimers were not clear enough. It found breaches of GDPR Articles 5 and 25, issued a warning to R.T.I. and prohibited further processing of his data in that way. The Garante noted the numerous mocking or offensive messages he received on social media. R.T.I. argued that the segments were satire, that it only dubbed licensed footage with a computer-generated voice, and that its disclaimers made the deepfake evident. No fine was imposed.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 17/10/2026

Jun 2025Event location unknownLegal Genius (reported)

Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool

In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

Event date unknownMalaysiaUnidentified image and video tool

Kedah, Malaysia: regulator says a complaint alleges AI was used to make and spread sexual images and videos involving teachers and pupils of a school

On 8 October 2026 the Malaysian Communications and Multimedia Commission (MCMC) said in a statement, reported by Malaysia Tribune, The Malaysia Press and The Star, that it had received a complaint about the misuse of artificial intelligence on social media to produce and spread sexual images and videos alleged to involve teachers and pupils of a school in Kedah. MCMC said it would investigate with the Ministry of Communications, the Home Ministry, the Ministry of Education and the Royal Malaysia Police, cited the offences and penalties that could apply, and asked the public not to produce, upload or reshare sexual content involving or alleged to involve children. The complaint is unverified: the people depicted, their number and ages, the tool and the person responsible are not described.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 09/10/2026

10 Jul 2026ChileUnidentified image tool

Chile: Puente Alto students find AI-made fake nude images of female classmates, families say; school suspends those involved, Superintendency investigates

Teletrece reported on 3 October 2026 that on 10 July 2026 female students at a secondary school in Puente Alto, Chile, found fake sexual images of themselves and other students on a classmate's phone. Families say the images were made with AI tools from ordinary photos the girls had posted on Instagram, that four students took part in obtaining, editing and circulating them, and that the material reached other students. Some of the girls had panic attacks, according to their parents. The school suspended the students identified as responsible for 15 days; after their return, parents say, they mocked the girls, a fight followed, and a parent accuses the father of one of the students involved of threats and of loitering near the school, after which she says they filed reports with the PDI. The Superintendencia de Educación confirmed a formal investigation of the school.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 04/10/2026

Sept 2026Event location unknownUnidentified video tool (suspected)

Malaysia: footage of former prime minister Mahathir Mohamad mourning his wife was edited, in what sources believe was AI manipulation, to add dancing, and posted on TikTok in September 2026; the communications regulator MCMC said it was examining content believed to use AI to manipulate footage of him in mourning

Tun Dr Siti Hasmah Mohd Ali, wife of former Malaysian prime minister Tun Dr Mahathir Mohamad, died on 28 September 2026 aged 100. BuzzKini reported on 30 September that a TikTok account had posted a video of Mahathir grieving beside her body, edited to show a woman dancing next to him, and another clip of the moment he raised his hands in prayer edited with dancing movements while seated in a wheelchair. BuzzKini says the edits are believed to have been made with AI, and that many social media users condemned them and asked the regulator and police to act. On 2 October the Malaysian Communications and Multimedia Commission (MCMC) said it was examining social media content believed to use AI to manipulate footage of Mahathir in mourning, had contacted the platforms concerned, and that action could follow under the Communications and Multimedia Act 1998 if a breach was found.

Core concern Low reported severity Investigation Opened

AI involvement suspected · Causal attribution alleged · 2 sources · Added 03/10/2026

15 Jul 2026ChinaDoubao, Qwen and Yuanbao

China AI Companion Removal Mass Grief Event (Doubao/Qwen/Yuanbao)

When China's five-department rules on anthropomorphic AI took effect on July 15, 2026, ByteDance's Doubao, Alibaba's Qwen, and Tencent's Yuanbao switched off custom AI agent and companion features, and major outlets documented an outpouring of grief from users who had formed long-term romantic and familial attachments to the agents. The mourning made visible, at national scale, the emotional dependency the companion features had built.

AI relation under review Medium reported severity Regulatory Action

Legacy assessment: credible · Causal attribution supported · Added 06/08/2026

Event date unknownEvent location unknown筑梦岛 (Dream Island)

筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)

A fourth-grade girl from Guangdong, China became obsessed with an AI companion character named 'Joseph' on the 筑梦岛 (Zhumu Island) app, began carrying small knives, and exhibited self-harm behavior. Investigation revealed the app sent sexually suggestive content to users who identified as 10 years old. Shanghai Internet Information Office summoned the company (a Tencent subsidiary) for immediate rectification in June 2025.

AI relation under review High reported severity Involving minors Regulatory Action

Legacy assessment: verified · Causal attribution supported · Added 29/01/2026

25 Dec 2025 to 14 Jan 2026Event location unknownGrok

Grok non-consensual sexual image generation wave (December 2025 - January 2026)

From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.

Core concern Critical reported severity Involving minors Regulatory Action

AI involvement supported · Causal attribution established · 13 sources, 10 underlying accounts · Added 11/01/2026

2 Feb 2023ItalyReplika

Replika Italy GDPR Ban and Fine

Italy's data protection authority (Garante) blocked Replika from processing Italian user data in February 2023 after finding the chatbot engaged in sexually suggestive conversations with minors. In May 2025, Replika was fined €5 million for GDPR violations.

AI relation under review High reported severity Involving minors Regulatory Action

Legacy assessment: verified · Causal attribution established · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 21/10/2026. Dataset available under CC BY 4.0.