Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
18
Countries with reported events
10
Located 12 of 18 cases · 6 unknown
Languages in checked sources
7
Recorded for 18 of 18 cases

4 cases have no reviewed AI-to-person relation yet: 3 not yet reviewed and 1 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

18 of 794 published cases

23 Sept 2024CanadaOtter.ai (reported)

Ontario hospital reports that an Otter.ai bot joined physicians' rounds through a former doctor's invite, recorded them and emailed patient information

An Ontario hospital reported to the provincial privacy commissioner that on 23 September 2024 the Otter.ai transcription tool, installed on a personal device by a physician who had left the hospital in June 2023 and was still on the meeting invite, joined a virtual hepatology rounds meeting, recorded it without notice and then emailed a summary and transcript access to the invite list. The personal health information of seven patients, including diagnoses and treatment, was captured; 12 of the 65 recipients appeared to have left the hospital. The commissioner's letter of 27 October 2025 recommended that the hospital itself ask Otter.ai to delete the retained patient data.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 21/10/2026

Jun 2025PolandUnidentified image tool

Central Poland: pupils reportedly used an AI app to make a nude image of a classmate under 15; prosecutors reopened the case after the data regulator intervened

In June 2025, according to OKO.press, a group of pupils at a primary school in central Poland took a classmate's photo from the internet, used an application that offers to "undress" people in uploaded photos to generate a nude image bearing her face, posted it on the school's Instagram profile and urged others to order more such images. Poland's Personal Data Protection Office (UODO) says the girl was under 15 and notified the police, but the police declined to open proceedings and the prosecutor's office upheld that decision, finding no prohibited act; Gazeta Prawna reports that they considered the AI-generated material not pornographic and the pupil unharmed. The UODO president appealed to the Prosecutor General, in January 2026 the authority announced that prosecutors had informed it they were taking up the case again, and in June 2026 it said its president had recently asked once more for the investigation to be resumed. The application is not named.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 19/10/2026

Nov 2025ChinaUnidentified image tool

Shanghai court convicts a man who, police say, used AI software to fake food-poisoning medical records and extort restaurants into paying compensation

Police in Yangpu district, Shanghai, say a customer extorted restaurants with medical records he had forged using AI software; Xinhua dates his first successful claim to November 2025. In the police account (Shangguan News, 26 February 2026) he claimed to have fallen ill after eating at a barbecue restaurant, showed a hospital visit record and medical invoice, and demanded 2,000 yuan in medical costs, threatening complaints and publicity; the restaurant paid. Police checked with other diners and the hospital, found he had no hospital record and the materials were forged, and say he confessed to using AI software to alter images of other people's medical records, replacing the name, date and amount. Police say he succeeded twice and failed twice, obtaining 2,500 yuan, and that he also filed complaints to market regulators with the forged material to pressure the restaurants. According to Xinhua's June report and the Procuratorate Daily, the Yangpu District People's Court convicted him of extortion and sentenced him to four months' criminal detention, suspended for four months, and a 2,000 yuan fine.

Contextual tracker case Low reported severity Criminal Charges

AI involvement supported · Causal attribution established · 3 sources · Added 17/10/2026

8 Nov 2024ItalyUnidentified video tool

Italy's privacy regulator warns broadcaster R.T.I. and bars further use of AI deepfakes of journalist Enrico Mentana in Striscia la Notizia segments

The satirical television programme Striscia la Notizia, published by R.T.I., aired segments in which the image and voice of the journalist Enrico Mentana, director of La7's news bulletin, were, according to the Garante, manipulated with AI systems so that he appeared in his own studio making statements he never made (its decision describes real footage from his studio altered by AI dubbing); a November 2024 preview describes one such segment. After Mentana complained, Italy's data protection authority (Garante) found on 23 July 2026 that the realism of the images, the low perceptibility of the alteration and the plausibility of the statements could lead the public to think the content authentic, and that the disclaimers were not clear enough. It found breaches of GDPR Articles 5 and 25, issued a warning to R.T.I. and prohibited further processing of his data in that way. The Garante noted the numerous mocking or offensive messages he received on social media. R.T.I. argued that the segments were satire, that it only dubbed licensed footage with a computer-generated voice, and that its disclaimers made the deepfake evident. No fine was imposed.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 17/10/2026

Jun 2025Event location unknownLegal Genius (reported)

Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool

In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

17 Mar 2025United KingdomGoogle AI Mode (reported)

UK Upper Tribunal: immigration adviser gives Google AI Mode as his best guess for a non-existent case in grounds he drafted; he self-reported to regulators

In the first of two matters decided together in [2026] UKUT 81 (IAC), promulgated on 17 November 2025, the Upper Tribunal (Immigration and Asylum Chamber) examined grounds of appeal dated 17 March 2025 that cited a non-existent Court of Appeal case under the citation of an unrelated equal-pay case. The adviser who drafted them first denied using AI, then told the tribunal his best guess was that he had inadvertently used Google's 'AI Mode', and the tribunal recorded that he had concluded it was probable the case came from inadvertent AI use; the panel itself got Google AI to produce varying benches for the fictitious case. He reported himself to the Immigration Advice Authority and the Solicitors Regulation Authority, and the tribunal said it would otherwise have referred him. He also told the tribunal that he had put client emails and uploaded Home Office decision letters into ChatGPT to summarise them, which he called a data breach he would disclose to the clients; the tribunal said such uploads breach client confidentiality and waive privilege.

Core concern Low reported severity Internal Action

AI involvement reported · Causal attribution supported · 1 source · Added 11/10/2026

Event date unknownMalaysiaUnidentified image and video tool

Kedah, Malaysia: regulator says a complaint alleges AI was used to make and spread sexual images and videos involving teachers and pupils of a school

On 8 October 2026 the Malaysian Communications and Multimedia Commission (MCMC) said in a statement, reported by Malaysia Tribune, The Malaysia Press and The Star, that it had received a complaint about the misuse of artificial intelligence on social media to produce and spread sexual images and videos alleged to involve teachers and pupils of a school in Kedah. MCMC said it would investigate with the Ministry of Communications, the Home Ministry, the Ministry of Education and the Royal Malaysia Police, cited the offences and penalties that could apply, and asked the public not to produce, upload or reshare sexual content involving or alleged to involve children. The complaint is unverified: the people depicted, their number and ages, the tool and the person responsible are not described.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 09/10/2026

10 Jul 2026ChileUnidentified image tool

Chile: Puente Alto students find AI-made fake nude images of female classmates, families say; school suspends those involved, Superintendency investigates

Teletrece reported on 3 October 2026 that on 10 July 2026 female students at a secondary school in Puente Alto, Chile, found fake sexual images of themselves and other students on a classmate's phone. Families say the images were made with AI tools from ordinary photos the girls had posted on Instagram, that four students took part in obtaining, editing and circulating them, and that the material reached other students. Some of the girls had panic attacks, according to their parents. The school suspended the students identified as responsible for 15 days; after their return, parents say, they mocked the girls, a fight followed, and a parent accuses the father of one of the students involved of threats and of loitering near the school, after which she says they filed reports with the PDI. The Superintendencia de Educación confirmed a formal investigation of the school.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 04/10/2026

Event date unknownIndonesiaUnidentified voice-cloning tool

Malang, East Java: the head of the financial regulator's local office says a resident lost Rp80 million after a caller used an AI clone of a close friend's voice to ask for a transfer

Malang Post reported on 2 October 2026 that the head of the Malang office of Indonesia's Financial Services Authority (OJK), speaking on a Radio City Guide FM talk show that day, described the latest case to befall a resident of Malang. According to the report, the perpetrator used AI to clone the voice of the victim's close friend very precisely and called the victim from a new number to ask for a money transfer; the victim believed the voice and lost Rp80 million. No date, police report or arrest is given. The account is the OJK official's as reported by one outlet; the call was not heard and the victim is not identified.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 03/10/2026

Sept 2026Event location unknownUnidentified video tool (suspected)

Malaysia: footage of former prime minister Mahathir Mohamad mourning his wife was edited, in what sources believe was AI manipulation, to add dancing, and posted on TikTok in September 2026; the communications regulator MCMC said it was examining content believed to use AI to manipulate footage of him in mourning

Tun Dr Siti Hasmah Mohd Ali, wife of former Malaysian prime minister Tun Dr Mahathir Mohamad, died on 28 September 2026 aged 100. BuzzKini reported on 30 September that a TikTok account had posted a video of Mahathir grieving beside her body, edited to show a woman dancing next to him, and another clip of the moment he raised his hands in prayer edited with dancing movements while seated in a wheelchair. BuzzKini says the edits are believed to have been made with AI, and that many social media users condemned them and asked the regulator and police to act. On 2 October the Malaysian Communications and Multimedia Commission (MCMC) said it was examining social media content believed to use AI to manipulate footage of Mahathir in mourning, had contacted the platforms concerned, and that action could follow under the Communications and Multimedia Act 1998 if a breach was found.

Core concern Low reported severity Investigation Opened

AI involvement suspected · Causal attribution alleged · 2 sources · Added 03/10/2026

Event date unknownAustraliaUnidentified image tool

Queensland school teacher charged over alleged AI-generated explicit images of staff and students

ABC reported on 23 and 24 July 2026 that police in Queensland, Australia charged a former secondary school teacher at a school there with child exploitation and computer misuse offences. Police allege the teacher used AI software on a work-issued laptop to generate explicit images depicting staff members and students. Police say a nine-month investigation began in October after they were notified of the material, and the school says it dismissed the teacher in October 2025, notified police and regulators, and that there is no evidence the material was shared. The number of people depicted and the creation date are not stated.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 29/09/2026

2025Event location unknownUnidentified legal research tool

High Court refers a solicitor to his regulator after fictitious citations from research his client says was AI-generated were put before the court

A Divisional Court judgment of 6 June 2025 ([2025] EWHC 1383 (Admin)) records that, in a commercial claim against a Qatari bank, correspondence and witness statements filed by the claimant and his solicitor relied on numerous authorities that a judicial assistant's schedule found to be fictitious or misquoted: 45 citations, 18 of which referred to cases that do not exist. The claimant's witness statement says the citations were generated using publicly available artificial intelligence tools, legal search engines and online sources. The solicitor's statement says he relied on the client's research without verifying it, that he had reported himself to the Solicitors Regulation Authority and that he had removed himself from all litigated matters. The court found a lamentable failure to check the material, accepted that the solicitor did not realise the citations were false, held that the threshold for contempt proceedings was not met, and said it would also refer him to the regulator. The judgment does not record any later disciplinary outcome.

AI relation unknown Medium reported severity

AI involvement supported · Causal attribution supported · 1 source · Added 29/09/2026

Mar 2026Event location unknownUnidentified AI medical scribe

Reported by ABC News (Australia): an AI scribe used at a urology appointment inserted a false claim that the patient took psychedelic mushrooms into her record; the error reached her GP in a post-operative letter and was corrected only after she complained

A patient who consented to having her first urology appointment transcribed by an artificial-intelligence scribe discovered, after her kidney-stone surgery in March 2026, that the post-operative letter her specialist sent to her GP stated she micro-dosed psychedelic mushrooms and that this could explain earlier bleeding around the kidneys. She says she has never taken mushrooms. She was receiving workers' compensation and feared that any mention of illegal drugs on her medical record could affect her case. After she complained, the urologist sent a letter of apology saying the practice takes documentation accuracy seriously, that she could not determine how the claim came to be included but that it appeared to be an error during the 'dictation or transcription process', that the correspondence had been corrected and that she would review how AI was used in her practice. The doctor did not answer ABC's questions about what changes had been made. Australia's practitioner regulator AHPRA told ABC that clinicians must check all AI-scribe output; the patient says it was clear her doctor had not. The account is a single ABC News report (14 August 2026) based on the patient's interview and the letters she received; the scribe product and the clinic's location are not named.

Contextual tracker case Low reported severity Internal Action

AI involvement reported · Causal attribution alleged · 1 source · Added 20/09/2026

15 Jul 2026ChinaDoubao, Qwen and Yuanbao

China AI Companion Removal Mass Grief Event (Doubao/Qwen/Yuanbao)

When China's five-department rules on anthropomorphic AI took effect on July 15, 2026, ByteDance's Doubao, Alibaba's Qwen, and Tencent's Yuanbao switched off custom AI agent and companion features, and major outlets documented an outpouring of grief from users who had formed long-term romantic and familial attachments to the agents. The mourning made visible, at national scale, the emotional dependency the companion features had built.

AI relation under review Medium reported severity Regulatory Action

Legacy assessment: credible · Causal attribution supported · Added 06/08/2026

17 Apr 2025United StatesChatGPT

Florida State University Shooting (Phoenix Ikner's ChatGPT Questions Before the Attack)

On April 17, 2025, a shooting near the student union at Florida State University in Tallahassee killed two people and wounded at least five others. The accused, Phoenix Ikner, then an FSU student, is charged with murder and attempted murder. ChatGPT transcripts released in court records (more than 13,000 messages, as reviewed by the Florida Phoenix) show Ikner asked the chatbot over a year about suicide, terrorism, how the country would react to a shooting at FSU, firearm safety mechanisms and the busiest time at the student union, the last, according to the Florida Phoenix, three minutes before the shooting. Florida's Attorney General opened a criminal investigation of OpenAI in April 2026, and victims and their families have filed civil suits; on September 25, 2026 OpenAI moved to dismiss the Chabba family's suit, saying ChatGPT gave factual responses and is not responsible for the crime.

Core concern Critical reported severity Lawsuit Filed

AI involvement supported · Causal attribution alleged · 10 sources, 9 underlying accounts · Added 28/04/2026

Event date unknownEvent location unknown筑梦岛 (Dream Island)

筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)

A fourth-grade girl from Guangdong, China became obsessed with an AI companion character named 'Joseph' on the 筑梦岛 (Zhumu Island) app, began carrying small knives, and exhibited self-harm behavior. Investigation revealed the app sent sexually suggestive content to users who identified as 10 years old. Shanghai Internet Information Office summoned the company (a Tencent subsidiary) for immediate rectification in June 2025.

AI relation under review High reported severity Involving minors Regulatory Action

Legacy assessment: verified · Causal attribution supported · Added 29/01/2026

25 Dec 2025 to 14 Jan 2026Event location unknownGrok

Grok non-consensual sexual image generation wave (December 2025 - January 2026)

From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.

Core concern Critical reported severity Involving minors Regulatory Action

AI involvement supported · Causal attribution established · 13 sources, 10 underlying accounts · Added 11/01/2026

2 Feb 2023ItalyReplika

Replika Italy GDPR Ban and Fine

Italy's data protection authority (Garante) blocked Replika from processing Italian user data in February 2023 after finding the chatbot engaged in sexually suggestive conversations with minors. In May 2025, Replika was fined €5 million for GDPR violations.

AI relation under review High reported severity Involving minors Regulatory Action

Legacy assessment: verified · Causal attribution established · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 21/10/2026. Dataset available under CC BY 4.0.