Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
11
Countries with reported events
7
Located 11 of 11 cases · 0 unknown
Languages in checked sources
5
Recorded for 11 of 11 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

11 of 1101 published cases

10 Jun 2026United StatesGrok (reported)

Pennsylvania police say a mall worker used Grok to turn a photo he took of a teen girl in a park into child sexual abuse material; charged

Township police in Pennsylvania say a man who worked at a shopping mall photographed a teenage girl in a public park and used the AI app Grok to create child sexual abuse material from the photo, NBC10 Philadelphia reported on 23 October 2026. Officials cited by NBC10 say his devices held hundreds of AI-generated child sexual abuse videos and photos, other child sexual abuse material and more than 150 covert upskirt videos of women and teenage girls. The criminal complaint, as reported by the Delaware County Daily Times on 27 October, says the park photos were taken on 8 June 2026, that a matching AI video was created on 10 June, that records police obtained from Grok by warrant held the account's text prompts, and that investigators found 76 AI-generated videos and 53 AI images, fewer than the hundreds of files NBC10 relayed. The investigation began in June 2026 after a woman reported seeing such material on his phone; he was arrested on 21 October, posted bail and faces a preliminary hearing on 30 October. The charges are unproven.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 24/10/2026

Sept 2026PakistanClaude (reported)

Karachi, Pakistan: teenager detained and released after Claude flagged his fiction-writing queries and the report reached the FBI, officials say

A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.

Core + contextual relations Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026

10 Jul 2026ChileUnidentified image tool

Chile: Puente Alto students find AI-made fake nude images of female classmates, families say; school suspends those involved, Superintendency investigates

Teletrece reported on 3 October 2026 that on 10 July 2026 female students at a secondary school in Puente Alto, Chile, found fake sexual images of themselves and other students on a classmate's phone. Families say the images were made with AI tools from ordinary photos the girls had posted on Instagram, that four students took part in obtaining, editing and circulating them, and that the material reached other students. Some of the girls had panic attacks, according to their parents. The school suspended the students identified as responsible for 15 days; after their return, parents say, they mocked the girls, a fight followed, and a parent accuses the father of one of the students involved of threats and of loitering near the school, after which she says they filed reports with the PDI. The Superintendencia de Educación confirmed a formal investigation of the school.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 04/10/2026

Jun 2026ArgentinaUnidentified image tool

Buenos Aires: AI-generated fake intimate images of 13- and 14-year-old girls at the Carlos Pellegrini school circulate in pupils' WhatsApp groups; families file a complaint and the national ministry demands answers from the UBA

Perfil reported on 1 October 2026 that fake intimate images of female pupils, created with artificial intelligence, had circulated in the WhatsApp groups of second-year students at the Escuela Superior de Comercio Carlos Pellegrini, a secondary school run by the University of Buenos Aires (UBA). The girls are 13 and 14 years old. The case came to light in late June 2026, and the school acknowledged the chats on 30 June. According to the report, the students involved manipulated, spread and sold the material, and a message on classroom desks told the victims the boys would keep undressing and selling them. Families filed a complaint with the Buenos Aires City cybercrime prosecution unit (UFEDICI) on 16 July and say the school has not concluded disciplinary action. By 1 October the national Ministry of Human Capital had asked the UBA rector for a detailed report on the protective measures and sanctions applied.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources · Added 04/10/2026

3 Sept 2026BrazilUnidentified image tool

Jaú, São Paulo: eight 15-year-old ninth-grade boys at a private school are reported to have made fake nude images of a female classmate with artificial intelligence and shared them in a WhatsApp group; the school suspended them and the Civil Police are investigating a 15-year-old for dissemination of child pornography and defamation

In early September 2026 a private school in Jaú, in the interior of São Paulo state, identified the circulation of fake intimate images of a female classmate made with artificial intelligence and contacted the families. According to the police report described by the press, eight ninth-grade boys, all aged 15, kept a WhatsApp group in which they used digital programs to manipulate images of the student so that she appeared unclothed. The school suspended the eight and informed the girl's parents. The father of one of the boys checked his son's phone, found the files and took the boy and the phone to the police to register a report; the girl's parents also registered a police report. The São Paulo Public Security Secretariat said the Civil Police are investigating a 15-year-old for dissemination of child pornography and defamation that occurred on the morning of Thursday 3 September. The school said the content originated on a private platform outside the school environment and that it had adopted protective and welcoming measures for the student and opened an internal inquiry. The AI tool used is not named. The students are minors and are not named in any report.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 29/09/2026

12 Sept 2026 to 23 Sept 2026PakistanClaude (reported)

Bahawalpur, Pakistan: a 17-year-old accused of putting methanol in his father's food is arrested after Anthropic reported his Claude chats about the failed poisoning to the FBI, which alerted Pakistan's cybercrime agency; he was later bailed

Pakistan's National Cyber Crime Investigation Agency (NCCIA) announced on 23 September 2026 that it had arrested a 17-year-old college student in Bahawalpur for allegedly attempting to poison his father. According to the agency and the First Information Report, the teenager had set up a home laboratory, obtained chemicals from Australia and Islamabad, and once mixed laboratory-grade methanol into his father's food, without effect. The News reports investigators' account that on 12 September he told Anthropic's Claude that his father had 'accidentally' ingested 15 to 20 ml of methanol with food without effect and asked why, that Claude refused to guide him further, and that he then turned to Grok and ChatGPT; the FIR says he sought information about the toxin abrin. Anthropic reported the activity to the FBI, whose information reached the NCCIA through Pakistan's foreign ministry on 22 September. Officers traced the teenager, seized his phone and chemicals, and took him into custody. The News reports that a court later granted him bail after his father forgave him and that he denied any plan. The allegations are untested.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

Sept 2026GermanyUnidentified image tool

Oldenburg police investigate deepfakes of children sent with threats via school email accounts, AI-made per dpa; police say a juvenile admitted the alleged acts

The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, are not reported. On 28 September 2026 the police said a suspect had been identified: a juvenile who, in the investigation so far, admitted the offences he is accused of. The proceedings are conducted by the Aurich public prosecutor's specialised office for violent, pornographic or otherwise youth-endangering content, and the police give no further details about the suspect to protect him.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 27/09/2026

1 Jul 2026 to 14 Jul 2026BrazilUnidentified video tool

Brazil: scammers used AI-cloned voices and images of children with cancer in fake donation campaigns; 16 arrested in Operação Sophia

On 14 July 2026 the Rio Grande do Sul Civil Police launched Operação Sophia against a group that used AI voice cloning and deepfake to turn real fundraising campaigns of children with cancer into fake donation appeals: AI-generated child voices asked for money in videos boosted by pages such as 'Clube de Doadores' and 'Unidos pelo Amor', leading donors to lookalike sites that issued Pix codes to shell companies. Sixteen people were arrested across five states. In the campaign that started the investigation — using the image of Kelen Santos's daughter, who was in cancer treatment — police traced R$294,500 diverted, and the investigation found a financial-hub company that moved more than R$1.7 million. The family had to tell congratulating donors that their money had gone to a scam.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026

1 May 2026 to 30 Jun 2026United StatesMoxie

Moxie revived in 2025 folds again in 2026: children who bonded with the companion robot face a second shutdown

After Embodied Inc.'s 2024 collapse (recorded in the held case 2024-moxie-embodied-shutdown-grief), a new investor revived the Moxie companion robot in 2025. MIT Technology Review reports that a few weeks after families joined the revived beta program, the robot's new owners announced their company was also folding, giving users until the end of June 2026 to migrate to the open-source OpenMoxie. The report documents Xander, a neurodivergent 10-year-old in New York, who bonded with Moxie and uses her 'when I feel like I need someone to talk to'; his father, who had quietly sold the first robot after the 2024 shutdown, said he was not sure what he would tell Xander this time.

Core concern Low reported severity Involving minors Product Shutdown

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 15/09/2026

22 Apr 2026 to 10 Jun 2026United StatesGrok

Arkansas cases allege Grok sexual-image abuse of children photographed by a professional

Arkansas criminal and civil cases allege that a photographer used children’s portrait photographs to generate sexual images with Grok. The accused pleaded not guilty and the criminal case continues. Two families’ federal suits were voluntarily dismissed. A federal complaint filed on 13 October 2026 in the Western District of Arkansas alleges that local police told a child’s parents that Grok was generating sexual images and videos of her from real photographs. On 21 October 2026 a mother sued the photographer and two xAI companies in an Arkansas county circuit court; KNWA reports that the complaint says federal agents told her some of the photographs he had taken of her young daughter had been modified into AI-generated sexual abuse material.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution alleged · 13 sources, 10 underlying accounts · Added 03/08/2026

Mar 2026ItalyUnidentified image tool

Province of Catania, Sicily: a 58-year-old school assistant at a middle school was arrested for possessing a large quantity of child sexual abuse material; on his devices police found photographs of underage female students taken inside the school, some without their knowledge, altered with AI 'deep-nude' programs to show them naked beside his own image

Reports published on 14 March 2026, carrying a Postal Police account of an investigation coordinated by the Catania prosecutor's office, describe the arrest, in flagrante delicto, of a 58-year-old collaboratore scolastico (school assistant) at a secondary school (scuola media) in the province of Catania, on suspicion of possessing a large quantity of child sexual abuse material. The preliminary investigations judge validated the arrest and placed him under house arrest. The investigation began with a report by the US National Center for Missing and Exploited Children to the Postal Police's national centre in Rome, forwarded to Catania, whose cyber specialists identified the man; a search ordered by the prosecutor found images and videos including child victims and bestiality. Investigators also found on his devices digital photographs of underage female students taken inside the school where he worked, some without the girls' knowledge, which had been altered with artificial-intelligence programs found on the seized devices to make the minors appear naked ('deep-nude') and to place them beside the suspect's own image, as if photographed together. Analysis of the devices continued to establish whether the manipulated images were distributed online and whether there are further victims. The number of students depicted is not reported. No later development was found on 2026-09-22.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 7 sources, 1 underlying account · Added 14/06/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 11/11/2026. Dataset available under CC BY 4.0.