Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
11
Countries with reported events
6
Located 11 of 11 cases · 0 unknown
Languages in checked sources
7
Recorded for 11 of 11 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

11 of 868 published cases

Aug 2026ChinaUnidentified symptom-analysis tool

Zhejiang toddler hospitalised with pneumonia after his mother relied on an AI tool's asthma diagnosis and declined a chest X-ray (newspaper account)

A Guangming Daily feature on AI symptom-checking, republished by Bingtuan Daily on Sina Finance on 8 October 2026, recounts a case from August 2026 in Zhejiang and closes it with a quotation from the head of paediatrics at a provincial hospital, who says the family did not heed the doctor's advice. A three-year-old boy with a history of asthma was brought in; his mother had entered keywords such as allergy, asthma, cough and night-time wheezing into an AI tool, which quickly returned a diagnosis of an acute bronchial asthma attack. On that basis, the account says, she declined the chest X-ray the doctor recommended and insisted on taking home only nebuliser medication. Two days later the child's condition worsened with rapid breathing; on an overnight return to the hospital, examination found extensive inflammatory lesions in both lungs, and he was diagnosed with human metapneumovirus pneumonia with a superimposed bacterial infection and admitted as an emergency. The paediatrics head is quoted saying the illness would not have become so severe had the family listened earlier. The AI tool is not named. The case is told in the newspaper's voice, and the feature does not say where its account came from beyond the paediatrics head's quotation; no statement from the family is reported.

Contextual tracker case Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 1 source · Added 09/10/2026

Sept 2026GermanyUnidentified image tool

Oldenburg police investigate deepfakes of children sent with threats via school email accounts, AI-made per dpa; police say a juvenile admitted the alleged acts

The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, are not reported. On 28 September 2026 the police said a suspect had been identified: a juvenile who, in the investigation so far, admitted the offences he is accused of. The proceedings are conducted by the Aurich public prosecutor's specialised office for violent, pornographic or otherwise youth-endangering content, and the police give no further details about the suspect to protect him.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 27/09/2026

15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool

East Jakarta: police confirm a grade-9 student at a state junior high school edited several female schoolmates' photographs with AI into indecent images that circulated as WhatsApp stickers; a social-media post said about 200 images were sold; the student was later beaten by schoolmates angry at the images (police statements differ on whether the depicted students or their friends did so) and both matters are under police investigation (Kompas, ANTARA, detik, VIVA, Media Indonesia, 23-24 September 2026)

On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026

17 Sept 2026United StatesUnidentified image tool

Henderson, Kentucky: police identified AI-generated nude images of two middle-school children on a device after a report that such images were being created and shown to other students at South Middle School; a juvenile was lodged at the juvenile detention centre on charges of distributing sexually explicit images without consent and possessing and distributing matter portraying a sexual performance by a minor

Henderson Police said that on 'last Thursday' (17 September 2026) they received a report that AI-generated nude images of children were being created and shown to other students at South Middle School in Henderson, Kentucky. During the investigation officers found and identified AI-generated photographs of two minor victims on a digital device. A juvenile accused of sharing the images was lodged at the Juvenile Detention Center on three charge types: distribution of sexually explicit images without consent; two counts of possession or viewing of matter portraying a sexual performance by a minor over 12 and under 18; and distribution of matter portraying a sexual performance by a minor over 12 and under 18. The school said on Monday 21 September that it was aware of a situation involving a student allegedly misusing artificial intelligence and inappropriate images, that the police investigation was active and that it had remained in communication with the families involved. 14 News (WFIE) reported the case on 21 September; WKYT carried the same report. The tool is not named. The depicted children's exact ages are not reported, though the charge descriptors put them between 12 and 18. The accused is described as a South Middle School student; the accused's age and any relationship to the depicted children beyond attending the same school are not reported.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/09/2026

2 Sept 2026United StatesMeta AI

Utah: Meta AI's suggested prompts under a mother's Instagram video compiled her young daughters' names, birth details and old photos and her likely home location; Meta said the prompts 'missed the mark' and changed the feature

On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.

Contextual tracker case Low reported severity Involving minors Internal Action

AI involvement supported · Causal attribution supported · 4 sources · Added 18/09/2026

1 Jul 2026 to 14 Jul 2026BrazilUnidentified video tool

Brazil: scammers used AI-cloned voices and images of children with cancer in fake donation campaigns; 16 arrested in Operação Sophia

On 14 July 2026 the Rio Grande do Sul Civil Police launched Operação Sophia against a group that used AI voice cloning and deepfake to turn real fundraising campaigns of children with cancer into fake donation appeals: AI-generated child voices asked for money in videos boosted by pages such as 'Clube de Doadores' and 'Unidos pelo Amor', leading donors to lookalike sites that issued Pix codes to shell companies. Sixteen people were arrested across five states. In the campaign that started the investigation — using the image of Kelen Santos's daughter, who was in cancer treatment — police traced R$294,500 diverted, and the investigation found a financial-hub company that moved more than R$1.7 million. The family had to tell congratulating donors that their money had gone to a scam.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026

1 May 2026 to 30 Jun 2026United StatesMoxie

Moxie revived in 2025 folds again in 2026: children who bonded with the companion robot face a second shutdown

After Embodied Inc.'s 2024 collapse (recorded in the held case 2024-moxie-embodied-shutdown-grief), a new investor revived the Moxie companion robot in 2025. MIT Technology Review reports that a few weeks after families joined the revived beta program, the robot's new owners announced their company was also folding, giving users until the end of June 2026 to migrate to the open-source OpenMoxie. The report documents Xander, a neurodivergent 10-year-old in New York, who bonded with Moxie and uses her 'when I feel like I need someone to talk to'; his father, who had quietly sold the first robot after the 2024 shutdown, said he was not sure what he would tell Xander this time.

Core concern Low reported severity Involving minors Product Shutdown

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 15/09/2026

22 Apr 2026 to 10 Jun 2026United StatesGrok

Arkansas cases allege Grok sexual-image abuse of children photographed by a professional

Arkansas criminal and civil cases allege that a photographer used children’s portrait photographs to generate sexual images with Grok. The accused pleaded not guilty. Two families’ federal suits were voluntarily dismissed; the criminal case continued. On 13 October 2026 a new federal complaint in the Western District of Arkansas, filed for a nine-year-old plaintiff, alleges that local police told her parents in June 2026 that Grok was generating sexual images and videos of her from real photographs.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution alleged · 12 sources, 9 underlying accounts · Added 03/08/2026

Apr 2026 to Jun 2026United StatesUnidentified image tool

Illinois teacher charged after prosecutors say his phone held students' photos altered with an AI app into sexual images

Illinois police and prosecutors charged a middle-school teacher in July 2026 with eight felony child-pornography counts. They say a forensic examination of his phone found photographs of students, taken at school, that had been altered with an AI app into nude or explicit images, and prosecutors told a detention hearing the app was on the phone. A judge ordered him detained and the school board dismissed him; the charges are unproven.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 8 sources, 4 underlying accounts · Added 06/07/2026

Mar 2026ItalyUnidentified image tool

Province of Catania, Sicily: a 58-year-old school assistant at a middle school was arrested for possessing a large quantity of child sexual abuse material; on his devices police found photographs of underage female students taken inside the school, some without their knowledge, altered with AI 'deep-nude' programs to show them naked beside his own image

Reports published on 14 March 2026, carrying a Postal Police account of an investigation coordinated by the Catania prosecutor's office, describe the arrest, in flagrante delicto, of a 58-year-old collaboratore scolastico (school assistant) at a secondary school (scuola media) in the province of Catania, on suspicion of possessing a large quantity of child sexual abuse material. The preliminary investigations judge validated the arrest and placed him under house arrest. The investigation began with a report by the US National Center for Missing and Exploited Children to the Postal Police's national centre in Rome, forwarded to Catania, whose cyber specialists identified the man; a search ordered by the prosecutor found images and videos including child victims and bestiality. Investigators also found on his devices digital photographs of underage female students taken inside the school where he worked, some without the girls' knowledge, which had been altered with artificial-intelligence programs found on the seized devices to make the minors appear naked ('deep-nude') and to place them beside the suspect's own image, as if photographed together. Analysis of the devices continued to establish whether the manipulated images were distributed online and whether there are further victims. The number of students depicted is not reported. No later development was found on 2026-09-22.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 7 sources, 1 underlying account · Added 14/06/2026

Apr 2026United StatesUnidentified image tool

Texas authorities allege AI sexual-image abuse involving about 30 identified children

Texas authorities arrested a man over allegations that he used AI to create sexual images from photographs of children. Investigators reported about 30 identified children and were coordinating support. The allegations remained charges at review.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 03/06/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.