Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
12
Countries with reported events
5
Located 11 of 12 cases · 1 unknown
Languages in checked sources
4
Recorded for 12 of 12 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

12 of 1029 published cases

Jul 2026Event location unknownGrok (reported)

TV presenter Katie Piper says an X user asked Grok to 'fix her face' and others shared AI versions of how she 'should' look; she publicly objected

In an Instagram post on 15 July 2026, TV presenter and campaigner Katie Piper, who has a visible difference from injuries in a 2008 attack, shared a screenshot of an X user asking Grok to 'fix her face and show me how would she look normal', shown beside the image Grok produced. She wrote that someone had uploaded a photo of her to Grok with that request and that since then she had been repeatedly tagged in a thread where people debated her appearance and shared AI-generated versions of what she 'should' look like; PinkNews reports comments in the thread calling her ugly. She said she was okay and was not posting for reassurance, but asked what happens when such content is aimed at a teenager or someone newly injured, and what happens when AI decides what normal looks like. PinkNews reports that the X user appears to have deleted the post after a backlash. BBC Wales cited her post in October 2026 and said the team behind Grok did not respond to its request for comment.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 29/10/2026

14 Oct 2026BrazilUnidentified image tool

Bahia police say four teenagers extorted a girl with an intimate image made with AI; she paid R$8,300 and police recovered R$6,300

A 12-year-old girl in Vitória da Conquista, in the south-west of Bahia, Brazil, was threatened from 14 October 2026 by a 15-year-old who said he had intimate images of her and demanded money not to post them on social media. Frightened, she secretly took R$8,300 from money her father kept and handed it over; the suspect then demanded a further R$10,000. According to the Bahia Civil Police, its investigation found that the image used in the threats had been produced with artificial intelligence to simulate intimate content of the girl. On 23 October police identified the 15-year-old and three other adolescents aged 14 to 16 as suspects, recovered R$6,300 and an electric bicycle bought with part of the money, and returned the money to her father. The police opened a juvenile offence procedure and sent it to the Childhood and Youth Court. How police established that the image was AI-made is not disclosed.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 28/10/2026

13 Sept 2026JapanUnidentified website-generation tool

Japan: police say two teenagers used generative AI to build a fake payment-service site that took women's details, later used to pay for a hotel and consoles

Shiga prefectural police sent two teenagers' cases to prosecutors on 27 October 2026 on suspicion of violating Japan's unauthorised computer access law. According to the police announcement as reported by the Yomiuri Shimbun and Asahi Broadcasting (ABC), on 13 September 2026 the two, in Tokyo, sent two women the URL of a site made to look like a real payment service, told them they could receive money, and had them enter details such as email addresses and phone numbers. Police say the two used generative AI to make the phishing site, and the Yomiuri reports that one of them, who is believed to have used generative AI to make the fake site, said he did not have the skill to build a site without AI. The same day, police say, they logged into a travel-booking site with one woman's details and paid a Tokyo hotel bill of 182,830 yen; they were later re-arrested over three portable game consoles bought with another woman's account. Police believe they took about 50 people's information, including from other payment services, and charged about 5 million yen. Both admitted the allegations, according to the police. They are not named here.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 28/10/2026

10 Jun 2026United StatesGrok (reported)

Pennsylvania police say a mall worker used Grok to turn a photo he took of a teen girl in a park into child sexual abuse material; charged

Township police in Pennsylvania say a man who worked at a shopping mall photographed a teenage girl in a public park and used the AI app Grok to create child sexual abuse material from the photo, NBC10 Philadelphia reported on 23 October 2026. Officials cited by NBC10 say his devices held hundreds of AI-generated child sexual abuse videos and photos, other child sexual abuse material and more than 150 covert upskirt videos of women and teenage girls. The criminal complaint, as reported by the Delaware County Daily Times on 27 October, says the park photos were taken on 8 June 2026, that a matching AI video was created on 10 June, that records police obtained from Grok by warrant held the account's text prompts, and that investigators found 76 AI-generated videos and 53 AI images, fewer than the hundreds of files NBC10 relayed. The investigation began in June 2026 after a woman reported seeing such material on his phone; he was arrested on 21 October, posted bail and faces a preliminary hearing on 30 October. The charges are unproven.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 24/10/2026

2026ChinaUnidentified video tool

Beijing News: a student says a friend's older relative bought several high-priced orders from an AI-generated 'Xiaohai' persona's shop window

The Beijing News reported on 18 October 2026, in a follow-up to its investigation of 'Xiaohai' accounts on Chinese short-video platforms, that the accounts show AI-generated teenage boys who address older women as 'aunties and mothers' and steer them to high-priced shop windows. A university student told the paper that an older relative of a friend had been watching 'Xiaohai' videos and asked the friend why the boy was so badly off; the friend then found that the relative had already bought several orders of goods at high prices through the persona's shop window. The student made a counter-video with the same AI tools, posted on 28 September, in which the persona admits to deceiving viewers; after the friend showed it to the relative, the relative said they would not buy the persona's goods again. The amount spent and the goods bought are not reported. China National Radio's report the same day also describes the 'Xiaohai' videos as AI-generated and notes that many carry an 'AI-generated' watermark.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources · Added 19/10/2026

May 2026ChinaUnidentified video tool

A 79-year-old set off alone by train to visit an AI-generated 'Xiaohai' persona until railway police intervened, Beijing News and state radio report

The Beijing News reported on 16 October 2026, in an investigation of 'Xiaohai' accounts on Chinese short-video platforms, that the accounts show an AI-generated digital teenager who calls older women viewers 'aunties and mothers', tells stories of hardship and asks them to buy goods through sales links; its reporter generated such a video by following a tutorial, in a little over ten minutes. The paper describes a 79-year-old woman, given a pseudonym, who lived alone and talked most with the 'Xiaohai' on her phone. Around May 2026, according to the paper, a 'Xiaohai' video invited viewers to Yuncheng in Shanxi to see apricot blossoms; she secretly packed, bought a train ticket and set off with no clear route. On the train, railway police noticed her, told her that 'Xiaohai' was not a real person, and contacted her children, who bought her return ticket and brought her home. At first she refused to believe it. The paper also found that most 'Xiaohai' videos now carry a declaration that the content is AI-generated. How the paper learned of her journey is not stated. China National Radio (China Media Group) reported the same journey on 19 October 2026 with recorded exchanges between the woman and a train police officer: in May 2026 Urumqi railway police found a 79-year-old who cannot read travelling alone, able to say only that she was going to Yuncheng in Shanxi to see a child who called her 'auntie' every day on her phone; the officer told her the person in the live room was fake, and she got off and went home on a return ticket her family bought. The station's reporter found that the persona she trusted was one of the batch-produced 'digital human Xiaohai' accounts and that many carry an 'AI-generated' watermark in a corner of the video.

Core concern Low reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 18/10/2026

14 Oct 2026United StatesUnidentified image tool

Hillsborough County, Florida: sheriff's office says a teenager used an AI-altered image to frame her ex-boyfriend for a school shooting threat

According to the Hillsborough County Sheriff's Office, as reported by CBS News Miami, WFLA and WTSP, deputies responded to a high school in Riverview, Florida, on 14 October 2026 after administrators received an email containing a screenshot of an Instagram post threatening a shooting at the school. The post appeared to come from a male student. Detectives interviewed him and determined that the post did not come from him. The sheriff's office's communications chief said detectives very quickly realised the post was AI-altered and linked it to his ex-girlfriend, a teenage former student. Police say she admitted sending the email knowing that the image had been altered using AI. She was arrested and charged with making a written or electronic threat to conduct a mass shooting or act of terrorism, unlawful use of a two-way communications device and disrupting a school campus or function. The tool used and how detectives established the alteration are not reported.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 17/10/2026

Sept 2026PakistanClaude (reported)

Karachi, Pakistan: teenager detained and released after Claude flagged his fiction-writing queries and the report reached the FBI, officials say

A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.

Core + contextual relations Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026

12 Sept 2026 to 23 Sept 2026PakistanClaude (reported)

Bahawalpur, Pakistan: a 17-year-old accused of putting methanol in his father's food is arrested after Anthropic reported his Claude chats about the failed poisoning to the FBI, which alerted Pakistan's cybercrime agency; he was later bailed

Pakistan's National Cyber Crime Investigation Agency (NCCIA) announced on 23 September 2026 that it had arrested a 17-year-old college student in Bahawalpur for allegedly attempting to poison his father. According to the agency and the First Information Report, the teenager had set up a home laboratory, obtained chemicals from Australia and Islamabad, and once mixed laboratory-grade methanol into his father's food, without effect. The News reports investigators' account that on 12 September he told Anthropic's Claude that his father had 'accidentally' ingested 15 to 20 ml of methanol with food without effect and asked why, that Claude refused to guide him further, and that he then turned to Grok and ChatGPT; the FIR says he sought information about the toxin abrin. Anthropic reported the activity to the FBI, whose information reached the NCCIA through Pakistan's foreign ministry on 22 September. Officers traced the teenager, seized his phone and chemicals, and took him into custody. The News reports that a court later granted him bail after his father forgave him and that he denied any plan. The allegations are untested.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

Aug 2026United StatesUnidentified image tool

Cookeville, Tennessee: two high-school students were charged with aggravated sexual exploitation of a minor after the sheriff's office said they used an AI program to turn photographs, including those of female classmates, into sexually explicit images and posted them; the mother of one depicted girl says her daughter shut herself in her room and stopped talking to friends

On 31 August 2026 the Putnam County Sheriff's Office was told of possible sharing of sexually explicit images at Cookeville High School. Detectives found that two male teenage students had used an artificial-intelligence program to turn photographs obtained online, in some cases photographs of fellow female students, into sexually explicit images, and had shared them; explicit images already stored on one phone were also shared. Both juveniles were taken to the Putnam County Juvenile Detention Center. One was charged with one count each of aggravated sexual exploitation of a minor and especially aggravated sexual exploitation of a minor, the other with two counts of each. The district attorney told NewsChannel 5 on 21 September that the two would be prosecuted in juvenile court. The mother of one of the depicted girls told the station the episode was very hard on her daughter, who had made no naked photographs herself, locked herself in her room and would not talk to her, to anybody or to her friends. The sheriff's-office account and the school system's statement were carried by WZTV, WSMV and 3B Media News on 1-2 September; NewsChannel 5 added its own interviews with the sheriff, the district attorney and the mother on 21 September. The tool is not named. The juveniles are not named in any report.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 22/09/2026

1 Jul 2026 to 14 Jul 2026BrazilUnidentified video tool

Brazil: scammers used AI-cloned voices and images of children with cancer in fake donation campaigns; 16 arrested in Operação Sophia

On 14 July 2026 the Rio Grande do Sul Civil Police launched Operação Sophia against a group that used AI voice cloning and deepfake to turn real fundraising campaigns of children with cancer into fake donation appeals: AI-generated child voices asked for money in videos boosted by pages such as 'Clube de Doadores' and 'Unidos pelo Amor', leading donors to lookalike sites that issued Pix codes to shell companies. Sixteen people were arrested across five states. In the campaign that started the investigation — using the image of Kelen Santos's daughter, who was in cancer treatment — police traced R$294,500 diverted, and the investigation found a financial-hub company that moved more than R$1.7 million. The family had to tell congratulating donors that their money had gone to a scam.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026

11 Aug 2026United StatesChatGPT (reported)

Massachusetts prosecutors cite a teenager’s ChatGPT prompts in a family homicide case

Two family members were killed in Massachusetts on 11 August 2026. Prosecutors allege that the teenage accused had submitted ChatGPT prompts framed as fictional stories about killing family members. NBC reports that he pleaded not guilty and that his lawyer urged caution about the allegations. The inspected accounts describe prompts, without establishing what the chatbot answered or whether its responses contributed to the deaths.

Core concern Critical reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 14/08/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/10/2026. Dataset available under CC BY 4.0.