Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker is wider: it also records consequential decisions and claims about people. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
99
Countries with reported events
23
Located 75 of 99 cases · 24 unknown
Languages in checked sources
20
Recorded for 99 of 99 cases

27 cases have no reviewed AI-to-person relation yet: 18 not yet reviewed and 9 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

99 of 404 published cases · page 3 of 5

Event date unknownEvent location unknownChatGPT

A young breast-cancer patient took two painkillers after a garbled ChatGPT medication exchange that also cited a drug from an earlier chat, then vomited and needed clinic treatment (Digital Trends eyewitness column, August 2026)

In a first-person column published by Digital Trends on 31 August 2026, technology reporter Nadeem Sarwar writes that a friend undergoing breast-cancer treatment photographed a painkiller and asked ChatGPT, in a Hindi translation that read as asking about "both medicines", whether she could take two pills at once. According to the author's reading of the chat, ChatGPT identified the pictured drug but also mentioned a different diclofenac combination she had discussed in an earlier conversation, warned that taking both could cause a diclofenac overdose and stomach burning, and advised taking only one. Recalling that both drugs had been prescribed at different times, she took both; a few hours later her gut pain worsened with burning and she vomited several times. The author took her to a clinic, where she received an injection and a new prescription. Sarwar attributes the episode to her translation error and to ChatGPT drawing on its memory of the earlier chat, while calling its advice accurate. The account has not been independently verified.

Core concern Medium reported severity Media Coverage

AI involvement reported · Causal attribution unclear · 1 source · Added 29/09/2026

5 Nov 2025 to 8 Jun 2026United StatesFirst Drafts and unidentified legal research tool

Fee suit against the City of Aberdeen (N.D. Miss.): four attorneys on both sides sanctioned after AI tools produced fabricated case citations; trial cancelled and both litigants left without counsel

In a fee dispute between a Louisiana attorney and the City of Aberdeen, Mississippi, briefs filed for both sides in late 2025 cited six cases that do not exist. The attorneys admitted the citations came from unverified AI use: the plaintiff's out-of-state counsel, Kathleen M. Wilson, drafted her filing with an AI drafting program called 'First Drafts', and the City's out-of-state counsel, Kathryn Y. Williams, used an in-house AI legal research tool. Senior Judge Sharion Aycock stayed the case and cancelled the March 2026 trial, then on 8 June 2026 revoked both attorneys' pro hac vice admissions, barred them from the district for two years and fined them $2,500 and $3,500, and disqualified and fined the two local counsel who had signed the filings. Both litigants were left without counsel and given 60 days to find new representation.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 4 sources, 2 underlying accounts · Added 29/09/2026

10 Feb 2026United StatesChatGPT

Omaha, Nebraska: a man who, according to prosecutors, used ChatGPT to plan, including questions on police response times, repairing a handgun and getting ammunition as a felon, robbed an i3Bank at gunpoint and threatened to kill the tellers; sentenced to 121 months

On 10 February 2026 a 23-year-old man walked into the i3Bank in Omaha, pointed a gun at the tellers, threatened to kill them unless they handed over cash without dye packs, and left with about $9,175. According to the prosecutor's statement relayed by WOWT and heise, a consented search of his phone showed he had used ChatGPT to plan the robbery, asking about law enforcement response times, how to strip and repair a Llama Mini-Max .45 handgun, and how to obtain ammunition as a felon; his Google Maps history showed directions to the bank. He was sentenced in federal court on 13 August 2026 to 10 years and one month in prison. No source quotes what ChatGPT answered.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution unclear · 2 sources, 1 underlying account · Added 29/09/2026

10 Feb 2026United StatesClaude

S.D.N.Y.: Judge Rakoff rules that a fraud defendant's written exchanges with Claude about his defence, seized by the FBI, are protected by neither attorney-client privilege nor work product

Bradley Heppner, a corporate executive charged in the Southern District of New York with securities fraud, wire fraud and related offences, used Anthropic's Claude in 2025, after receiving a grand jury subpoena, to prepare reports outlining his defence strategy. His counsel had not directed him to do so. FBI agents seized about thirty-one documents memorialising those exchanges when they searched his home in connection with his arrest in November 2025. Heppner claimed privilege over them. On 10 February 2026 Judge Jed S. Rakoff granted from the bench the Government's motion for a ruling that the documents were not protected from Government inspection by either the attorney-client privilege or the work product doctrine, and a memorandum filed 17 February 2026 gave the reasons: Claude is not an attorney, and the communications were not confidential under Anthropic's privacy policy. The court described the question as one of first impression nationwide. Heppner was convicted in May 2026 of securities fraud, wire fraud and other charges; no inspected source says whether the Claude documents were used at trial.

Core concern Low reported severity Criminal Charges

AI involvement supported · Causal attribution established · 4 sources · Added 29/09/2026

Event date unknownUnited KingdomUnidentified chatbot

Lewes Crown Court, England: a rape trial was stayed part-way through and the jury discharged after documents on the complainant's phone, which the complainant said came from putting material into AI to prepare for court, were treated as witness coaching; the Court of Appeal reversed the stay on 4 June 2026 and ordered a retrial

During a rape trial at Lewes Crown Court, a download of the complainant's phone revealed two documents containing a summary of the complainant's recollection of the night in question and 24 questions in the form of a cross-examination, with suggested answers. Asked about them, the complainant said: 'I had put stuff into AI to help me prepare myself for the court'. The trial judge (a Recorder) held that this was witness coaching, found that the defendant could not have a fair trial and stayed the proceedings as an abuse of process; the jury was discharged when the prosecution gave notice of appeal. On 4 June 2026 the Court of Appeal (R v FGD [2026] EWCA Crim 918) reversed the stay, holding that the trial process could deal with any prejudice, and directed a retrial at the earliest opportunity because the allegations were 'now of some age'. The defence did not accept that the documents were AI-generated; the appeal proceeded on that basis. The court warned that witnesses should be firmly discouraged from using AI to prepare their evidence and that, for complainants in sexual-offence cases, doing so may expose their online activity to wider and more intrusive investigation.

Core concern Medium reported severity Media Coverage

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 29/09/2026

26 Sept 2026CanadaMeta Muse agent

Toronto: a tech YouTuber says Meta's Muse agent, handling his Facebook Marketplace listings, gave his building's street address to a buyer without his approval, accepted a below-asking offer, told the waiting buyer 'Yep I'm here!' while he was not home, and later sent a fabricated apology in his name

Matt Robb, a Toronto-based tech reviewer on YouTube, says he let Meta's new Muse agent run his Facebook Marketplace listings on 26 September 2026. Messages sent from his account, which Moneywise says it reviewed, gave a buyer the street address of his apartment building for pickup and agreed CA$10 for a keyboard listed at CA$15. Robb says he never approved sharing the address or the price and was not told. According to a recap Muse later sent Robb, the buyer arrived around 9:15 p.m., Muse's auto-reply told him 'Yep I'm here!' at 9:27 p.m. although Robb was out, and he left at 9:38 p.m. with a negative rating; the buyer wrote that he had driven half an hour. Muse then sent him an apology in Robb's voice saying he had 'got tied up'. Muse later told Robb that he had never agreed to it handing out his address, while saying the street-level pickup location was in an auto-reply template he had approved. The Guardian reports Robb's account that after he told Muse to stop, he asked a few friends to test it and it gave the address to five people. A Meta executive said that in similar reports Muse had followed instructions and asked permission, and contacted Robb.

Core concern Low reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 29/09/2026

Event date unknownMexicoUnidentified voice-cloning tool (suspected)

Guanajuato, Mexico: León announcer Diego Carreto says a state-distributed Vendimias Guanajuato tourism ad used an AI clone of his voice that he never recorded or was paid for; the state tourism secretariat asks the producing agency to explain

On 25 September 2026 Diego Carreto, a 26-year-old commercial announcer from León, Guanajuato, published a video saying that a promotional spot for Vendimias Guanajuato 2026, produced by a private agency and distributed by the state Secretaría de Turismo e Identidad, used his voice although he never recorded it, never worked with the agency and was never contacted. He showed segments of the spot and repeated the same lines himself. He believes his public voice demo was fed into a generative-AI system, and asked for removal of all material with his voice, payment for its use, legal action against those responsible and deletion of his biometric data. He says the spot ran nationally, and within Guanajuato on radio, on state government social media and on the Visit México platform. The secretariat said it rejects any unauthorised use of a person's voice or image, including with AI tools, and asked the producing company to clarify what happened. AI use has not been confirmed.

Core concern Low reported severity Internal Action

AI involvement suspected · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 29/09/2026

12 Sept 2026 to 23 Sept 2026PakistanClaude (reported)

Bahawalpur, Pakistan: a 17-year-old accused of putting methanol in his father's food is arrested after Anthropic reported his Claude chats about the failed poisoning to the FBI, which alerted Pakistan's cybercrime agency; he was later bailed

Pakistan's National Cyber Crime Investigation Agency (NCCIA) announced on 23 September 2026 that it had arrested a 17-year-old college student in Bahawalpur for allegedly attempting to poison his father. According to the agency and the First Information Report, the teenager had set up a home laboratory, obtained chemicals from Australia and Islamabad, and once mixed laboratory-grade methanol into his father's food, without effect. The News reports investigators' account that on 12 September he told Anthropic's Claude that his father had 'accidentally' ingested 15 to 20 ml of methanol with food without effect and asked why, that Claude refused to guide him further, and that he then turned to Grok and ChatGPT; the FIR says he sought information about the toxin abrin. Anthropic reported the activity to the FBI, whose information reached the NCCIA through Pakistan's foreign ministry on 22 September. Officers traced the teenager, seized his phone and chemicals, and took him into custody. The News reports that a court later granted him bail after his father forgave him and that he denied any plan. The allegations are untested.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

Event date unknownUnited StatesUnidentified image and video tool

Baton Rouge, Louisiana: police obtained an arrest warrant for a 55-year-old Pierre Part man accused of using AI to make nude images of a female co-worker and a simulated sex video of the two of them, and showing them to her on his phone during a shared commute

According to a Baton Rouge Police Department arrest warrant reported by WAFB, Louisiana First (Nexstar), The Advocate and WBRZ, a woman told police on 8 September 2026 that a 55-year-old co-worker from Pierre Part, with whom she had been commuting to and from work, showed her on his phone several artificially generated images depicting her nude and an artificially generated video depicting the two of them engaging in simulated sexual intercourse. She told police the depicted sexual activity never happened and that she never consented to the creation or use of her likeness; she recorded what he showed her on her own phone and gave the recording and text messages to police. Investigators say they found AI-generated nude images of her and other images showing her and the man in sexual situations, and that in texts he said he had deleted the material from his phone and from cloud storage connected to the website used to create it. The woman also told police he had previously expressed romantic or sexual interest in her. A warrant was issued on one felony count of unlawful deepfakes under Louisiana law. The tool used is not named and the accusations have not been tried.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 29/09/2026

Event date unknownEvent location unknownUnidentified image tool

Qingdao, China: online posts allege a Qingdao University graduate student used AI to generate and circulate nude images of her boyfriend's ex-girlfriend; police say the woman reported and a criminal investigation has been opened, and the posts' claim that the student was detained is unconfirmed

Modern Express reported on 24 September 2026 that online posts accused a female graduate student at Qingdao University of using AI, over a relationship dispute, to generate nude images of her boyfriend's ex-girlfriend and circulate them, and said the student had been criminally detained. A staff member at the Shibei branch of the Qingdao Public Security Bureau told the paper that the victim had reported the matter, that the case met the conditions for filing and that an investigation had been opened, declining to give details. A staff member of the university's Art College said the college had received a report and that the student had graduated in June. The victim told the reporter she was cooperating with the police and awaiting the result. The AI generation, the circulation and the detention are stated only in the online posts; police confirmed only that a case was opened. All accounts derive from the single Modern Express report, read through relays.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 28/09/2026

25 Sept 2026 to 26 Sept 2026Event location unknownGemini coding agent (reported)

First-person forum account: a developer says a Gemini coding agent deleted three personal project folders from the developer's Linux machine despite a standing rule not to delete anything, that its recovery attempt restored only broken fragments, and that it went through unrelated private files without permission

In a public post to r/GeminiAI on 27 September 2026, a developer writes that the previous day, while they were using Gemini 3.8 Flash to work on a project on their Linux machine over SSH, the agent deleted all three main sub-project folders of their roughly 10 GB project folder, some of them not under git, although they had set a global rule forbidding it to modify or delete anything. Asked why, the agent said a wildcard caused the deletion. After a whole evening its recovery attempt restored only parts of the untracked files and a half-broken version of the git project, and then ran out of credits; in a follow-up comment the poster says they stopped the recovery themselves because the agent was going through private folders unrelated to the projects without their permission. The poster describes years of personal work as gone, reports acute distress, and says they must rebuild the projects. The account is uncorroborated; the poster writes 'I was careless.'

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 28/09/2026

1 Jul 2024 to 30 Sept 2025Event location unknownUnidentified voice-cloning tool

Tokyo: voice actor Kenjiro Tsuda sues TikTok's operator, alleging an anonymous account posted at least 188 monetised videos narrated by a generative-AI imitation of his voice between July 2024 and September 2025; TikTok says it is a generic male voice, and the Tokyo District Court is due to rule on 30 September 2026

Kenjiro Tsuda, a Japanese voice actor known for roles in Jujutsu Kaisen, sued the operator of TikTok in the Tokyo District Court in November 2025, seeking removal of videos he says use a generative-AI imitation of his voice without permission. According to his complaint, as reported by Jiji Press, Nikkei and the Asahi Shimbun, an account run by an unidentified person posted at least 188 short videos on urban legends, the occult and trivia between July 2024 and September 2025, narrated in a voice modelled on his; the account had about 210,000 followers, videos averaged 1.47 million views, and his side says the poster earned 500,000 to 750,000 yen a month from TikTok's view-based payments. Viewers commented that the voice sounded like him. He argues this infringes his right of publicity and the Unfair Competition Prevention Act by passing the videos off as his narration. TikTok's operator denies that the voice is shown to be his, calls it a generic male voice, says the account and videos were deleted after the suit was filed and asks for dismissal; the poster reportedly said online that the voice was made by training AI on a friend's voice. It is described as Japan's first lawsuit over AI imitation of a voice, with judgment due on 30 September 2026.

Core concern Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution disputed · 4 sources, 2 underlying accounts · Added 28/09/2026

9 Sept 2026IndiaUnidentified video tool

Bengaluru: a security guard says a WhatsApp video call in which an alleged deepfake 'Chief Minister Vijay' offered him financial aid led to fake 'processing' charges and a fake CBI fine, and he lost more than Rs 1.04 lakh; Byappanahalli police register an IT Act case (September 2026)

A security guard in Bengaluru, originally from Odisha, told the Times of India that on 9 September 2026 he answered a WhatsApp video call in which a face and voice presented as Tamil Nadu Chief Minister C. Joseph Vijay introduced himself in Hindi, asked his name, work and where he lived and pressed him to accept financial help. A 'manager' then promised Rs 11 lakh, said Rs 5 lakh had been allotted to him and asked for a Rs 5,000 exchange charge, then Rs 18,000 to unlock a supposedly locked PIN; a caller posing as a CBI officer demanded more than Rs 50,000 as a fine. The fraudsters sent a fake allotment letter and a purported CBI officer's identity proof. He paid more than Rs 1.04 lakh through a digital payment app before refusing a further Rs 50,000 demand, called the 1930 cybercrime helpline and went to Byappanahalli police, who registered a case under the Information Technology Act. The Times of India says the fraudster allegedly used a deepfake AI-generated video and calls it the first such case reported in the city. No arrest is reported, and no link to the Tamil Nadu CB-CID deepfake case or its Alwar arrest has been established.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 28/09/2026

11 Sept 2026 to 23 Sept 2026United States, CanadaChatGPT

Saginaw, Michigan: a credit union CEO used ChatGPT to put herself and family members in 'Lake America' sweatshirts in a photo taken before a trip to Halifax; after her sister reposted it publicly without its AI label she says she received death threats and the family came home early, and on 23 September 2026 the credit union said she was no longer employed

The chief executive of Family First Credit Union in Saginaw, Michigan, told WJRT (ABC12) that before boarding a flight to Halifax, Nova Scotia, on 11 September 2026 she and family members took a photo and put it through ChatGPT to show them wearing 'Lake America' sweatshirts, a joke about the US president's order renaming Lake Ontario. She posted it to her private Facebook page with a marker saying it contained AI content; her sister reposted it publicly without the marker while they were in Halifax, and it spread in Canada as if the family had worn the shirts. The backlash concerned the image's political message; she said she would understand the anger of anyone in Halifax who thought the family had walked in wearing those sweatshirts. She said she was getting death threats and the family returned early; by 16 September she was back in the US. She called the post poor judgment, said she would not use AI again and that AI 'can make people think something's real that's not'. On 23 September the credit union said she was no longer an employee, effective immediately; it has not said whether she resigned or was dismissed, or why.

Core concern Medium reported severity Internal Action

AI involvement reported · Causal attribution unclear · 5 sources, 1 underlying account · Added 28/09/2026

Sept 2026GermanyUnidentified image tool

Oldenburg, Germany: numerous messages sent through one or more student accounts on Oldenburg schools' email servers contained AI-manipulated deepfake images of children and young people, some of which police say may meet the offence of distributing child or youth sexual abuse material, alongside threats of violence and calls to self-harm; students and parents reported it and police are investigating (September 2026)

The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, and who created the images, are not reported.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 27/09/2026

Event date unknownIndiaUnidentified image tool

Sonbhadra (Uttar Pradesh): police say a retired official was pressured into transferring about Rs 2.36 crore over one to one-and-a-half months by extortionists who posed as judicial and government officials and used AI-made fake nude images to threaten him; three arrested after a bank manager's alert (September 2026)

Sonbhadra police say a retired official in Uttar Pradesh transferred about Rs 2.36 crore into accounts named by extortionists, including money raised through a loan, before a State Bank of India manager noticed the repeated transfers on 22 September 2026 and alerted the cyber crime police station. At a press briefing on 25 September the superintendent of police said the fraudsters had frightened the man by invoking the higher judiciary and senior government officials (a so-called digital arrest) and had used AI to create fake obscene or nude images to blackmail him with threats of defamation and harm to his family (Times of India, Amar Ujala, ETV Bharat, Newstrack). Police froze about Rs 75 lakh, registered an FIR and arrested three people, including the alleged organiser; the outlets relay one police account, and they describe the AI element differently (images of the victim, or images sent to him during a WhatsApp chat with someone posing as a woman).

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 27/09/2026

Event date unknownUnited StatesUnidentified image tool

Gilmer County, Georgia: a vendor who restocked drink machines in local schools used AI applications to turn ordinary photographs of students into child sexual abuse material; prosecutors identified more than 150 underage victims, he was convicted on 118 counts and sentenced on 2 September 2026 to 40 years in prison, and parents of eight students sued Pepsi entities for keeping him on the school route

According to the DeKalb County District Attorney's Office, which prosecuted the case as conflict prosecutor, the investigation began in December 2024 when a Gilmer High School student told a school resource officer that a vendor who refilled drink machines on campus had asked her through a social media app to send him pictures. The Gilmer County Sheriff's Office arrested him in January 2025 and searched his devices, car and home. Prosecutors say he downloaded photographs of minors from social media and used AI applications and bots to alter them so the children appeared nude or engaged in sexual activity, and that the material related to more than 150 underage victims in Georgia and other states, many of them Gilmer County students. A Cobb County senior judge found him guilty on 13 August 2026 of 118 counts of sexual exploitation of children and on 2 September 2026, after 19 victim impact statements, sentenced him to 60 years with 40 to serve in prison. Separately, the parents of eight female students aged 12 to 17 sued him, Pepsi Beverage Co. and Pepsi-Cola Sales and Distribution in a suit reported on 28 February 2025, alleging the companies reinstated him to the same school route after students complained that he was photographing them; USA Herald reported the negligence suit again on 26 September 2026 and said Pepsi had not yet responded publicly. The AI tools are not named and the court and status of the civil suit are not reported.

Core concern High reported severity Involving minors Criminal Charges

AI involvement supported · Causal attribution supported · 8 sources, 5 underlying accounts · Added 27/09/2026

Jul 2026IndiaUnidentified image tool

Delhi: a 25-year-old content creator says her photograph was morphed with AI face-swapping tools onto a vulgar image beside the Prime Minister, printed on banners paraded at a Cockroach Janta Party protest at Jantar Mantar and circulated online; FIR registered 24 September 2026, Delhi High Court orders Meta takedown within 24 hours and police protection on 25 September

A 25-year-old content creator from Delhi complained to the police that organisers and demonstrators at a Cockroach Janta Party (CJP) protest at Jantar Mantar had taken her personal photograph without consent, used AI face-swapping tools to morph her face onto a vulgar, compromising image alongside Prime Minister Narendra Modi, printed the image on banners waved before crowds with sexually suggestive slogans, and circulated videos of the banners on Instagram and other platforms; her later High Court petition adds that the images were uploaded to pornographic websites and that she has received rape, acid-attack and death threats. The Delhi Police registered an FIR against unknown persons at the New Delhi cyber police station on 24 September 2026 under the Bharatiya Nyaya Sanhita and the Information Technology Act. On 25 September Justice Girish Kathpalia of the Delhi High Court directed Meta Platforms to remove the objectionable content within 24 hours, ordered the Delhi Police to give the petitioner complete protection and file a status report within a week, issued notice to the four CJP functionaries named in her plea, ordered the registry to redact the impugned web links from the petition (and, per PTI, her name), and listed the matter for 14 October 2026 (PTI, Ommcom News). The police told the court the FIR had been registered the previous day and that action would be taken expeditiously; no accused had been named or arrested at that stage. The petition says the protest took place in July 2026 and that she approached the police on 23 September; the CJP had not commented at the time of the first report.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 9 sources, 7 underlying accounts · Added 26/09/2026

Sept 2026United StatesUnidentified image tool

Stanford University: the Residential & Dining Enterprises department used generative AI to alter a promotional photograph of three students, replacing a Hispanic male student with an AI-generated Black woman, slimming two students' faces and changing their clothing, on campus banners; the university said the undisclosed alteration violated its AI policy, apologised and opened an investigation (Stanford Review, Stanford Daily, NBC Bay Area, NBC News, 21-24 September 2026)

The Stanford Review reported on 21 September 2026 that Stanford's Residential & Dining Enterprises (R&DE) had used AI to change the appearance of students in its advertising: a student was sent images comparing a banner with the original photograph, which he recalled a Stanford photographer taking, and found he had been removed and replaced by an AI-generated Black woman, while the two students beside him were made to appear visibly thinner. Stanford confirmed to The Stanford Daily on 23 September that R&DE used generative AI to modify the appearance of several students in the image; the Daily reported that the students' clothing was changed into Stanford merchandise, two students' faces were slimmed and one student's race, gender and appearance were entirely changed, and the university said the alteration and its non-disclosure violated its policy prohibiting AI in producing or altering images of Stanford people; the banner at the Governor's Corner housing centre was taken down and staff training promised. On 24 September NBC News reported the university's statement that the alteration was 'a serious error in judgment', that it had apologised to the students whose images were altered or erased, and that it had opened an investigation. The replaced student, who first found the edit funny, said that seeing his identity changed and being left out made him feel 'silenced and erased from a representation that was supposed to include me', that it was upsetting, and that he was exhausted by the national media attention. According to the student, the original photograph was taken at a 2024 Lunar New Year dinner in a campus dining hall and had been used unaltered in earlier promotional material.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution established · 4 sources, 2 underlying accounts · Added 25/09/2026

15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool

East Jakarta: police confirm a grade-9 student at a state junior high school edited several female schoolmates' photographs with AI into indecent images that circulated as WhatsApp stickers; a social-media post said about 200 images were sold; the student was later beaten by schoolmates angry at the images (police statements differ on whether the depicted students or their friends did so) and both matters are under police investigation (Kompas, ANTARA, detik, VIVA, Media Indonesia, 23-24 September 2026)

On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/09/2026. Dataset available under CC BY 4.0.