Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
50
Countries with reported events
21
Located 44 of 50 cases · 6 unknown
Languages in checked sources
18
Recorded for 50 of 50 cases

5 cases have no reviewed AI-to-person relation yet: 1 not yet reviewed and 4 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

50 of 868 published cases · page 2 of 3

Jun 2026GermanyUnidentified image tool

Woman in NRW, Germany, says AI-altered photos from her Instagram were used in an online sex ad with her face; police complaint filed, prosecutor investigating

A woman in her late twenties from North Rhine-Westphalia, Germany, learned at the end of June 2026 from an Instagram user that her face appeared in an advertisement on the classifieds platform Markt.de offering sex meetings and other sexual services, according to her account to the Lippische Landes-Zeitung (14 September 2026) and WDR (9 October 2026). WDR reports that the pictures came from her public Instagram account and were partly altered with AI; the extent of the manipulation is unknown. She filed a criminal complaint and engaged a lawyer; the Bielefeld public prosecutor's office told WDR that investigations are ongoing, and a suspect was identified through the ad, who the report notes could himself be a victim of identity theft. The ad has been taken down. She went public with a video on her Instagram account and says the experience changed how she shares online.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources · Added 10/10/2026

7 Oct 2026ArgentinaUnidentified image tool

Ituzaingó, Buenos Aires: complaint says a 15-year-old pupil's Instagram photos were made into AI nude images posted in a Telegram group; classmate investigated

Infobae and La Nación, each citing the complaint or police report it accessed, report that on 7 October 2026 a 15-year-old fourth-year pupil at a private secondary school in Ituzaingó, Buenos Aires province, received messages from three unknown numbers inviting her out and saying they had got her number from a Telegram group; a link led her to a group sharing pornographic content that included images of her modified with artificial intelligence. According to the complaint, a 15-year-old classmate admitted to her that he had downloaded photos from her Instagram account, edited them with AI to undress her and posted them in the group. Her mother filed a complaint on 8 October 2026 and asked for the harassment to stop; the case is with the juvenile criminal prosecutor's office No. 2 of Morón under Article 128 of the Penal Code (sexual representations of minors for distribution or sale). The school told families that images of pupils from other years had also surfaced and called meetings for 9 October. Two smaller outlets report, without naming their sources, that four pupils aged 15 to 16 are under investigation, that a seven-year-old primary pupil is among possible victims and that a second complaint was filed by the school; La Nación says the police report does not state whether other people are under investigation. The local outlet La Ciudad, citing pupils' testimony including that of a pupil who spoke anonymously, reported that three boys aged 15 and 16 took photos from girls' Instagram profiles and covertly at breaks, sold the AI-altered images on Telegram, and sold one girl's phone number with them, after which she received repeated calls from unknown numbers; the outlet says pupils at the school bought the material, and the anonymous pupil said that, as she understood it, the images were offered for money and that girls from every year were affected. The tool is not identified and no court ruling is reported.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 5 sources · Added 10/10/2026

30 Sept 2026IndiaUnidentified voice-cloning tool (suspected)

Bhopal: a security guard lost about Rs 35,000 to a caller whose voice sounded like a friend, reported as a suspected AI voice-cloning fraud

Free Press Journal reported on 4 October 2026 that a 50-year-old security guard from the TT Nagar area of Bhopal, Madhya Pradesh, was cheated of nearly Rs 35,000 after a caller impersonated a friend by mimicking the friend's voice. According to the report, the call came on 30 September from an unidentified person who claimed to need money urgently and sent a QR code. The guard made three transfers (Rs 5,000, Rs 10,000 and Rs 20,000), then reached the friend on the friend's own number and learned that the friend had not called. The outlet calls it a suspected case of AI-enabled fraud with a suspected AI-cloned voice. TT Nagar police registered a case and opened an investigation. No source confirms that the voice was AI-generated.

Core concern Low reported severity Investigation Opened

AI involvement suspected · Causal attribution alleged · 1 source · Added 05/10/2026

Sept 2026ParaguayUnidentified image tool

Asunción, Paraguay: students of the Universidad Nacional de Asunción report an anonymous website sharing intimate images of students, teachers and staff without consent, some altered or generated with AI; police cybercrime investigators and a prosecutor open an investigation, reported 21 to 24 September 2026

According to Hoy (21 September 2026) and El Nacional (22 September), students of the architecture faculty of the Universidad Nacional de Asunción reported an anonymous website that shared intimate images of students, teachers and staff without authorisation, including real photographs and material altered with AI. El Nacional reports that at least about twenty students complained, that some posts used photographs taken from social media, and that related content later appeared in Telegram and WhatsApp groups. The Minister of Women said her ministry had seen messages in which UNA students raised concern about content of them held without consent, and that in some cases AI-generated images of sexual content were shared (La Nación, 22 September). La Tribuna, reporting the findings of the police cybercrime department, describes the portal as used for the non-consensual distribution of intimate photographs and AI-altered content; according to a memorandum signed by the head of the department, a Paraguay section exposes full names, images and phone numbers of students (24 September). The university referred the case to prosecutors and police, and police suggested that prosecutors seek a court order to block the site in Paraguay. No person responsible has been publicly identified.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 05/10/2026

26 Sept 2026United StatesFlock Safety license plate readers

Lexington, Kentucky: police surrounded a couple's home at about 4 a.m. in September 2026, one officer with a gun unholstered, after a Flock camera search by vehicle description returned their truck in a road-rage investigation

WEKU, WKYT and LEX 18 reported that Lexington police surrounded a couple's home in the early hours of 26 September 2026 while investigating a reported assault in a road-rage incident. The victim had described a dark pickup truck and gave no license plate. The Lexington Police Department said officers searched its Flock camera network using the description, that only one return matched at that time of day, and that this led to the response to the residence. Doorbell video showed several police cars, spotlights and an officer with a gun unholstered at the door. Officers told the couple they were not suspects and left after about ten minutes. Police said they determined the truck was not the suspect vehicle, placed no charges and described the visit as following up a lead, not a misidentification. The residents said the response frightened them and a 94-year-old relative inside the home.

Contextual tracker case Low reported severity Media Coverage

AI involvement supported · Causal attribution supported · 3 sources · Added 05/10/2026

10 Jul 2026ChileUnidentified image tool

Chile: Puente Alto students find AI-made fake nude images of female classmates, families say; school suspends those involved, Superintendency investigates

Teletrece reported on 3 October 2026 that on 10 July 2026 female students at a secondary school in Puente Alto, Chile, found fake sexual images of themselves and other students on a classmate's phone. Families say the images were made with AI tools from ordinary photos the girls had posted on Instagram, that four students took part in obtaining, editing and circulating them, and that the material reached other students. Some of the girls had panic attacks, according to their parents. The school suspended the students identified as responsible for 15 days; after their return, parents say, they mocked the girls, a fight followed, and a parent accuses the father of one of the students involved of threats and of loitering near the school, after which she says they filed reports with the PDI. The Superintendencia de Educación confirmed a formal investigation of the school.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 04/10/2026

May 2026ChinaUnidentified video tool (suspected)

China: Shanghai woman loses 800,000 yuan to a fake army officer met on a matchmaking platform; Pudong police point to a sign of AI synthesis in her screenshot of him

In May 2026 a 50-year-old woman in Shanghai met a man on a matchmaking platform who said he was an army regiment commander about to retire and sent officer and identity card photos. He also made a video call on his own initiative, in which he quickly covered his face with his hand to show he was not using AI face-swap. He then steered her into a fake investment platform, and within about a month she put in 800,000 yuan, almost all of it borrowed, and could not withdraw it. A Pudong police anti-fraud officer said that AI synthesis could still be detected and that in her screenshot the man's thumb was clearly longer than a normal person's. The report gives no direct statement that face-swap software was used. The case was under further investigation.

Core concern Medium reported severity Investigation Opened

AI involvement suspected · Causal attribution alleged · 1 source · Added 04/10/2026

Mar 2026IndiaUnidentified image tool

Chandigarh: a PhD scholar says a man posing as an IPS officer took cash, gold and a laptop; Dainik Bhaskar reports police found his uniform photo was AI-made

A PhD scholar in Chandigarh told police that in March 2026 she found a man's profile on a matrimonial site showing him in uniform, and that he presented himself at different times as an excise assistant commissioner, an IPS officer and a RAW agent. Dainik Bhaskar reported on 29 September 2026 that the police investigation found the IPS uniform photo on the profile was not real and had been made with the help of AI; no officer is quoted on this, and the other reports read do not mention AI. According to her complaint, he took about Rs 11.5 lakh in cash, gold jewellery and a laptop with promises of marriage and a government job; the Tribune adds about Rs 7.88 lakh in online transfers between March and June, and police put the total at about Rs 30 lakh. Bhaskar reports that he had a bank account opened in her name with her documents and kept its passbook, ATM card and SIM card until the bank froze it over suspicious transactions. When she asked for her money and belongings back, he threatened to circulate her photographs on social media; the Tribune adds a threat of harm to her brother. A case was registered in August. Police arrested a man from Rohtak, Haryana, who was produced in court on Monday 28 September 2026 and remanded for one day.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 1 underlying account · Added 02/10/2026

20 Aug 2026SingaporeGemini (reported)

Singapore: an AI-generated photo of a crocodile at Pandan Reservoir led PUB to suspend water activities and search the reservoir in August 2026; a contractor's worker who allegedly made it was charged with transmitting a false message and with obstructing justice for allegedly deleting the image and the Gemini app history

On 20 August 2026 Singapore's national water agency PUB received a report of a crocodile sighting at Pandan Reservoir, with a photo. PUB said it tried to verify the image with several AI checker tools without a definite result, so it suspended water activities, told the Singapore Rowing Association and Singapore Canoe Federation to stop all activities there, put up warning signs and, with the National Parks Board, ran search-and-capture operations. On 21 August PUB found the photo was fake, stopped searching and filed a police report; water activities resumed on 22 August. Police said on 28 September that preliminary investigations found a man had used artificial intelligence to generate the image, sent it to a colleague, and then deleted the image and the related application to conceal his actions. On 29 September the 30-year-old, a worker employed by PUB's reservoir maintenance contractor, was charged with transmitting a false message and with obstructing the course of justice; the charge sheets, as reported by The Straits Times, say he deleted the image and the Gemini AI application history log from his phone on 21 August. He told the court he intended to plead guilty, and the case returns to court in November.

AI relation unknown Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 02/10/2026

2 Jan 2026Event location unknownGrok

UK: Grok made sexualised images of a Welsh presenter and a broadcaster at users' requests; police closed both cases, then reopened the presenter's, TBIJ reports

The Bureau of Investigative Journalism (TBIJ) and The Observer reported on 29 September 2026 that police investigations into sexualised images generated by X's chatbot Grok had failed to identify anyone. A Welsh presenter and campaigner against deepfake abuse, who had criticised Grok publicly on New Year's Eve 2025, saw an anonymous X user ask '@grok' to put her in a bikini made of cling film; Grok generated the image from her profile photo and posted it. She reported it to South Wales Police on 2 January 2026, was not asked for a statement until March, and was told officers had not heard back from X; the case was closed in May with the force saying no suspect could be identified. The same account also targeted a commentator and broadcaster, who estimates about 300 Grok images and videos of her were posted during the wave, including one alongside Jeffrey Epstein reported to the Metropolitan Police, which likewise said no suspect could be identified. The presenter entered pre-action legal correspondence with xAI (part of SpaceXAI) alleging misuse of private information and breaches of data-protection law and the Equality Act. On 22 October 2026 TBIJ reported that South Wales Police had reopened her case after she filed a formal complaint in September and TBIJ gave officers new information about the requesting user, including a crypto wallet and dozens of deleted posts; the force said it was now investigating the offence under the sexual-offences legislation aimed at deepfakes, rather than malicious-communications law, including enquiries with X. TBIJ added that other users had edited images of her with the standalone Grok app and that she is starting civil legal action against the company. BBC Wales had reported in January 2026 that explicit images of the presenter were created with the chatbot and shared without her consent.

Core concern Medium reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 30/09/2026

23 Feb 2026 to 25 Feb 2026ItalyUnidentified voice-cloning tool

Italy: Fideuram chairman Paolo Molesini is deceived by a WhatsApp impersonation of Intesa Sanpaolo's CEO and a phone call in the reportedly AI-cloned voice of a lawyer he knew into ordering about 95 million euros of transfers; at least 36 million remain missing and he resigned on 12 March 2026, weeks later

On 23 February 2026 Paolo Molesini, then chairman of Fideuram (the private-banking subsidiary of Intesa Sanpaolo), received a WhatsApp message from an unknown number from someone claiming to be Intesa's chief executive Carlo Messina, announcing a confidential acquisition that had to be executed through Fideuram. The same day a caller presenting as a lawyer of A&O Shearman whom Molesini knew, whose voice ANSA, Il Fatto Quotidiano and Corriere della Sera, reporting from the Milan court papers, describe as created with artificial intelligence (today.it, which also cites the seizure decree, writes that the court papers do not yet answer whether the voice was imitated), had him sign a confidentiality agreement and sent eleven payment instructions; Fideuram's treasury head was separately contacted by someone posing as Fideuram's CEO. Between 23 and 25 February eleven transfers totalling about 95 million euros went to accounts in Portugal and at Bank of China; the bank's alarm systems and the Milan prosecutors recovered about 40-42 million from China and 13 million seized in Portugal, leaving at least 36 million (39.5 million per the court papers) missing after conversion into cryptocurrency. Molesini, who Corriere writes is not under investigation, resigned as chairman on 12 March 2026, which Fideuram announced as being for personal reasons; a 48-year-old Israeli citizen is under investigation as a member of the gang.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 8 sources, 5 underlying accounts · Added 30/09/2026

6 Jan 2026IndiaUnidentified voice-cloning tool (suspected)

Indore play school operator reports losing Rs 97,500 after a call in a voice matching a relative's that police preliminarily attribute to AI voice cloning

The New Indian Express (9 January 2026) reported that a woman who runs a small play school in Indore said that on the night of 6 January a call came from an unknown number close to a cousin's number, in a voice that sounded exactly like the cousin's. The caller said a close friend needed urgent cardiac surgery at a private hospital in Indore and asked for money to be forwarded to a QR code. A total of Rs 97,500 was sent in four transactions. None of the money the caller had said was being credited arrived, the cousin denied making the call, and the calling number has been switched off. An Additional Deputy Commissioner of Police (Crime) in Indore said preliminary investigations strongly suggest AI-based voice modulation technology was used. The Free Press Journal, The420 and Malwa Abhi Tak reported the same call. All four outlets appear to rest on the woman's account and police statements, no audio analysis or AI tool is reported, and the police case against unidentified persons was described as ongoing.

Core concern Medium reported severity

AI involvement suspected · Causal attribution alleged · 4 sources, 1 underlying account · Added 30/09/2026

16 Apr 2026KenyaMeta AI (reported)

Kenya: Sama lays off more than 1,000 workers after Meta ends its AI data-annotation contract; a workers' group alleges a link to staff speaking out

On 16 April 2026 Sama, an outsourcing company with operations in Nairobi that did AI data-annotation work for Meta, announced that Meta had given formal notice ending its contract and that a redundancy process would affect more than 1,000 employees. Sama put the figure at 1,108 workers. The Guardian reported that the workers were abruptly sacked, and the Oversight Lab said they had six days' notice. The decision came less than two months after the SvD and GP investigation in which Sama annotators said they had seen intimate footage from users of Meta's AI glasses. Meta said it paused its work with Sama the month before while it looked into those claims and then decided to end the work because Sama does not meet its standards. Sama says it was never notified of any failure to meet those standards. A Kenyan workers' organisation alleges Meta's decision was caused by staff speaking out, which Meta had not addressed when the BBC reported it on 30 April 2026. Employees told SvD that Sama tightened security and tried to identify who had spoken to journalists, which Sama denies. TechPolicy.Press reports that one worker, with Sama for over a decade, now faces starting from scratch. The workers are described by role and are not named.

AI relation unknown Medium reported severity

AI involvement disputed · Causal attribution disputed · 5 sources, 4 underlying accounts · Added 29/09/2026

19 Mar 2026United States, United KingdomPangram AI-text detector

US and UK: Hachette cancels the US edition of the novel Shy Girl and discontinues the UK edition after allegations it was AI-generated, with the author denying personal use of AI

On 19 March 2026 Hachette Book Group said it had cancelled the US publication of the horror novel Shy Girl by Mia Ballard (Orbit imprint) and would not continue the UK edition (Wildfire imprint, first released in November 2025). Reports say the decision followed an investigation by Hachette and came a day after the New York Times asked the publisher about online allegations that the text was largely AI-generated. The allegations came from readers on Goodreads, Reddit and YouTube and from AI-detector results, including a 78.4 percent AI-generated score on the Pangram detector that a publishing consultant says two other services confirmed. Ballard denied personally using AI in emails to the New York Times and the Wall Street Journal, and told the New York Times that an acquaintance hired to edit the original self-published version used AI. Ballard wrote that "my name is ruined" and "my mental health is at an all time low", and said legal action was being pursued. Hachette’s public statements cite its commitment to original creative expression. The sources inspected do not report what its investigation found. Whether AI generated any of the text, and who used it, is unresolved.

Contextual tracker case Medium reported severity

AI involvement disputed · Causal attribution disputed · 9 sources, 4 underlying accounts · Added 29/09/2026

12 Sept 2026 to 23 Sept 2026PakistanClaude (reported)

Bahawalpur, Pakistan: a 17-year-old accused of putting methanol in his father's food is arrested after Anthropic reported his Claude chats about the failed poisoning to the FBI, which alerted Pakistan's cybercrime agency; he was later bailed

Pakistan's National Cyber Crime Investigation Agency (NCCIA) announced on 23 September 2026 that it had arrested a 17-year-old college student in Bahawalpur for allegedly attempting to poison his father. According to the agency and the First Information Report, the teenager had set up a home laboratory, obtained chemicals from Australia and Islamabad, and once mixed laboratory-grade methanol into his father's food, without effect. The News reports investigators' account that on 12 September he told Anthropic's Claude that his father had 'accidentally' ingested 15 to 20 ml of methanol with food without effect and asked why, that Claude refused to guide him further, and that he then turned to Grok and ChatGPT; the FIR says he sought information about the toxin abrin. Anthropic reported the activity to the FBI, whose information reached the NCCIA through Pakistan's foreign ministry on 22 September. Officers traced the teenager, seized his phone and chemicals, and took him into custody. The News reports that a court later granted him bail after his father forgave him and that he denied any plan. The allegations are untested.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

Sept 2026GermanyUnidentified image tool

Oldenburg police investigate deepfakes of children sent with threats via school email accounts, AI-made per dpa; police say a juvenile admitted the alleged acts

The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, are not reported. On 28 September 2026 the police said a suspect had been identified: a juvenile who, in the investigation so far, admitted the offences he is accused of. The proceedings are conducted by the Aurich public prosecutor's specialised office for violent, pornographic or otherwise youth-endangering content, and the police give no further details about the suspect to protect him.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 27/09/2026

24 Sept 2026 to 25 Sept 2026ItalyUnidentified image tool

Italian official condemns alleged AI sexualisation of her photograph in a political post

On the eve of the 27-28 September 2026 Chamber by-election in the Reggio Calabria constituency, Roberto Vannacci, leader of Futuro Nazionale, posted on Facebook a campaign image showing Matilde Siracusano, Undersecretary for Relations with Parliament and a Forza Italia deputy, seated at a table beside the centre-right candidate Fabio Roscioli and Senator Claudio Lotito. According to AGI and RaiNews, the white top Siracusano wears under her floral jacket in the original photograph (taken from her Instagram profile, per RaiNews) had disappeared and a much deeper neckline appeared in its place. The Calabrian blog Iacchite', to which Vannacci pointed, said it had published the image on 24 September, that it was not a real photograph but an image produced with artificial intelligence, and that the AI had reconstructed the neck and neckline area; Vannacci reposted it on 25 September without citing the source, according to the blog. Siracusano told Adnkronos that using AI to undress a woman in order to denigrate her was 'squalid'; RaiNews reports her calling it a crime and announcing her intention to file a criminal complaint (querela), while Adnkronos and ANSA say she was weighing one; she told la Repubblica that her lawyers would act. Vannacci replied that his accusers should 'look better' for whom to blame. Ministers and politicians across parties, including Forza Italia leader Antonio Tajani, condemned the post. No complaint filing, investigation or removal of the post is reported in the inspected sources.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 8 sources · Added 27/09/2026

Sept 2026United StatesUnidentified image tool

Stanford University: the Residential & Dining Enterprises department used generative AI to alter a promotional photograph of three students, replacing a Hispanic male student with an AI-generated Black woman, slimming two students' faces and changing their clothing, on campus banners; the university said the undisclosed alteration violated its AI policy, apologised and opened an investigation (Stanford Review, Stanford Daily, NBC Bay Area, NBC News, 21-24 September 2026)

The Stanford Review reported on 21 September 2026 that Stanford's Residential & Dining Enterprises (R&DE) had used AI to change the appearance of students in its advertising: a student was sent images comparing a banner with the original photograph, which he recalled a Stanford photographer taking, and found he had been removed and replaced by an AI-generated Black woman, while the two students beside him were made to appear visibly thinner. Stanford confirmed to The Stanford Daily on 23 September that R&DE used generative AI to modify the appearance of several students in the image; the Daily reported that the students' clothing was changed into Stanford merchandise, two students' faces were slimmed and one student's race, gender and appearance were entirely changed, and the university said the alteration and its non-disclosure violated its policy prohibiting AI in producing or altering images of Stanford people; the banner at the Governor's Corner housing centre was taken down and staff training promised. On 24 September NBC News reported the university's statement that the alteration was 'a serious error in judgment', that it had apologised to the students whose images were altered or erased, and that it had opened an investigation. The replaced student, who first found the edit funny, said that seeing his identity changed and being left out made him feel 'silenced and erased from a representation that was supposed to include me', that it was upsetting, and that he was exhausted by the national media attention. According to the student, the original photograph was taken at a 2024 Lunar New Year dinner in a campus dining hall and had been used unaltered in earlier promotional material.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution established · 4 sources, 2 underlying accounts · Added 25/09/2026

15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool

East Jakarta: police confirm a grade-9 student at a state junior high school edited several female schoolmates' photographs with AI into indecent images that circulated as WhatsApp stickers; a social-media post said about 200 images were sold; the student was later beaten by schoolmates angry at the images (police statements differ on whether the depicted students or their friends did so) and both matters are under police investigation (Kompas, ANTARA, detik, VIVA, Media Indonesia, 23-24 September 2026)

On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026

24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system

Delhi: the police facial-recognition system logged at least 25 people who were in Tihar, Mandoli or Rohini jails as present at the Jantar Mantar student protests (20 to 26 July 2026), with timestamps on 24 to 26 July, on a sworn list of 2,873 persons with 'criminal antecedents' that the Supreme Court allowed police to register a fresh FIR against (Indian Express investigation, 4 September 2026)

In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 23/10/2026. Dataset available under CC BY 4.0.