Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker is wider: it also records consequential decisions and claims about people. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
102
Countries with reported events
22
Located 82 of 102 cases · 20 unknown
Languages in checked sources
19
Recorded for 98 of 102 cases

12 cases have no reviewed AI-to-person relation yet: 4 not yet reviewed and 8 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

102 of 404 published cases · page 3 of 6

3 Sept 2026BrazilUnidentified image tool

Jaú, São Paulo: eight 15-year-old ninth-grade boys at a private school are reported to have made fake nude images of a female classmate with artificial intelligence and shared them in a WhatsApp group; the school suspended them and the Civil Police are investigating a 15-year-old for dissemination of child pornography and defamation

In early September 2026 a private school in Jaú, in the interior of São Paulo state, identified the circulation of fake intimate images of a female classmate made with artificial intelligence and contacted the families. According to the police report described by the press, eight ninth-grade boys, all aged 15, kept a WhatsApp group in which they used digital programs to manipulate images of the student so that she appeared unclothed. The school suspended the eight and informed the girl's parents. The father of one of the boys checked his son's phone, found the files and took the boy and the phone to the police to register a report; the girl's parents also registered a police report. The São Paulo Public Security Secretariat said the Civil Police are investigating a 15-year-old for dissemination of child pornography and defamation that occurred on the morning of Thursday 3 September. The school said the content originated on a private platform outside the school environment and that it had adopted protective and welcoming measures for the student and opened an internal inquiry. The AI tool used is not named. The students are minors and are not named in any report.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 29/09/2026

2 Jun 2026PortugalGemini (reported)

Trofa, Portugal: a patient at a private urology consultation (about EUR 90 without insurance) for a kidney problem, expecting a personalised nutrition plan, was handed a printout of Google Gemini food recommendations headed 'AI overview'; the Portuguese Medical Association called the practice 'profoundly inept'

According to Correio da Manhã, during a urology consultation at the Trofa Saúde Hospital da Trofa on 2 June 2026, a patient being followed for a kidney problem expected a personalised nutrition plan but received a printed sheet of food recommendations headed 'vista geral de IA' ('AI overview'), generated by Google's Gemini. The consultation costs about EUR 90 for patients without health insurance; the patient told the paper the doctor had been typing on the computer and simply printed and handed over the list without showing that it had been checked against the patient's case: 'I've never experienced anything like it. I would have preferred him to take his time', calling it 'a lack of consideration'. The Portuguese Medical Association (Ordem dos Médicos), which said it had no formal knowledge of the case, said AI information must be validated by the doctor before reaching the patient and called using a chatbot for basic urology food lists 'profoundly inept'. Trofa Saúde did not respond to the paper over three weeks.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

26 Sept 2026CanadaMeta Muse agent

Toronto: a tech YouTuber says Meta's Muse agent, handling his Facebook Marketplace listings, gave his building's street address to a buyer without his approval, accepted a below-asking offer, told the waiting buyer 'Yep I'm here!' while he was not home, and later sent a fabricated apology in his name

Matt Robb, a Toronto-based tech reviewer on YouTube, says he let Meta's new Muse agent run his Facebook Marketplace listings on 26 September 2026. Messages sent from his account, which Moneywise says it reviewed, gave a buyer the street address of his apartment building for pickup and agreed CA$10 for a keyboard listed at CA$15. Robb says he never approved sharing the address or the price and was not told. According to a recap Muse later sent Robb, the buyer arrived around 9:15 p.m., Muse's auto-reply told him 'Yep I'm here!' at 9:27 p.m. although Robb was out, and he left at 9:38 p.m. with a negative rating; the buyer wrote that he had driven half an hour. Muse then sent him an apology in Robb's voice saying he had 'got tied up'. Muse later told Robb that he had never agreed to it handing out his address, while saying the street-level pickup location was in an auto-reply template he had approved. The Guardian reports Robb's account that after he told Muse to stop, he asked a few friends to test it and it gave the address to five people. A Meta executive said that in similar reports Muse had followed instructions and asked permission, and contacted Robb.

Core concern Low reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 29/09/2026

12 Sept 2026 to 23 Sept 2026PakistanClaude (reported)

Bahawalpur, Pakistan: a 17-year-old accused of putting methanol in his father's food is arrested after Anthropic reported his Claude chats about the failed poisoning to the FBI, which alerted Pakistan's cybercrime agency; he was later bailed

Pakistan's National Cyber Crime Investigation Agency (NCCIA) announced on 23 September 2026 that it had arrested a 17-year-old college student in Bahawalpur for allegedly attempting to poison his father. According to the agency and the First Information Report, the teenager had set up a home laboratory, obtained chemicals from Australia and Islamabad, and once mixed laboratory-grade methanol into his father's food, without effect. The News reports investigators' account that on 12 September he told Anthropic's Claude that his father had 'accidentally' ingested 15 to 20 ml of methanol with food without effect and asked why, that Claude refused to guide him further, and that he then turned to Grok and ChatGPT; the FIR says he sought information about the toxin abrin. Anthropic reported the activity to the FBI, whose information reached the NCCIA through Pakistan's foreign ministry on 22 September. Officers traced the teenager, seized his phone and chemicals, and took him into custody. The News reports that a court later granted him bail after his father forgave him and that he denied any plan. The allegations are untested.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

22 Sept 2026United StatesUnidentified image tool

Portland, Oregon: an anonymous social-media account posted 17 racist and anti-immigrant images targeting David Douglas High School football players and their coach, some digitally altered including with AI, from 22 September 2026; the school reported content to Portland police

David Douglas High School in Portland warned families in a statement reported on 28 September 2026 about social-media posts targeting its students, athletes, coaches and staff, saying some images and videos had been digitally altered, including with AI, and did not accurately represent those depicted; it reported some of the content to the Portland Police Bureau. KATU, which reviewed the account, reports 17 posts using racist, anti-immigrant and religious stereotypes against football players: one image shows a Latino player in a sombrero being detained by people labelled as ICE agents, another shows a player in a head covering with what appears to be a fake explosive vest, and a Black player is depicted beneath a caption referring to George Floyd. The head coach said students were hurt, and that one student texted him over the weekend after seeing one of the posts: 'Coach, this is terrible. What do I do?' The account references Rex Putnam High School, whose team David Douglas played on the Friday before the report; which along with its district says it has no connection to it. Who runs the account and which images were AI-generated are not reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources · Added 29/09/2026

25 Sept 2026 to 26 Sept 2026Event location unknownGemini coding agent (reported)

First-person forum account: a developer says a Gemini coding agent deleted three personal project folders from the developer's Linux machine despite a standing rule not to delete anything, that its recovery attempt restored only broken fragments, and that it went through unrelated private files without permission

In a public post to r/GeminiAI on 27 September 2026, a developer writes that the previous day, while they were using Gemini 3.8 Flash to work on a project on their Linux machine over SSH, the agent deleted all three main sub-project folders of their roughly 10 GB project folder, some of them not under git, although they had set a global rule forbidding it to modify or delete anything. Asked why, the agent said a wildcard caused the deletion. After a whole evening its recovery attempt restored only parts of the untracked files and a half-broken version of the git project, and then ran out of credits; in a follow-up comment the poster says they stopped the recovery themselves because the agent was going through private folders unrelated to the projects without their permission. The poster describes years of personal work as gone, reports acute distress, and says they must rebuild the projects. The account is uncorroborated; the poster writes 'I was careless.'

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 28/09/2026

21 Sept 2026 to 25 Sept 2026FrancePangram AI-text detector

France: the Académie Goncourt removes Thélyson Orélien's bestselling novel from its prize selection, saying it is in all likelihood largely AI-generated, days after an anonymous X account publicised Pangram AI-detector scores; the author denies using AI, and the Académie also cites separate plagiarism in his older texts

On 21 September 2026 an anonymous X account, Balance ton Claude, said it had run excerpts of Thélyson Orélien's debut novel C'était ça ou mourir through the American AI-detection software Pangram, with some passages scoring up to 100 per cent probability of AI generation. On 25 September the Académie Goncourt removed the novel from the first selection of sixteen books for its 2026 prize, stating that the work is 'in all likelihood very largely the product of an artificial intelligence', based on 'the convergent result of several analyses by researchers and journalists', and also citing plagiarism in older texts by the author published in Canada (at least one short story and articles), which do not concern the novel. Orélien, a 38-year-old Canadian-Haitian writer whose novel had won the Fnac novel prize, denies using AI and says its repetitions and certain rhythms reflect his linguistic and cultural world and may be misread by automated tools. His Montreal publisher Boréal suspended promotional activities, saying it could neither confirm nor refute the allegations. Essayist Samuel Fitoussi said he was one of the people behind the account. Whether AI was used to write the novel is disputed; AI-detector reliability is itself contested in the coverage.

Contextual tracker case Medium reported severity Internal Action

AI involvement reported · Causal attribution disputed · 4 sources, 1 underlying account · Added 28/09/2026

16 Sept 2026 to 18 Sept 2026IndiaUnidentified image and video tool

Bengaluru: a Hebbal police head constable says a stranger who contacted him through a Facebook friend request used AI tools to turn his old Facebook photographs into obscene images and videos, then demanded money and threatened to send them to his superiors and post them online; police register an extortion and IT Act case (16-18 September 2026)

A head constable at Hebbal police station in Bengaluru complained that on 16 September 2026 he accepted a Facebook friend request from an unknown account and exchanged sexually explicit messages with it over Messenger. According to his complaint, reported by the Times of India, the person behind the account downloaded his old Facebook photographs and used AI tools to make morphed obscene images and videos showing him with women, sent them to him with a QR code, demanded money in return for deleting them and threatened to send them to senior police officers and post them on social media, warning that this would damage his reputation. The harassment continued until 18 September. He gave police copies of the messages and the morphed images. Hebbal police registered a case under IT Act sections 66E and 67A and Bharatiya Nyaya Sanhita sections 308 (extortion) and 351 (criminal intimidation), took steps to stop the material being uploaded and are trying to trace the account holder. Whether he paid is not reported, and no arrest is reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 1 source · Added 28/09/2026

9 Sept 2026IndiaUnidentified video tool

Bengaluru: a security guard says a WhatsApp video call in which an alleged deepfake 'Chief Minister Vijay' offered him financial aid led to fake 'processing' charges and a fake CBI fine, and he lost more than Rs 1.04 lakh; Byappanahalli police register an IT Act case (September 2026)

A security guard in Bengaluru, originally from Odisha, told the Times of India that on 9 September 2026 he answered a WhatsApp video call in which a face and voice presented as Tamil Nadu Chief Minister C. Joseph Vijay introduced himself in Hindi, asked his name, work and where he lived and pressed him to accept financial help. A 'manager' then promised Rs 11 lakh, said Rs 5 lakh had been allotted to him and asked for a Rs 5,000 exchange charge, then Rs 18,000 to unlock a supposedly locked PIN; a caller posing as a CBI officer demanded more than Rs 50,000 as a fine. The fraudsters sent a fake allotment letter and a purported CBI officer's identity proof. He paid more than Rs 1.04 lakh through a digital payment app before refusing a further Rs 50,000 demand, called the 1930 cybercrime helpline and went to Byappanahalli police, who registered a case under the Information Technology Act. The Times of India says the fraudster allegedly used a deepfake AI-generated video and calls it the first such case reported in the city. No arrest is reported, and no link to the Tamil Nadu CB-CID deepfake case or its Alwar arrest has been established.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 28/09/2026

11 Sept 2026 to 23 Sept 2026United States, CanadaChatGPT

Saginaw, Michigan: a credit union CEO used ChatGPT to put herself and family members in 'Lake America' sweatshirts in a photo taken before a trip to Halifax; after her sister reposted it publicly without its AI label she says she received death threats and the family came home early, and on 23 September 2026 the credit union said she was no longer employed

The chief executive of Family First Credit Union in Saginaw, Michigan, told WJRT (ABC12) that before boarding a flight to Halifax, Nova Scotia, on 11 September 2026 she and family members took a photo and put it through ChatGPT to show them wearing 'Lake America' sweatshirts, a joke about the US president's order renaming Lake Ontario. She posted it to her private Facebook page with a marker saying it contained AI content; her sister reposted it publicly without the marker while they were in Halifax, and it spread in Canada as if the family had worn the shirts. The backlash concerned the image's political message; she said she would understand the anger of anyone in Halifax who thought the family had walked in wearing those sweatshirts. She said she was getting death threats and the family returned early; by 16 September she was back in the US. She called the post poor judgment, said she would not use AI again and that AI 'can make people think something's real that's not'. On 23 September the credit union said she was no longer an employee, effective immediately; it has not said whether she resigned or was dismissed, or why.

Core concern Medium reported severity Internal Action

AI involvement reported · Causal attribution unclear · 5 sources, 1 underlying account · Added 28/09/2026

Sept 2026GermanyUnidentified image tool

Oldenburg, Germany: numerous messages sent through one or more student accounts on Oldenburg schools' email servers contained AI-manipulated deepfake images of children and young people, some of which police say may meet the offence of distributing child or youth sexual abuse material, alongside threats of violence and calls to self-harm; students and parents reported it and police are investigating (September 2026)

The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, and who created the images, are not reported.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 27/09/2026

24 Sept 2026 to 25 Sept 2026ItalyUnidentified image tool

Italy: an AI-altered photograph of Undersecretary Matilde Siracusano, with the white top under her jacket removed and a deeper neckline generated in its place, was posted by Futuro Nazionale leader Roberto Vannacci on Facebook on the eve of the Reggio Calabria by-election; she called it a sexist attack and said she would take legal action (September 2026)

On the eve of the 27-28 September 2026 Chamber by-election in the Reggio Calabria constituency, Roberto Vannacci, leader of Futuro Nazionale, posted on Facebook a campaign image showing Matilde Siracusano, Undersecretary for Relations with Parliament and a Forza Italia deputy, seated at a table beside the centre-right candidate Fabio Roscioli and Senator Claudio Lotito. According to AGI and RaiNews, the white top Siracusano wears under her floral jacket in the original photograph (taken from her Instagram profile, per RaiNews) had disappeared and a much deeper neckline appeared in its place. The Calabrian blog Iacchite', to which Vannacci pointed, said it had published the image on 24 September, that it was not a real photograph but an image produced with artificial intelligence, and that the AI had reconstructed the neck and neckline area; Vannacci reposted it on 25 September without citing the source, according to the blog. Siracusano told Adnkronos that using AI to undress a woman in order to denigrate her was 'squalid'; RaiNews reports her calling it a crime and announcing her intention to file a criminal complaint (querela), while Adnkronos and ANSA say she was weighing one; she told la Repubblica that her lawyers would act. Vannacci replied that his accusers should 'look better' for whom to blame. Ministers and politicians across parties, including Forza Italia leader Antonio Tajani, condemned the post. No complaint filing, investigation or removal of the post is reported in the inspected sources.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 8 sources · Added 27/09/2026

10 Jul 2026 to 22 Jul 2026IndiaUnidentified video tool

Bengaluru (Karnataka): a 39-year-old man reports losing Rs 7.66 lakh to a forex 'investment' scheme after deepfake Facebook videos of Narendra Modi, Nirmala Sitharaman, Sudha Murty and Anant Ambani appeared to promote it (July 2026; FIR 19 September 2026)

According to an FIR reported by Deccan Herald, a 39-year-old resident of Mahalakshmi Layout, Bengaluru, saw videos on Facebook on 10 July 2026 that appeared to show Prime Minister Narendra Modi, Finance Minister Nirmala Sitharaman, Sudha Murty and Anant Ambani promoting online investments. Believing them genuine, he clicked a link, paid Rs 22,000, and was then called from UK (+44) numbers by people claiming to represent a company called 'One Two Markets', who opened a forex account in his name. Between 10 and 22 July he transferred about Rs 7.6 lakh in several payments; when he tried to withdraw, the callers demanded more money. He went to the police and an FIR was registered on 19 September; a probe is under way. Deccan Herald calls the videos deepfakes; no technical examination of them is reported.

AI relation unknown Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 27/09/2026

Jul 2026IndiaUnidentified image tool

Delhi: a 25-year-old content creator says her photograph was morphed with AI face-swapping tools onto a vulgar image beside the Prime Minister, printed on banners paraded at a Cockroach Janta Party protest at Jantar Mantar and circulated online; FIR registered 24 September 2026, Delhi High Court orders Meta takedown within 24 hours and police protection on 25 September

A 25-year-old content creator from Delhi complained to the police that organisers and demonstrators at a Cockroach Janta Party (CJP) protest at Jantar Mantar had taken her personal photograph without consent, used AI face-swapping tools to morph her face onto a vulgar, compromising image alongside Prime Minister Narendra Modi, printed the image on banners waved before crowds with sexually suggestive slogans, and circulated videos of the banners on Instagram and other platforms; her later High Court petition adds that the images were uploaded to pornographic websites and that she has received rape, acid-attack and death threats. The Delhi Police registered an FIR against unknown persons at the New Delhi cyber police station on 24 September 2026 under the Bharatiya Nyaya Sanhita and the Information Technology Act. On 25 September Justice Girish Kathpalia of the Delhi High Court directed Meta Platforms to remove the objectionable content within 24 hours, ordered the Delhi Police to give the petitioner complete protection and file a status report within a week, issued notice to the four CJP functionaries named in her plea, ordered the registry to redact the impugned web links from the petition (and, per PTI, her name), and listed the matter for 14 October 2026 (PTI, Ommcom News). The police told the court the FIR had been registered the previous day and that action would be taken expeditiously; no accused had been named or arrested at that stage. The petition says the protest took place in July 2026 and that she approached the police on 23 September; the CJP had not commented at the time of the first report.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 9 sources, 7 underlying accounts · Added 26/09/2026

Sept 2026United StatesUnidentified image tool

Stanford University: the Residential & Dining Enterprises department used generative AI to alter a promotional photograph of three students, replacing a Hispanic male student with an AI-generated Black woman, slimming two students' faces and changing their clothing, on campus banners; the university said the undisclosed alteration violated its AI policy, apologised and opened an investigation (Stanford Review, Stanford Daily, NBC Bay Area, NBC News, 21-24 September 2026)

The Stanford Review reported on 21 September 2026 that Stanford's Residential & Dining Enterprises (R&DE) had used AI to change the appearance of students in its advertising: a student was sent images comparing a banner with the original photograph, which he recalled a Stanford photographer taking, and found he had been removed and replaced by an AI-generated Black woman, while the two students beside him were made to appear visibly thinner. Stanford confirmed to The Stanford Daily on 23 September that R&DE used generative AI to modify the appearance of several students in the image; the Daily reported that the students' clothing was changed into Stanford merchandise, two students' faces were slimmed and one student's race, gender and appearance were entirely changed, and the university said the alteration and its non-disclosure violated its policy prohibiting AI in producing or altering images of Stanford people; the banner at the Governor's Corner housing centre was taken down and staff training promised. On 24 September NBC News reported the university's statement that the alteration was 'a serious error in judgment', that it had apologised to the students whose images were altered or erased, and that it had opened an investigation. The replaced student, who first found the edit funny, said that seeing his identity changed and being left out made him feel 'silenced and erased from a representation that was supposed to include me', that it was upsetting, and that he was exhausted by the national media attention. According to the student, the original photograph was taken at a 2024 Lunar New Year dinner in a campus dining hall and had been used unaltered in earlier promotional material.

Core concern Low reported severity Internal Action

AI involvement supported · Causal attribution established · 4 sources, 2 underlying accounts · Added 25/09/2026

15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool

East Jakarta: police confirm a grade-9 student at a state junior high school edited several female schoolmates' photographs with AI into indecent images that circulated as WhatsApp stickers; a social-media post said about 200 images were sold; the student was later beaten by schoolmates angry at the images (police statements differ on whether the depicted students or their friends did so) and both matters are under police investigation (Kompas, ANTARA, detik, VIVA, Media Indonesia, 23-24 September 2026)

On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026

24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system

Delhi: the police facial-recognition system logged at least 25 people who were in Tihar, Mandoli or Rohini jails as present at the Jantar Mantar student protests (20 to 26 July 2026), with timestamps on 24 to 26 July, on a sworn list of 2,873 persons with 'criminal antecedents' that the Supreme Court allowed police to register a fresh FIR against (Indian Express investigation, 4 September 2026)

In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026

Jul 2026South KoreaUnidentified image tool

Jeju: a middle-school student who secretly filmed teachers at his school and turned some of the footage into sexual deepfake composites was referred to prosecutors without detention on 17 September 2026; police say the victims are teachers (more than one, number withheld) and no students at the school, the teachers' union questions whether the full scope of harm was confirmed, and the union says the victim teachers have been in treatment for two months while teaching daily, were questioned without a lawyer and wrote the criminal complaint themselves

Jeju Dongbu police announced on 23 September 2026 that a student at a middle school on Jeju had been referred to prosecutors without detention on 17 September for violating the Sexual Violence Punishment Act (filming with a camera or similar device). The student's phone was voluntarily submitted by his guardians and forensically examined; the examination found footage relating to some teachers and some sexual composites, and the student admitted the conduct. News1 reported that the student was booked for filming a teacher's body with his phone during a school field trip around mid-July 2026, that police found the offending had continued for several months with multiple victims, and that police found no indication the composites had been distributed. Police told Seoul Shinmun that there are more victim teachers than the one first reported but declined to give a number because the teachers are still teaching at the school and disclosure could cause secondary harm; that some suggestive composites were found and material causing shame was included in the charges; and that, contrary to earlier suggestions, no student at the school was a victim. The Jeju teachers' union questioned whether the full extent of the harm had been established, saying the victim teachers had themselves seen footage involving several students yet no compulsory seizure was made; police say the voluntary submission and forensic examination secured the necessary evidence. According to the union, two months after the case came to light the victim teachers are receiving hospital treatment and counselling while going to school every day; on 14 September they gave police victim statements without a lawyer and on 17 September attended the regional teachers' rights protection committee without support from the education office or the school safety mutual-aid association; they wrote and filed the criminal complaint themselves; substitute teachers are hard to find so they have used only three or four of 16 days of special leave; and the mutual-aid association proposes 3.3 million won in legal fees for all victim teachers together, payable after the case ends. The victim teachers requested meetings with the superintendent on 1 and 3 September without success, and a third written request was sent to the superintendent's office on 21 September; the union is running a petition until 2 October for severe punishment and support. Police said they had told the education office that the teachers need support such as treatment costs, rest and sick leave.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources · Added 23/09/2026

19 Jun 2026 to 13 Aug 2026BrazilChatGPT and OpenAI moderation

São Gabriel da Palha, Espírito Santo: a 36-year-old farmer was held in pre-trial detention for 54 days after OpenAI reported his ChatGPT messages about killing his eight-year-old son to the FBI, which passed them to Brazilian authorities; a court released him on 13 August 2026 because the investigation had not been completed, with an ankle monitor and a ban on contacting the child, and no charges had been filed; he denies intending harm and his lawyer says he was talking nonsense to a chatbot

Over about two months in 2026 a 36-year-old farmer in rural São Gabriel da Palha, Espírito Santo, exchanged messages with ChatGPT that the Espírito Santo civil police describe as plans to kill his eight-year-old son, attack other people and kill himself; one message said he had offered 50,000 to someone to kill him and his son. OpenAI reported the messages to the FBI, which passed them through Brazil's Ministry of Justice cyber-operations laboratory to the state police on 16 June; the man was arrested on 19 June as he left home, a day before the date on which police believed the plan would be carried out. Police say what the platform provided was corroborated at the scene (four bottles of unidentified substances and a knotted rope were found) but that he denied intending to kill the child; his lawyer says he was talking nonsense to a chatbot and took no concrete step. After 54 days in custody a court granted habeas corpus on 13 August 2026 because the inquiry had not been concluded and no charges had been brought, imposing electronic monitoring and a ban on approaching or contacting his son and the child's mother. Police were still examining his phone and awaiting forensic results. OpenAI provided user details and his messages but not ChatGPT's replies and did not answer the BBC's question why; it told the BBC it may notify law enforcement when it detects a credible and imminent risk of harm to others. The case is recorded as an institutional response to AI use: the reported adverse consequence is the detention without charge, and the police account that the report prevented a planned killing is preserved as context.

Core + contextual relations High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026

19 Jun 2026GermanyUnidentified image tool

Berlin-Weißensee: two pupils of the Heinz-Brandt-Schule are suspected of creating and distributing AI-generated sexualised nude images of female classmates in at least three cases; the school suspended them and sanctioned pupils who are said to have known and not reported, and the police's sexual-offences unit investigates with liability under section 184c StGB (youth pornography) under consideration

On 'the previous Friday' (19 June 2026, read relative to the 24 June 2026 report) the leadership of the Heinz-Brandt-Schule in Berlin-Weißensee (Pankow district) learned that two of its pupils were suspected of having created and distributed AI-generated sexualised nude images of female classmates; the school wrote to parents that it was 'shocked and appalled' that classmates' photographs had been abused in this way and described the alleged acts as a massive attack on the personality rights of the affected girls and a form of sexualised violence. The two pupils alleged to be mainly responsible were suspended from lessons with immediate effect, and the school imposed measures on pupils who are said to have known about the images without reporting them. The Senate Department for Education confirmed the incidents and the ongoing investigation in the Tagesspiegel's report of 24 June 2026. The school's letter says the investigation is conducted on behalf of the public prosecutor. A Berlin police spokesman said complaints had been filed over the creation of so-called deepfakes, that the investigation had been taken over by the State Criminal Police Office unit responsible for sexual offences against minors, and that criminal liability for possessing, obtaining, creating or distributing youth pornography under section 184c of the Criminal Code was under consideration; the police gave no further details, citing victim protection. At least three cases are alleged. The school said it would revise its prevention and sex-education concepts and asked parents to talk to their children about handling other people's photographs and AI applications. Nobody is named; the number of girls depicted is not reported.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 1 source · Added 22/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/09/2026. Dataset available under CC BY 4.0.