Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
10
Countries with reported events
1
Located 9 of 10 cases · 1 unknown
Languages in checked sources
2
Recorded for 10 of 10 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighLow
More filters: AI relation, use, setting, sources and responses
Clear filters

10 of 1099 published cases

Event date unknownIndonesiaUnidentified image and video tool

Semarang court jails university student for a year over AI-edited sexual images made with faces from the student's former high school

In October 2025 indecent photos and videos showing the faces of female students and at least one teacher of a public high school in Semarang, Central Java, spread on X from the account of a university student in Semarang who had attended the school. Kompas described the videos as made with AI editing. The student posted an apology on the school's Instagram account saying the student had edited and uploaded friends' photos and videos without permission. Central Java police's cyber directorate investigated, named the student a suspect and took the student into custody on 13 November 2025; the police spokesman said investigators had established the elements of an AI-based pornography offence that also breached the electronic information and transactions law. On 5 March 2026 Semarang District Court sentenced the student to one year in prison and a 2-billion-rupiah fine, more than the seven months prosecutors had sought. According to ANTARA, the court found that the student had produced 1,100 pornographic photo and video files, that the content remained publicly accessible and that the editing caused the victims psychological trauma. Both sides said they would consider the verdict; no appeal outcome was found.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 01/11/2026

2025IndonesiaDreamFace and dupdub (reported)

Surabaya court jails two over AI deepfake videos of East Java Governor Khofifah offering cheap motorbikes that police say defrauded about 100 people

East Java regional police (Polda Jatim) said on 28 April 2025 that they had arrested three suspects from Pangandaran, West Java, after the provincial communications office reported TikTok videos in which Governor Khofifah Indar Parawansa appeared to offer motorbikes for Rp500,000. According to the police, the videos were manipulated with AI deepfake technology, one suspect told investigators that the governor's video had been edited with AI, and people who answered the videos contacted a WhatsApp number and transferred money; police estimated about 100 victims in four provinces and Rp87.6 million taken over three months. The indictment read at the Surabaya District Court on 15 October 2025, as reported by Harian Disway, says the video was edited with the DreamFace app and dupdub.com so that the governor's lip movements and voice looked real, and gives the proceeds as Rp79.6 million. Suara Publik reported on 16 December 2025 that the court found two defendants guilty of jointly manipulating electronic information and sentenced each to three years in prison and a Rp500 million fine; the third suspect's case file was separate.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 01/11/2026

Nov 2024 to Feb 2025IndonesiaUnidentified video tool

Indonesia: police say deepfake videos of President Prabowo offering aid led viewers to pay fake 'administrative fees'; two suspects arrested in early 2025

Indonesian police say a 29-year-old man and a 25-year-old in Lampung province made or spread AI deepfake videos showing President Prabowo Subianto, Finance Minister Sri Mulyani and other officials offering government aid, with a WhatsApp number attached. According to police, viewers who contacted the number were asked to transfer an 'administrative fee' and promised a disbursement that never existed; police recorded 11 victims of the first suspect from five provinces, and the second suspect alone is said by police to have taken roughly Rp 65 million from roughly 100 people in 20 provinces since December 2024. A police forensic laboratory reported the video as a deepfake with a near-100% fake score. The suspects were arrested on 16 January and 4 February 2025 and handed to prosecutors in April 2025.

Core concern Low reported severity Criminal Charges

AI involvement supported · Causal attribution alleged · 8 sources, 2 underlying accounts · Added 09/10/2026

Event date unknownIndonesiaUnidentified image tool

Garut, West Java: a local outlet reports that a young man paid Rp200,000 to an unknown account that threatened to spread an AI-made fake nude photo

Kilas Garut News reported on 3 October 2026 that a young man from Karangpawitan in Garut Regency, West Java, was extorted by an unknown account that threatened to spread a fake nude photo made with AI. According to the report, the account demanded money to delete the photo and the young man, frightened, transferred Rp200,000; the account then asked for a second payment for permanent deletion. The young man told family members, who consulted a journalist of the outlet. The journalist is quoted as saying the photo was an AI paste-up and as advising the family to stop paying and block the account, which they did. No police report is mentioned. The account comes from the outlet and its own journalist, who helped the family.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 05/10/2026

Event date unknownIndonesiaUnidentified voice-cloning tool

Malang, East Java: the head of the financial regulator's local office says a resident lost Rp80 million after a caller used an AI clone of a close friend's voice to ask for a transfer

Malang Post reported on 2 October 2026 that the head of the Malang office of Indonesia's Financial Services Authority (OJK), speaking on a Radio City Guide FM talk show that day, described the latest case to befall a resident of Malang. According to the report, the perpetrator used AI to clone the voice of the victim's close friend very precisely and called the victim from a new number to ask for a money transfer; the victim believed the voice and lost Rp80 million. No date, police report or arrest is given. The account is the OJK official's as reported by one outlet; the call was not heard and the victim is not identified.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 03/10/2026

2025IndonesiaUnidentified image and video tool

Jakarta: AI-manipulated TikTok videos showed toll-road businessman Jusuf Hamka and his daughter in detainee uniforms with bribery and corruption narratives that Hamka denies; a TikTok account holder was arrested in November 2025 and is on trial at the Central Jakarta District Court, where Hamka's side refused restorative justice on 29 September 2026

Indonesian businessman Mohamad Jusuf Hamka reported to Jakarta police on 18 October 2025 that videos circulating on TikTok showed him and his daughter as if wearing prosecutors' detainee uniforms, tied to narratives of corruption, bribery and gratification over the Cawang-Pluit toll concession, which he denies and his lawyers call false; his lawyers say the faces were composited into staged scenes with AI, and that other content called him a 'toll mafia' and posted a fabricated poster of him running for president in 2029. Polda Metro Jaya's cyber directorate arrested the holder of the TikTok accounts on 27 November 2025; Hamka and his lawyers say the defendant admitted to police that he made the content on others' instructions for Rp500,000 per item; tvOneNews and TVRI note this is Hamka's side's claim within the contested case, and Poskota reports it is being examined at trial. The case file was reported complete (P21) on 12 August 2026 and the trial opened at the Central Jakarta District Court on 15 September 2026 under the Electronic Information and Transactions Law (Article 35 jo 51(1), maximum 12 years) and alternative counts. Hamka told reporters the content disturbed him and could damage his reputation and that the campaign was systematic. At the 29 September 2026 hearing the judges asked about restorative justice; Hamka's lawyer said there was no room for it unless the defendant named who ordered and paid for the content. The defendant's lawyer said the content related to his work as secretary-general of an anti-corruption committee and that the indictment was unclear.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 9 sources, 4 underlying accounts · Added 30/09/2026

15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool

East Jakarta: police confirm a grade-9 student at a state junior high school edited several female schoolmates' photographs with AI into indecent images that circulated as WhatsApp stickers; a social-media post said about 200 images were sold; the student was later beaten by schoolmates angry at the images (police statements differ on whether the depicted students or their friends did so) and both matters are under police investigation (Kompas, ANTARA, detik, VIVA, Media Indonesia, 23-24 September 2026)

On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026

1 Jan 2026IndonesiaUnidentified image and video tool

Solo and Semarang, Indonesia: a university student's face was composited with AI onto pornographic images and a video by her ex-boyfriend and posted online; the suspect was detained after a nearly seven-month investigation

A female student at a state university in Solo (Surakarta), Central Java, learned on 1 January 2026 from friends that her face had been composited onto pornographic images and a video, which her lawyer said were found on Instagram and Telegram. Her family reported the case to the Central Java regional police cyber directorate on 28 January 2026. Police issued a formal police report on 31 July, arrested her ex-boyfriend, a university student in Semarang, at his boarding house in Gunungpati on 4 August 2026, and detained him. The police spokesman said the suspect used AI to place the complainant's face on another woman's naked body so that she appeared in pornographic content, uploaded it to his X account, did not sell it, and acted out of resentment after an on-and-off relationship ended. He faces charges under Articles 51 and 35 of the Electronic Information and Transactions Law and an article printed by two outlets as 'Law No. 1 of 2026', with a maximum of 12 years' imprisonment. Her lawyer said she could not sleep, withdrew, felt shame and at one point lost hope, that his team had found seven women in total allegedly targeted of whom six had not reported, and that the suspect's parents asked for an out-of-court settlement; police said only one complainant was confirmed.

Core concern High reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 6 sources, 2 underlying accounts · Added 20/09/2026

2025IndonesiaUnidentified image and video tool

Cileungsi, Bogor Regency, Indonesia: photographs of private-school pupils taken from social media were turned into AI pornographic images and videos, reportedly since 2025; three pupils have filed a joint police report, the victims' lawyer says hundreds were affected, and two former pupils are named as suspects

Bogor Regency police confirmed on 18 September 2026 that they are investigating a report that pupils of a private school in Cileungsi had their faces edited with artificial intelligence into pornographic content. The head of the women-and-children unit told Kumparan that so far three pupils had reported in a single police report, that the case began when a victim heard from a friend that someone was making content with their face using AI technology, and that investigators were still establishing who made the content and which program was used, under the Electronic Information and Transactions Law. A lawyer for the witnesses, quoted by Pojok Bogor and Uzone, says the victims number in the hundreds; that two former pupils, one as initiator and one as maker, have been reported and admitted the acts to witnesses; that police found thousands of suspected AI-manipulated photos and videos on a suspect's phone, some uploaded to websites including an online-gambling site; and that the case, reported on 19 May 2026, is believed to have run since 2025 while all involved were still pupils, some victims now being university students. Police say the case is at an early stage and asked the public not to draw conclusions.

Core concern High reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources · Added 19/09/2026

25 Dec 2025 to 14 Jan 2026Event location unknownGrok

Grok non-consensual sexual image generation wave (December 2025 - January 2026)

From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.

Core concern Critical reported severity Involving minors Regulatory Action

AI involvement supported · Causal attribution established · 13 sources, 10 underlying accounts · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.