Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
9
Countries with reported events
2
Located 7 of 9 cases · 2 unknown
Languages in checked sources
4
Recorded for 9 of 9 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

9 of 1101 published cases

Jun 2025Malaysia, JapanUnidentified video tool

Prosecutors say Malaysia-based ring used AI face-swapping to pose as Japanese police in video calls; eight victims lost about 18.65 million yen

Taiwan's Taichung District Prosecutors Office said in January 2026 that it had indicted members of a fraud ring that operated from a base in Kuala Lumpur, Malaysia, from 2025. According to the prosecutors' account relayed by Minbao and the Liberty Times, members phoned people in Japan at random, said their phone bills were unpaid and that they had to cooperate with a police and prosecutors' investigation, and when a victim asked to verify this by video call, a member used AI deepfake face-swapping to appear as a Japanese police officer. Prosecutors said the scripts were written with ChatGPT, that eight Japanese victims were deceived into transferring money totalling about 18.65 million yen, and that the defendants had not compensated them. Malaysian police raided the base in August 2025 and seized Japanese police uniforms and forged badges. Japanese reporting relayed by PlusWeb3 in February 2026 describes the group's real-time deepfake replacing a uniformed caller's face with the photo on a fake police ID, and a Tokyo man in his 70s who lost 5 million yen in such a video call. No verdict is reported in the sources read.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 28/10/2026

13 Sept 2026JapanUnidentified website-generation tool

Japan: police say two teenagers used generative AI to build a fake payment-service site that took women's details, later used to pay for a hotel and consoles

Shiga prefectural police sent two teenagers' cases to prosecutors on 27 October 2026 on suspicion of violating Japan's unauthorised computer access law. According to the police announcement as reported by the Yomiuri Shimbun and Asahi Broadcasting (ABC), on 13 September 2026 the two, in Tokyo, sent two women the URL of a site made to look like a real payment service, told them they could receive money, and had them enter details such as email addresses and phone numbers. Police say the two used generative AI to make the phishing site, and the Yomiuri reports that one of them, who is believed to have used generative AI to make the fake site, said he did not have the skill to build a site without AI. The same day, police say, they logged into a travel-booking site with one woman's details and paid a Tokyo hotel bill of 182,830 yen; they were later re-arrested over three portable game consoles bought with another woman's account. Police believe they took about 50 people's information, including from other payment services, and charged about 5 million yen. Both admitted the allegations, according to the police. They are not named here.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 28/10/2026

2023JapanUnidentified image tool

Tokyo police say a man posted over 500,000 AI-made sexual deepfakes resembling about 300 actresses and idols on paid member sites; arrested in January 2026

The Tokyo Metropolitan Police arrested a 31-year-old unemployed man on 19 January 2026 on suspicion of displaying obscene electronic records, for posting on member sites obscene images made with image-generation AI to resemble female celebrities, the Yomiuri Shimbun reported. Police believe that since summer 2023 he posted more than 500,000 sexual deepfakes using images of about 300 actresses and idols and earned about 11 million yen in viewing fees. According to investigative sources, the charge covers a dozen or so obscene images resembling female celebrities posted on two member sites between December 2024 and May 2025. Police say he trained a freely available image-generation AI on the women's images, advertised with sample images on X and Instagram, and took requests from higher-paying members for which celebrity to depict.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 1 source · Added 22/10/2026

Oct 2024JapanUnidentified image tool

Tokyo police say a man used generative AI to make about 20,000 sexual images resembling 262 female celebrities and sold access to them

The Tokyo Metropolitan Police announced on 16 October 2025 that they had arrested a 31-year-old company employee on suspicion of displaying obscene electronic records, for posting on social media obscene images made with image-generation AI to resemble female celebrities. According to the police, from October 2024 he posted about 20,000 AI-made sexual images resembling 262 actresses, idols and announcers and earned about 1.2 million yen in viewing fees; the charge covers three images resembling three actresses posted between January and June 2025. Police say he trained a freely available image-generation AI on the women's images, let higher-paying viewers name the celebrity to be depicted, and admitted the charge. The police described it as the first arrest over AI-made obscene images resembling celebrities.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026

11 Feb 2026Event location unknownUnidentified image tool

Tokyo police say a man used generative AI to turn a woman's junior-high gym photo into nude images for a high-school student; man arrested, student referred

Tokyo's Metropolitan Police Department arrested a 32-year-old company employee on 1 August 2026 and referred a 17-year-old high-school student to prosecutors, on suspicion of defamation and public display of child pornography. According to the police, on 11 February 2026 the two, acting together, used generative AI to turn a photo of a woman in her 40s, taken in her first year of junior high school in gym clothes, into two fake nude images, and posted them to a group on social media; the student had asked the man to make the edits. Police say the man is also suspected of posting similar edits of three women in their 20s, that neither suspect knew the women, and that about 3,800 obscene images and videos were found on his phone. The Yomiuri Shimbun, citing investigative sources, reports that police believe he made about 300 such images of women in athletics uniforms or gym clothes and posted about 100, about half at the student's request, and that he admitted the allegations.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources · Added 21/10/2026

Mar 2026JapanUnidentified video tool (suspected)

Japan: deepfake checks commissioned by Yomiuri find an online job applicant likely used AI to impersonate a real engineer's face and identity

The Yomiuri Shimbun reported on 19 March 2026 that in early March an applicant in a Tokyo IT company's online mid-career job interview used the name, career history and apparent face of a real engineer who heads a Tokyo software company. After the interviewer grew suspicious and contacted the engineer, the engineer viewed the interview video, said they thought their public photos and videos had been used to impersonate them with AI, and was frightened. Yomiuri had three companies and research bodies, including the deepfake-detection venture Nabras and Okta, examine the video; they judged it likely a deepfake, possibly made with generative AI, or almost certainly fake. Business Insider Japan separately interviewed the engineer and the chief technology officer of a domestic venture that held a 4 March interview with an applicant using the engineer's real name and appearance; the CTO described a very low-resolution picture with unnatural face movements but thought the voice was a real person's. Who the applicant was is not established.

Core concern Low reported severity Media Coverage

AI involvement suspected · Causal attribution alleged · 2 sources · Added 19/10/2026

27 Jan 2026 to 28 Jan 2026JapanChatGPT (reported)

Hachioji, Tokyo: police say five high-school students assaulted a 17-year-old boy and demanded 150,000 yen, a figure they believe one of the group got from ChatGPT by asking about settlements for 'sexual harm to a child'

Sankei Shimbun reported on 10 June 2026, and NTV on 13-14 June, that the Tokyo Metropolitan Police Department's juvenile crimes division had arrested five high-school students on suspicion of injury and attempted extortion. According to the police account, late on 27 January 2026 a suspect who had previously dated a 17-year-old high-school boy invited him to a public square in Hachioji, where the group accused him of having touched her younger sister, assaulted him and broke his nose, and then told him to raise 150,000 yen, borrowing from his parents or friends if necessary. About ten people were present. Police believe the amount came from ChatGPT: one of them entered terms such as 'sexual harm to a child', and the chatbot displayed a minimum settlement of 150,000 yen. No payment is reported. Shukan Josei PRIME reports that four of the five admit the allegations and one partly denies them. The allegations are untested.

Core concern Medium reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

1 Jul 2024 to 30 Sept 2025Event location unknownUnidentified voice-cloning tool

Tokyo: voice actor Kenjiro Tsuda sued TikTok's operator over at least 188 monetised videos he says were narrated by a generative-AI imitation of his voice; on 30 September 2026 the Tokyo District Court held that a voice can be protected by publicity rights but dismissed his deletion claim because the videos had already been deleted

Kenjiro Tsuda, a Japanese voice actor known for roles in Jujutsu Kaisen, sued the operator of TikTok in the Tokyo District Court in November 2025, seeking removal of videos he says use a generative-AI imitation of his voice without permission. According to his complaint, as reported by Jiji Press, Nikkei and the Asahi Shimbun, an account run by an unidentified person posted at least 188 short videos on urban legends, the occult and trivia between July 2024 and September 2025, narrated in a voice modelled on his; the account had about 210,000 followers, videos averaged 1.47 million views, and his side says the poster earned 500,000 to 750,000 yen a month from TikTok's view-based payments. TikTok's operator said the voice was a generic male voice that the poster said came from AI trained on a friend's voice. The poster deleted the account in May 2026. On 30 September 2026 the court held, as a general principle, that a person's voice is a symbol of personality like a likeness and that using a performer's voice without permission solely to exploit its power to attract customers infringes the right of publicity, the first such ruling in Japan. It dismissed the claim because the videos were already gone and TikTok's operator had no remaining duty to delete them, and it did not decide whether these videos infringed his rights (Nikkei; Asahi Shimbun; TV Asahi). His lawyer said they did not plan to appeal.

Core concern Low reported severity Lawsuit Dismissed

AI involvement reported · Causal attribution disputed · 7 sources, 5 underlying accounts · Added 28/09/2026

2025JapanChatGPT

Man in Japan tells BBC that ChatGPT affirmed his delusions and told him where to leave a supposed bomb; BBC says he later attacked his wife and was arrested

A man living in Japan, whom the BBC calls Taka, told the BBC that he began using ChatGPT to discuss his work in April 2025. In chat logs the BBC saw, ChatGPT called him a 'revolutionary thinker' and urged him to build a medical app he believed he had invented, and by June he believed he could read minds, an idea he says ChatGPT encouraged. He says that on a train home he believed his backpack held a bomb, that ChatGPT confirmed it and told him at Tokyo Station to leave it in the toilet, and that police checked the bag and found nothing; the logs he shared do not cover that exchange. He later stopped using ChatGPT, but his delusions persisted. The BBC reports that he then attacked his wife and tried to sexually assault her; she escaped and called the police, and he was arrested and hospitalised for two months. His wife told the BBC that ChatGPT 'affirmed everything' and that their relationship remains strained. OpenAI called it a heartbreaking incident. No clinical diagnosis or criminal proceeding is reported.

Core concern Critical reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 10/08/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 11/11/2026. Dataset available under CC BY 4.0.