19 Jun 2026 to 13 Aug 2026BrazilChatGPT and OpenAI moderation
Over about two months in 2026 a 36-year-old farmer in rural São Gabriel da Palha, Espírito Santo, exchanged messages with ChatGPT that the Espírito Santo civil police describe as plans to kill his eight-year-old son, attack other people and kill himself; one message said he had offered 50,000 to someone to kill him and his son. OpenAI reported the messages to the FBI, which passed them through Brazil's Ministry of Justice cyber-operations laboratory to the state police on 16 June; the man was arrested on 19 June as he left home, a day before the date on which police believed the plan would be carried out. Police say what the platform provided was corroborated at the scene (four bottles of unidentified substances and a knotted rope were found) but that he denied intending to kill the child; his lawyer says he was talking nonsense to a chatbot and took no concrete step. After 54 days in custody a court granted habeas corpus on 13 August 2026 because the inquiry had not been concluded and no charges had been brought, imposing electronic monitoring and a ban on approaching or contacting his son and the child's mother. Police were still examining his phone and awaiting forensic results. OpenAI provided user details and his messages but not ChatGPT's replies and did not answer the BBC's question why; it told the BBC it may notify law enforcement when it detects a credible and imminent risk of harm to others. The case is recorded as an institutional response to AI use: the reported adverse consequence is the detention without charge, and the police account that the report prevented a planned killing is preserved as context.
Core + contextual relations High reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026
Event date unknownSpainUnidentified image tool
On 14 July 2026 Spain's Interior Ministry published a Guardia Civil release stating that a 14-year-old from Logroño was under investigation as the presumed author of offences of discovery and disclosure of secrets, corruption of minors and child pornography. Investigators from the technology investigation team (EDITE) and Equipo@ found that he knew all nine victims, all minors and classmates, followed them on social media, took their photographs from the public content of their profiles without consent, and used artificial-intelligence tools to manipulate the images, digitally undress and sexualise them. He uploaded the fake pornographic material to an adult pornography website, created a profile there describing the content as girls from his school made with AI, and organised it in individual folders with each victim's personal data, which the Guardia Civil says made the girls recognisable and multiplied the emotional and social harm. Before the content could be removed it had reached about 40,000 views, amplifying the harm to the nine girls' privacy within hours. The proceedings were passed to the juvenile prosecutor under the juvenile criminal responsibility law; the release notes that parents or guardians are jointly liable for moral damages. Diario de León (Europa Press, 26 July) placed the case in a series of Spanish school cases since Almendralejo in 2023 and, unlike the release, described the minor as having been arrested.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 23/09/2026
19 Jun 2026GermanyUnidentified image tool
On 'the previous Friday' (19 June 2026, read relative to the 24 June 2026 report) the leadership of the Heinz-Brandt-Schule in Berlin-Weißensee (Pankow district) learned that two of its pupils were suspected of having created and distributed AI-generated sexualised nude images of female classmates; the school wrote to parents that it was 'shocked and appalled' that classmates' photographs had been abused in this way and described the alleged acts as a massive attack on the personality rights of the affected girls and a form of sexualised violence. The two pupils alleged to be mainly responsible were suspended from lessons with immediate effect, and the school imposed measures on pupils who are said to have known about the images without reporting them. The Senate Department for Education confirmed the incidents and the ongoing investigation in the Tagesspiegel's report of 24 June 2026. The school's letter says the investigation is conducted on behalf of the public prosecutor. A Berlin police spokesman said complaints had been filed over the creation of so-called deepfakes, that the investigation had been taken over by the State Criminal Police Office unit responsible for sexual offences against minors, and that criminal liability for possessing, obtaining, creating or distributing youth pornography under section 184c of the Criminal Code was under consideration; the police gave no further details, citing victim protection. At least three cases are alleged. The school said it would revise its prevention and sex-education concepts and asked parents to talk to their children about handling other people's photographs and AI applications. Nobody is named; the number of girls depicted is not reported.
Core concern Medium reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 1 source · Added 22/09/2026
16 Sept 2026IndiaUnidentified video tool
A Rajasthan social-media influencer visited Haridwar with her family in June 2026 and on 6 June uploaded to Instagram a short video, recorded by relatives, of herself taking a dip in the Ganga at Har Ki Pauri wearing a salwar suit. About two months later she found that the video had been manipulated with AI into an objectionable version showing the same movements with her face and body portrayed 'in a shameful manner'; the fake reel went viral in the week before 20 September and drew objectionable comments and re-sharing. In a public appeal she asked whoever uploaded it to remove it, saying it was a matter of her dignity, that she was mentally very disturbed and had reached a point where she could not step out of her house. She filed a complaint with the cyber-crime police on 16 September 2026; the investigating Rajasthan Police Service officer said they were trying to identify who created and circulated the video and to have it removed, and that identifying the accused would take time. Dainik Bhaskar's English edition reported the case on 20 September in a 'Sunday Big Story' that does not name her.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 21/09/2026
Event date unknownIndiaUnidentified image tool
Dainik Bhaskar reported on 19 September 2026 that a young woman in the Chaubepur police-station area of Varanasi complained that an unknown person, who had been calling her repeatedly from an unknown number, created a fake Instagram profile resembling her name, used an AI tool to place her face on another young man's photograph to produce objectionable images, and sent them to the Instagram accounts of her prospective in-laws and her prospective brother-in-law with the aim of breaking off her prospective marriage. Chaubepur police registered a case against unknown persons on the basis of a public-hearing reference (1621/26); the station in-charge said digital information about the phone number and the fake account was being gathered with cyber experts to identify and locate the accused, and that action would follow once the accused's role was clear. The report is a single local account of the complaint; the dates of the images and the complaint are not stated.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 20/09/2026
11 Aug 2026BrazilUnidentified voice-cloning tool
On Monday 10 August 2026 a digital influencer from Picos, in the centre-south of Piauí, began negotiating a car advertised online for sale in Fortaleza (Ceará), where an uncle of his lives, and asked the sellers to take the car to the uncle so he could inspect it. On Tuesday 11 August a contact using a different number but the uncle's photo sent him audio messages in a voice identical to his uncle's, generated with artificial intelligence, saying the car was in good condition and telling him to make the bank transfer. Believing he was speaking to his uncle, he transferred the money; when he then called the uncle's real number he learned he had been defrauded. The loss exceeded R$56,000, money he says he had saved for years. He registered a police report on 11 August; the Piauí property-crimes unit (Depatri) is investigating and he is seeking a refund from the banks. The account is the victim's own, reported by G1 Piauí on 13 August 2026 from his social-media posts and an interview; the police unit did not respond to G1 before publication.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 20/09/2026
19 May 2026United StatesUnidentified voice-cloning tool (suspected)
A married couple in their sixties buying a US$460,000 condo in Hudsonville, near Grand Rapids, Michigan, received an email on 19 May 2026, days before closing, telling them to wire US$66,026.92 for the down payment and closing costs within 24 hours. The email listed a phone number differing from their loan officer's by two digits, and the husband then received a call confirming the instructions in a voice that sounded just like the loan officer. The couple borrowed from family and other sources and wired the money. The day before closing their real loan officer sent the actual statement; the closing was cancelled hours before signing and the money was gone. The husband now believes the call came from a spoofed number using AI-assisted voice cloning; Tyler Adams of CertifID, which is working with the couple and federal officials, said someone's email in the transaction was probably compromised and that the scammers likely cloned the loan officer's voice from social-media clips. The sender's address had two extra letters ('UnitedsMortgages' instead of 'UnitedMortgage'). Neither the lender nor the loan officer is accused of complicity. The couple later completed the purchase in early June from their mutual fund, reported the loss to the FBI's Internet Crime Complaint Center, and describe lasting apprehension and have discussed delaying retirement. CNN reported the case on 15 September 2026; the account the money went to has since closed.
Core concern Medium reported severity Investigation Opened
AI involvement suspected · Causal attribution alleged · 2 sources, 1 underlying account · Added 20/09/2026
1 Aug 2026 to 16 Sept 2026KazakhstanUnidentified video tool
On 16 September 2026 the Prosecutor General's Office of Kazakhstan warned of an investment-fraud scheme in which criminals advertise non-existent projects on TikTok, Instagram, YouTube and other platforms using deepfake videos of well-known people and fake 'AI' investment platforms promising very high passive income: 'Kaspi AI' with Mikhail Lomtadze, 'Quantum AI' with Elon Musk, 'TON' with Pavel Durov, and 'people's investments' in KazMunayGas or Gazprom fronted by news presenters from Khabar 24, KTK and Channel One. The office said 119 such cases had been registered across the country in the previous one and a half months. Its example: in September 2026 a woman from Taldykorgan saw an Instagram advertisement offering high returns from share trading, left her details through the link, was contacted by the fraudsters and, following their instructions, transferred more than 7 million tenge to third-party accounts; the money and supposed dividends appeared in a fake wallet that she could not withdraw from. A pre-trial investigation is under way. The office urged people not to trust guaranteed-return offers or transfer money to strangers.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 5 sources, 1 underlying account · Added 20/09/2026
1 Jan 2026IndonesiaUnidentified image and video tool
A female student at a state university in Solo (Surakarta), Central Java, learned on 1 January 2026 from friends that her face had been composited onto pornographic images and a video, which her lawyer said were found on Instagram and Telegram. Her family reported the case to the Central Java regional police cyber directorate on 28 January 2026. Police issued a formal police report on 31 July, arrested her ex-boyfriend, a university student in Semarang, at his boarding house in Gunungpati on 4 August 2026, and detained him. The police spokesman said the suspect used AI to place the complainant's face on another woman's naked body so that she appeared in pornographic content, uploaded it to his X account, did not sell it, and acted out of resentment after an on-and-off relationship ended. He faces charges under Articles 51 and 35 of the Electronic Information and Transactions Law and an article printed by two outlets as 'Law No. 1 of 2026', with a maximum of 12 years' imprisonment. Her lawyer said she could not sleep, withdrew, felt shame and at one point lost hope, that his team had found seven women in total allegedly targeted of whom six had not reported, and that the suspect's parents asked for an out-of-court settlement; police said only one complainant was confirmed.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 6 sources, 2 underlying accounts · Added 20/09/2026
Dec 2025MalaysiaUnidentified image tool
In early December 2025 a Chinese secondary school in Muar, Johor, expelled three male pupils in Forms 2, 3 and 4 after finding they had used AI software to composite several female classmates' faces onto indecent images, some of which had spread online. The school said it was told of the images on Monday 1 December, investigated immediately, met the parents of all pupils involved, expelled the three under its rules with a stated zero-tolerance policy, and urged victims to lodge police reports and parents to delete any such images. The boys' parents accepted the decision. At least two girls lodged police reports; the Muar district police chief confirmed reports had been received, that the boys had been summoned to assist the investigation, and that an investigation was under way. No charge or later outcome has been reported.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 20/09/2026
2025IndonesiaUnidentified image and video tool
Bogor Regency police confirmed on 18 September 2026 that they are investigating a report that pupils of a private school in Cileungsi had their faces edited with artificial intelligence into pornographic content. The head of the women-and-children unit told Kumparan that so far three pupils had reported in a single police report, that the case began when a victim heard from a friend that someone was making content with their face using AI technology, and that investigators were still establishing who made the content and which program was used, under the Electronic Information and Transactions Law. A lawyer for the witnesses, quoted by Pojok Bogor and Uzone, says the victims number in the hundreds; that two former pupils, one as initiator and one as maker, have been reported and admitted the acts to witnesses; that police found thousands of suspected AI-manipulated photos and videos on a suspect's phone, some uploaded to websites including an online-gambling site; and that the case, reported on 19 May 2026, is believed to have run since 2025 while all involved were still pupils, some victims now being university students. Police say the case is at an early stage and asked the public not to draw conclusions.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 2 sources · Added 19/09/2026
Event date unknownUnited KingdomUnidentified video tool
On 7 September 2026 the Police Service of Northern Ireland (PSNI) said a person in the Ards and North Down area had lost £250,000 in what it called a 'sophisticated and substantial' investment fraud. The victim first saw what appeared to be an AI-generated online video featuring a well-known personality from the financial sector promoting an investment with significant returns. After investing a small amount the victim was contacted on WhatsApp and encouraged to pay more, persuaded to open multiple online accounts, to allow the fraudsters remote access to a computer 'to assist with the investment', to borrow money to keep investing, and finally to make further payments to 'release' funds supposedly held in the investment. The PSNI did not name the personality; BBC News NI noted that fabricated endorsements of financial experts such as Martin Lewis, Peter Jones and Steven Bartlett circulate online.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 18/09/2026
14 Sept 2026United StatesUnidentified image and video tool
On 14 September 2026 Manhattan District Attorney Alvin Bragg announced the seizure of 12 domain names used to disseminate, publish and sell non-consensual AI-generated sexual 'deepfake' videos. His office said individuals under investigation had used AI image- and video-creation tools to turn photos and videos of approximately 1,200 real people, overwhelmingly women, into hyper-realistic sexual imagery without consent. The victims included actors, politicians, athletes, musicians, activists and social-media influencers. WIRED and outside researchers reported that many videos reposted content from the defunct MrDeepFakes platform and that dozens of politicians appeared on the sites; investigations into who ran them are ongoing.
Core concern High reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 2 sources · Added 17/09/2026
12 Jun 2026RussiaChatGPT
On 12 June 2026 a Russian-speaking crypto investor, known by the alias Alex (@vesnuhin), asked ChatGPT in Russian where to swap sFLR for WFLR tokens. ChatGPT's reply included a link to sceptre.network, a phishing clone of the legitimate sceptre.fi. He connected his wallet and signed an unlimited-approval transaction; within seconds about 1.9 million FXRP, worth roughly $2.1 million (about 180 million rubles), were drained. A blockchain analyst traced the theft, and reported that the phishing link appeared only in Russian-language answers. Russia's Interior Ministry (MVD) later confirmed the loss.
Core concern High reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 17/09/2026
12 Mar 2026 to 25 Aug 2026United KingdomUnidentified AI tool
On 25 August 2026 the Solicitors Disciplinary Tribunal struck Abhishek Kumar off the Register of Foreign Lawyers after finding proved that his 12 March 2026 Answer to the SRA's Rule 12 Statement contained misleading quotations and citations produced with generative AI — including a non-existent 'SRA v Chan [2020] EWHC 1502' and a miscited 'SRA v James, MacGregor & Naylor [2018] EWCA Civ 1420' that is actually an intellectual-property case — and that his 9 April 2026 email admitting AI use was itself AI-drafted with further errors. The tribunal said it would have struck him off on that allegation alone; the parallel ground was his January 2024 conviction under s.21 of the Immigration, Asylum and Nationality Act 2006. This is the SDT's first case on a lawyer's use of AI, per the SRA's counsel.
Core concern High reported severity Regulatory Action
AI involvement supported · Causal attribution established · 5 sources · Added 15/09/2026
1 Aug 2025 to 9 Sept 2026United StatesChatGPT
Santa Fe defense attorney Stephen Aarons used ChatGPT (OpenAI's o3) on a Rev.com transcript and the record to draft briefing in the murder appeal of Oscar Renee Sandoval; the brief contained fabricated witnesses and testimony (including police officers 'Michelle Amarillo' and 'Sanchez' and invented testimony attributed to real people) and misdescribed real precedents. After a 21 August 2026 show-cause hearing at which Aarons admitted he had not verified the output, the New Mexico Supreme Court's written order of 9 September 2026 held him in direct contempt, fined him $5,000 payable to the State Bar Client Protection Fund within 30 days, removed him from the case, barred him from appearing before the court pending a disciplinary-board referral, struck the filed briefs and reassigned the appeal to the public defender.
Core concern Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 3 sources · Added 15/09/2026
Mar 2026IndiaUnidentified image and video tool
Indore police registered an FIR at Banganga police station on a first-year college student's complaint reported on 12 and 13 May 2026. She said she had met the accused, a young man from the Indore area, at her sister's wedding in 2024, where he took some photographs of her; he later pressed her to marry him and, when she refused, threatened to edit her photographs with AI into objectionable (Navbharat Times, Amar Ujala) or obscene (Patrika) images and post them online. Navbharat Times reports that he edited the pictures with AI, blackmailed her with them and, after her family arranged her engagement elsewhere, reached her fiancé and showed him the edited pictures, after which the families quarrelled and the engagement was broken; Patrika says he went to the fiancé's home and intimidated him into breaking the match; Amar Ujala says he also threatened to kill her and her family and sent edited pictures when her family tried to reason with him, and that when her engagement took place about two months earlier he went to her house and made false allegations about her character in front of the prospective fiancé, after which the engagement broke. She went into severe mental distress and, according to Amar Ujala, had resolved to take a suicidal step before telling her family, who took her to the police. The FIR was registered under the IT Act and sections on criminal intimidation and defamation; police were searching for the accused.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 15/06/2026
14 May 2026IndiaUnidentified image tool
On the night of Thursday 14 May 2026 a 17-year-old Class 11 student was found hanging in her room at the family home in Bhopal's Aishbagh area after sending her younger sister out on a pretext; relatives brought her down but she had died. Her family told the Times of India and Dainik Bhaskar that two young men (both from the Chhola area according to the Times of India; one from Chhola and one from her neighbourhood according to Dainik Bhaskar) had harassed her for weeks, stalked her to and from school, pressured her to meet them, and threatened to circulate obscene images of her that they had made with AI tools from photographs taken from her social-media accounts; the family said she had never met them in person; they also told Dainik Bhaskar that she had told her parents, that the men had misbehaved with her father when the family tried to reason with them, and that fear of social defamation had kept them from going to the police earlier. The Aishbagh police station in-charge said an unnatural-death case had been registered, no suicide note was found, the family's statements were being recorded and further action would follow; investigators were expected to examine her phone and social-media accounts. After the post-mortem on 15 May relatives took the body to the police station and demanded action against the accused. No arrest or later development was found in this review.
Core concern Critical reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 15/06/2026
Feb 2026 to Apr 2026BrazilUnidentified video tool
A humorist and tyre repairer from Lençóis Paulista, São Paulo state, who posts on YouTube, Instagram, Facebook and TikTok as an impersonator of a television presenter, used AI tools to turn photographs that young women and adolescent girls of the Congregação Cristã do Brasil (CCB) had posted from inside churches into videos in which they appear dancing sensually beside women in short skirts, with the presenter inserted and the influencer commenting on their clothes. A 16-year-old congregant and her parents went to the 8ª Delegacia de Defesa da Mulher in São Paulo in February 2026; g1 made the case public on 22 April 2026 and Folha de S.Paulo confirmed the investigation. The girl told g1 the photograph had been taken in 2025 in front of the altar of a CCB church, that she was very shy, had not wanted to be exposed and was afraid the exposure would affect her social life, and that she had stopped taking photographs of herself; her family sued for moral damages. On 30 April 2026 the mother of a second girl, aged 17, registered a police report at the 4ª DDM Norte; g1 reported that the exposure had affected the girl psychologically. The São Paulo Civil Police investigate under article 241-C of the Estatuto da Criança e do Adolescente (simulating a sex or pornography scene with a minor by digital means) and for defamation of adult women in the videos; the inquiry was sent at the prosecutor's request to Lençóis Paulista, where the suspect lives, and the total number of people depicted was still being established. The influencer admitted making the videos with AI, said through his lawyer that they were satire and criticism of customs in a context of humour, said he did not know some of those depicted were minors, denied in his police statement linking the adolescent's image to sexualised content and said he had taken her for an adult, and posted an apology video (dated 5 April by g1's first report, which says it does not mention the deepfakes; described as posted after his police statement in g1's second report). The CCB said it had identified him, was taking internal measures and supports legal measures by the authorities. No later development was found on 2026-09-22.
Core concern High reported severity Involving minors Investigation Opened
AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 14/06/2026
Dec 2024SpainUnidentified image and video tool
In December 2024 a female student in the Ribera Alta area of Valencia province reported to the Guardia Civil that a social-media account had been created in her name featuring an AI-generated video, and later a second account in her name, other accounts showing AI-generated nude videos, and a webpage advertising the images for commercial purposes; the Guardia Civil said the photos, all of minors, had been manipulated so that the people in them appeared completely naked. After 15 other minors came forward with similar complaints, officers traced IP addresses and account emails to the home of a 17-year-old schoolmate, who is being investigated on suspicion of corrupting minors under a Valencia youth court. The Guardia Civil announced the investigation on 27 July 2025.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 1 source · Added 09/03/2026