Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
Event date unknownFinlandUnidentified image tool
Southeast Finland Police (Kaakkois-Suomen poliisi) opened a preliminary investigation in August 2026 into a case in which a minor boy in Lappeenranta is suspected of using AI to create nude images of several underage girls; Ilta-Sanomat reported that he is suspected of using social media photos of girls he knew, while the investigator told the paper that police could not yet comment on the method. On 25 August the lead investigator told Yle there were tens of victims, possibly more than a hundred, all from the Lappeenranta area; on 28 August police said the number of complainants had proved significantly smaller than first estimated, without giving a figure. Police are investigating the case as aggravated distribution of an image depicting a child sexually, an offence that also covers making such images, and said they were not aware that the AI images had been spread or sold onward. Student welfare professionals offered conversation and crisis support to young people in the town. Police also said the suspect had been threatened and harassed and that someone had tried to break into the suspect's home. The AI tool is not identified; victims and suspect are not named. Yle reported on 27 October 2026 that police had identified 45 victims with certainty, up from 37 about a month earlier; the detective inspector estimated that the final number could rise to fifty and said police aimed to complete the preliminary investigation by the end of the year.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 6 sources, 2 underlying accounts · Added 02/10/2026
Sept 2026GermanyUnidentified image tool
The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, are not reported. On 28 September 2026 the police said a suspect had been identified: a juvenile who, in the investigation so far, admitted the offences he is accused of. The proceedings are conducted by the Aurich public prosecutor's specialised office for violent, pornographic or otherwise youth-endangering content, and the police give no further details about the suspect to protect him.
Core concern Medium reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 27/09/2026
25 Dec 2025 to 14 Jan 2026Event location unknownGrok
From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.
Core concern Critical reported severity Involving minors Regulatory Action
AI involvement supported · Causal attribution established · 13 sources, 10 underlying accounts · Added 11/01/2026