Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
Dec 2019 to Jul 2020United StatesUnidentified facial recognition system
In a complaint filed in federal court in Pennsylvania on 19 December 2023, the US Federal Trade Commission alleged that the pharmacy chain Rite Aid used facial recognition in its stores to match customers against a database of people it suspected of shoplifting or other wrongdoing, and that staff acted on the match alerts by following, searching, ejecting and publicly accusing customers and by calling the police. The FTC says many alerts were false positives: employees recorded thousands of false-positive alerts between December 2019 and July 2020, staff stopped and searched an 11-year-old girl on a false match, and employees called the police on a Black woman matched to an image of a white woman with blonde hair. Rite Aid agreed to a proposed order barring it from using facial recognition in retail stores for five years, without admitting or denying the allegations.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026
Event date unknownEvent location unknownPangram AI-text detector (reported)
In a post to r/TrueOffMyChest on 11 October 2026, a writer who had posted fan fiction on Archive of Our Own (AO3) since 2023 says a reader accused them of using AI and said that Pangram, an AI-text detector, had rated their work 100% AI. The writer says they have never used AI. They say they then ran Pangram themselves on something written on the spot and on texts from their high-school years in the 2010s, and each came back 100% AI. They say they deleted all their works and their AO3 account rather than face further accusations, and that they feel sad and can never repost the works. In a reply the writer says the accuser was a regular reader who had commented for years. The account is uncorroborated: the accusation, the Pangram results and the deleted works were not published.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 12/10/2026
Event date unknownUnited StatesTurnitin AI-text detector (reported)
The University Press, Florida Atlantic University's student newspaper, reported on 29 September 2026 the accounts of two students who say they were penalised over AI-detection flags. A computer science sophomore submitted a paper 'last year' and received a zero after the professor flagged it for AI use after applying it to Turnitin; after the student emailed the professor, the grade was improved. The student says that when they ran the paper through a detector, it said the writing was overly human-sounding. A senior sociology major was accused of using AI on an essay and received a zero with little communication from the professor; after the student emailed to say no AI was used, the professor waived the penalty and gave a 50. The newspaper describes the second student's grade as due to a false AI detection and does not name the tool in that case. No professor's or university account of either case is reported.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 05/10/2026
30 Sept 2026 to 1 Oct 2026Event location unknownTurnitin AI-text detector (reported)
In a public post to r/ApplyingToCollege early on 1 October 2026 (UTC), a student taking the Advanced Placement (AP) Research course writes that their teacher told them that day that their source annotations had been found to be '100% ai' by Turnitin. The student says they did not use AI. They say their document history shows them typing over the course of an hour and that some sentences closely follow notes they wrote for an earlier assignment. They also say they had faced no AI accusation in a research course with the same teacher the year before. By the student's account, the teacher said the matter would be discussed later and that Turnitin's AI checker feedback never ends up being a false accusation. The student says the accusation leaves them upset and unsure how to defend themselves. No grade or disciplinary outcome is reported. The account is uncorroborated, and one commenter doubted it.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 01/10/2026