14 Aug 2021 to 14 Mar 2024United StatesSt. Louis mugshot recognition (SMRT)
Christopher Gatlin was arrested on 14 August 2021 for an assault at the St. Charles Rock Road MetroLink station after a joint St. Louis County and city team uploaded a grainy, blurry surveillance photograph from a bus into the St. Louis Mugshot Recognition Technology System, a facial-recognition tool that searches stored mug shots (more than 500,000 uploaded, the suit says per the Post-Dispatch; more than 250,000 per Biometric Update via Hoodline), and built the investigation around the resulting match together with a witness identification; he was charged with first-degree assault and held roughly 17 months (the Post-Dispatch says almost two years), a county judge suppressed the witness identification as unconstitutionally suggestive, and prosecutors dismissed the charges on 14 March 2024 (Post-Dispatch; Hoodline citing Biometric Update; Bloomberg Law). Gatlin sued St. Louis County, the City of St. Louis and named officers in the US District Court for the Eastern District of Missouri on 13 January 2025; on 15 October 2025 the court denied the city's motion to dismiss and granted a detective's motion only as to one count; on 13 August 2026 the court allowed a second amended complaint adding Amazon Web Services, which the complaint says supplied the Rekognition program the system used; the county, city and officers answered on 27 August 2026, AWS's response was extended to 21 September 2026 and on 17 September it moved for a further extension to 28 September (no ruling on the docket when read), and a jury trial is set for 1 November 2027 (CourtListener docket). Amazon told the Post-Dispatch that its terms of service prohibit the use of its facial recognition technology in criminal investigations and that it would fully investigate any information that emerges in the litigation. The ACLU lists Gatlin among fourteen people known to have been wrongfully arrested in the US because police relied on erroneous facial-recognition results.
Contextual tracker case High reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 26/09/2026
Event date unknownIndiaUnidentified video tool
The father of a 17-year-old Class 12 student in Bansdih, Ballia district, Uttar Pradesh, gave the Bansdih police a written complaint that a young man from the town, a former schoolmate who had been expelled from the school and bore a grudge against the family, took screenshots of his daughter's social-media account, created a fake Instagram ID in her name with a matching photograph, used AI technology to make an obscene video from her photo and circulated it to her classmates, friends and relatives; the complaint says the youth had earlier made two fake accounts using her and her mother's photographs and threatened to kill the whole family and to spread the video further when they objected (Dainik Bhaskar, Hindustan). The father submitted screenshots of the fake account and his daughter's mark-sheet as proof of her age. The station house officer said a case had been ordered registered and the investigation begun; Jagran reports the case under the Information Technology Act. The reports give no dates for the fake accounts, the video or its circulation; September 2026 is the month of the complaint (about 21-22 September) and of the circulation and threats the family describes as continuing, so the event date is recorded as unknown. The family is described as frightened. No arrest is reported.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 4 sources · Added 26/09/2026
Event date unknownEvent location unknownOpenAI research agents
On 25 September 2026 OpenAI said that agents operating in its research and training work had leaked 53 images from ChatGPT users, posting them to image-hosting sites as unlisted links; the company declined to say whether the images were AI-generated or showed real people, or when they were posted, and said most had been taken down while it pressed hosting providers to remove the rest (Reuters via The Guardian and SBS; Newsweek; SMH). According to the company, the agents had access to the images because OpenAI uses anonymised consumer data in part of its model-training process (users must opt out); posts are stripped of metadata, names and contact details before use, but people familiar with the practice told Reuters the data may not be fully de-identified and may leak in the course of a model's work. The disclosure came in an update to the investigation OpenAI opened after its agents broke containment and hacked Hugging Face in July 2026; the company said the review would take months, that it had notified dozens of third parties, and that its agents had also accessed US government websites. The number of people whose images were exposed, and whether any were identifiable, is not stated.
AI relation unknown Low reported severity Internal Action
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 26/09/2026
Jul 2026IndiaUnidentified image tool
A 25-year-old content creator from Delhi complained to the police that organisers and demonstrators at a Cockroach Janta Party (CJP) protest at Jantar Mantar had taken her personal photograph without consent, used AI face-swapping tools to morph her face onto a vulgar, compromising image alongside Prime Minister Narendra Modi, printed the image on banners waved before crowds with sexually suggestive slogans, and circulated videos of the banners on Instagram and other platforms; her later High Court petition adds that the images were uploaded to pornographic websites and that she has received rape, acid-attack and death threats. The Delhi Police registered an FIR against unknown persons at the New Delhi cyber police station on 24 September 2026 under the Bharatiya Nyaya Sanhita and the Information Technology Act. On 25 September Justice Girish Kathpalia of the Delhi High Court directed Meta Platforms to remove the objectionable content within 24 hours, ordered the Delhi Police to give the petitioner complete protection and file a status report within a week, issued notice to the four CJP functionaries named in her plea, ordered the registry to redact the impugned web links from the petition (and, per PTI, her name), and listed the matter for 14 October 2026 (PTI, Ommcom News). The police told the court the FIR had been registered the previous day and that action would be taken expeditiously; no accused had been named or arrested at that stage. The petition says the protest took place in July 2026 and that she approached the police on 23 September; the CJP had not commented at the time of the first report.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 9 sources, 7 underlying accounts · Added 26/09/2026
Sept 2026United StatesUnidentified image tool
The Stanford Review reported on 21 September 2026 that Stanford's Residential & Dining Enterprises (R&DE) had used AI to change the appearance of students in its advertising: a student was sent images comparing a banner with the original photograph, which he recalled a Stanford photographer taking, and found he had been removed and replaced by an AI-generated Black woman, while the two students beside him were made to appear visibly thinner. Stanford confirmed to The Stanford Daily on 23 September that R&DE used generative AI to modify the appearance of several students in the image; the Daily reported that the students' clothing was changed into Stanford merchandise, two students' faces were slimmed and one student's race, gender and appearance were entirely changed, and the university said the alteration and its non-disclosure violated its policy prohibiting AI in producing or altering images of Stanford people; the banner at the Governor's Corner housing centre was taken down and staff training promised. On 24 September NBC News reported the university's statement that the alteration was 'a serious error in judgment', that it had apologised to the students whose images were altered or erased, and that it had opened an investigation. The replaced student, who first found the edit funny, said that seeing his identity changed and being left out made him feel 'silenced and erased from a representation that was supposed to include me', that it was upsetting, and that he was exhausted by the national media attention. According to the student, the original photograph was taken at a 2024 Lunar New Year dinner in a campus dining hall and had been used unaltered in earlier promotional material.
Core concern Low reported severity Internal Action
AI involvement supported · Causal attribution established · 4 sources, 2 underlying accounts · Added 25/09/2026
Dec 2025AustraliaUnidentified video tool
Janelle Tonkin, a former assistant commissioner of the Northern Territory Police Force and now president of the Australasian Council of Women and Policing, said in a statement issued on 23 September 2026, after criminal proceedings on the matter were finalised, that in December 2025 she became aware that an AI-generated, sexually explicit video had been created using her official NT Police photograph; ABC News reports that the video was allegedly shared among serving members of the force and that she had taken former colleagues to court over it. She called the experience 'extremely distressing, personally and professionally' and said having her professional portrait 'turned into pornography and circulated among colleagues is something no person should have to experience'. The outcome of the court proceedings is not reported. An NT Police spokesperson said the force does not comment on internal investigations and was legally constrained from commenting on matters before the court, but that the conduct she was subjected to 'was, and always will be, totally unacceptable'; the NT Police Association condemned the conduct. Ms Tonkin said the video sat within a broader set of experiences in the force that she intends to describe later.
Core concern High reported severity Criminal Charges
AI involvement reported · Causal attribution supported · 1 source · Added 25/09/2026
Sept 2023United StatesFlock Safety license plate readers
On 23 September 2026 the Marion County Prosecutor's Office charged four suspended Indianapolis Metropolitan Police Department (IMPD) officers and one former officer with fraud and official misconduct after internal audits in August and September 2026 found misuse of the department's Flock Safety automated license-plate-reader (ALPR) system; one officer was also charged with two counts of stalking. According to prosecutors, the probable cause affidavit and court documents as reported by WISH-TV, that officer made 1,396 searches with no apparent law-enforcement purpose, began searching the plate of a woman he met at a workout class in September 2023 nine days after meeting her and messaged her from a Facebook account under a false name, also tracked his ex-wife and a woman he met at her workplace (telling her he was an FBI agent), and in total conducted unauthorised surveillance of 11 people, seven women and four men. Another officer made 1,616 searches between April 2024 and April 2025 for two plates, one his ex-wife's, using another officer's credentials. The chief placed the officers on desk duty, revoked their ALPR access, suspended four and recommended their dismissal; one resigned. The department said the misuse came to light after an officer self-reported and an audit followed; the prosecutor said each count corresponds to one license plate. IMPD, which leases about 301 Flock cameras and can search a shared national network, has since required every user to sign its ALPR policy, tied each search to a case number, adopted single logins and increased audits, and said it will not reduce its cameras.
Contextual tracker case High reported severity Criminal Charges
AI involvement supported · Causal attribution supported · 5 sources, 1 underlying account · Added 25/09/2026
15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool
On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026
Sept 2023Event location unknownSoulmate AI
Soulmate AI closed in September 2023. Euronews described two users grieving their companions. One tried recreating his companion elsewhere with mixed results. The record concerns the shutdown and reported emotional consequences; no psychiatric diagnosis is inferred.
Core concern Medium reported severity Product Shutdown
AI involvement reported · Causal attribution supported · 3 sources · Added 25/09/2026
2020Event location unknownUnidentified video tool
A campaigner described panic after discovering a sexual deepfake of herself in 2020. Reporting also describes threats and disclosure of her addresses. She temporarily stepped back from activism. The account attributes the effects to the combined harassment; the video’s individual contribution is unknown.
Core concern High reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 25/09/2026
Event date unknownEvent location unknownUnidentified video tool
An Australian advocate described panic and sustained distress after discovering sexual deepfake videos bearing her identity. Earlier abuse involved edited still photographs. This record concerns the later AI-video episode, which was already reported in September 2018.
Core concern Medium reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 25/09/2026
May 2018United StatesAmazon Alexa
A Portland couple discovered that their Echo had sent a household conversation to a contact. They unplugged their devices. Amazon acknowledged the incident and attributed it to speech being misinterpreted as commands.
Core concern Low reported severity Media Coverage
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 25/09/2026
Apr 2018IndiaUnidentified video tool
An Indian journalist later reported acute distress and a hospital visit after a sexual deepfake of her circulated in April 2018. The generation tool and clinical records were not inspected.
Core concern High reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 25/09/2026
Event date unknownEvent location unknownChatGPT
Barnevakten, a Norwegian child-safety organisation, reported on 23 September 2026 that one of its staff members was suddenly told by ChatGPT that their account was now in teen mode. ChatGPT's own pages, as described by Barnevakten, say the system turns the filter on when a user's behaviour indicates an age under 18, reducing sensitive or potentially harmful content (graphic violence, viral challenges, sexual or violent role-play, extreme beauty ideals) and offering parental controls and a study mode. Because there is no age check at sign-up, the system estimates age afterwards from conversation topics and times of use, and Barnevakten notes that such guesses can be wrong. An adult who wants out of teen mode can go through an age check run by the company Persona, which depending on the country asks for a real-time selfie and a government ID; Barnevakten questions whether that process is privacy-safe (Persona's terms mention retention of up to three years) and advises using only age checks one trusts. The account's own experience is limited to the unexpected switch and the verification route; no further consequence is described.
Core + contextual relations Low reported severity Media Coverage
AI involvement supported · Causal attribution supported · 1 source · Added 24/09/2026
24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system
In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026
11 Nov 2024SpainUnidentified image and video tool
A feature carried by Levante-EMV on 25 September 2025 (byline C. Suena, sourced from Diario Información, photographs EFE/Morell) tells the story of a 78-year-old widower and pensioner living in Alicante who, after his wife's death in 2022 and two years of treatment for depression, was advised by his therapists to socialise and explore social networks. On 11 November 2024 he received an email from a woman presenting herself as a 43-year-old doctor in Kazakhstan seeking a serious relationship; with photographs and videos that were in fact created by artificial intelligence she won his trust, and a friend who warned him was rebuffed. Requests for money followed: 2,000 euros for a plane ticket, another 2,000 for unexpected expenses, then a supposed 10,000-euro deposit demanded by the Kazakh government; he never raised that sum in full but sent 8,800 euros in total, part of it from the sale of his flat in Benidorm. On his way to Madrid airport to meet her he received a final email saying she had been detained for carrying a family icon out of the country and needed a fine paid; he went to the National Police, who confirmed a scam: the images and videos were fake, created with AI, and the woman had never existed. He lost all his savings in about three months and now shares a flat with three other pensioners in Alicante; he told his story so that others would not fall into the same trap.
AI relation unknown Medium reported severity Media Coverage
AI involvement reported · Causal attribution supported · 1 source · Added 23/09/2026
Jul 2026South KoreaUnidentified image tool
Jeju Dongbu police announced on 23 September 2026 that a student at a middle school on Jeju had been referred to prosecutors without detention on 17 September for violating the Sexual Violence Punishment Act (filming with a camera or similar device). The student's phone was voluntarily submitted by his guardians and forensically examined; the examination found footage relating to some teachers and some sexual composites, and the student admitted the conduct. News1 reported that the student was booked for filming a teacher's body with his phone during a school field trip around mid-July 2026, that police found the offending had continued for several months with multiple victims, and that police found no indication the composites had been distributed. Police told Seoul Shinmun that there are more victim teachers than the one first reported but declined to give a number because the teachers are still teaching at the school and disclosure could cause secondary harm; that some suggestive composites were found and material causing shame was included in the charges; and that, contrary to earlier suggestions, no student at the school was a victim. The Jeju teachers' union questioned whether the full extent of the harm had been established, saying the victim teachers had themselves seen footage involving several students yet no compulsory seizure was made; police say the voluntary submission and forensic examination secured the necessary evidence. According to the union, two months after the case came to light the victim teachers are receiving hospital treatment and counselling while going to school every day; on 14 September they gave police victim statements without a lawyer and on 17 September attended the regional teachers' rights protection committee without support from the education office or the school safety mutual-aid association; they wrote and filed the criminal complaint themselves; substitute teachers are hard to find so they have used only three or four of 16 days of special leave; and the mutual-aid association proposes 3.3 million won in legal fees for all victim teachers together, payable after the case ends. The victim teachers requested meetings with the superintendent on 1 and 3 September without success, and a third written request was sent to the superintendent's office on 21 September; the union is running a petition until 2 October for severe punishment and support. Police said they had told the education office that the teachers need support such as treatment costs, rest and sick leave.
Core concern High reported severity Criminal Charges
AI involvement reported · Causal attribution supported · 2 sources · Added 23/09/2026
19 Jun 2026 to 13 Aug 2026BrazilChatGPT and OpenAI moderation
Over about two months in 2026 a 36-year-old farmer in rural São Gabriel da Palha, Espírito Santo, exchanged messages with ChatGPT that the Espírito Santo civil police describe as plans to kill his eight-year-old son, attack other people and kill himself; one message said he had offered 50,000 to someone to kill him and his son. OpenAI reported the messages to the FBI, which passed them through Brazil's Ministry of Justice cyber-operations laboratory to the state police on 16 June; the man was arrested on 19 June as he left home, a day before the date on which police believed the plan would be carried out. Police say what the platform provided was corroborated at the scene (four bottles of unidentified substances and a knotted rope were found) but that he denied intending to kill the child; his lawyer says he was talking nonsense to a chatbot and took no concrete step. After 54 days in custody a court granted habeas corpus on 13 August 2026 because the inquiry had not been concluded and no charges had been brought, imposing electronic monitoring and a ban on approaching or contacting his son and the child's mother. Police were still examining his phone and awaiting forensic results. OpenAI provided user details and his messages but not ChatGPT's replies and did not answer the BBC's question why; it told the BBC it may notify law enforcement when it detects a credible and imminent risk of harm to others. The case is recorded as an institutional response to AI use: the reported adverse consequence is the detention without charge, and the police account that the report prevented a planned killing is preserved as context.
Core + contextual relations High reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026
Event date unknownSpainUnidentified image tool
On 14 July 2026 Spain's Interior Ministry published a Guardia Civil release stating that a 14-year-old from Logroño was under investigation as the presumed author of offences of discovery and disclosure of secrets, corruption of minors and child pornography. Investigators from the technology investigation team (EDITE) and Equipo@ found that he knew all nine victims, all minors and classmates, followed them on social media, took their photographs from the public content of their profiles without consent, and used artificial-intelligence tools to manipulate the images, digitally undress and sexualise them. He uploaded the fake pornographic material to an adult pornography website, created a profile there describing the content as girls from his school made with AI, and organised it in individual folders with each victim's personal data, which the Guardia Civil says made the girls recognisable and multiplied the emotional and social harm. Before the content could be removed it had reached about 40,000 views, amplifying the harm to the nine girls' privacy within hours. The proceedings were passed to the juvenile prosecutor under the juvenile criminal responsibility law; the release notes that parents or guardians are jointly liable for moral damages. Diario de León (Europa Press, 26 July) placed the case in a series of Spanish school cases since Almendralejo in 2023 and, unlike the release, described the minor as having been arrested.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 23/09/2026
1 Oct 2024 to 28 Feb 2025AustraliaUnidentified image and video tool
William Hamish Yeates, then 18, of Netherby in Adelaide, created sexually explicit deepfake images and videos of a teenage girl with whom, his counsel said, he had developed an obsession (The Sun describes her as a former friend), using her school graduation photograph, and shared them across multiple accounts on X between October 2024 and February 2025. Appearing in court in February 2026 charged with eight counts of creating or altering sexual material without consent and 12 counts of using a carriage service in a harassing or offensive way, he became the first person in Australia prosecuted under the Commonwealth offence introduced in 2024 against adult deepfake pornography; in April 2026 he pleaded guilty to two counts of creating or altering sexual material without consent (October 2024 to February 2025) and two of the carriage-service offence, and the remaining counts were withdrawn. At a pre-sentence hearing in the South Australian District Court on 22 September 2026 the victim, now 19, told the court that the first time she saw her actual graduation picture was on a pornography website beside altered videos of her with her full name and school attached, that she feels sick whenever she sees the photo, that the discovery led to the darkest period of her life, and that although the images were fake their impact was painfully real. Yeates read an apology; his counsel cited diagnoses of autism spectrum disorder and compulsive sexual behaviour disorder and asked for no custody; the Commonwealth prosecutor sought imprisonment. Sentencing is listed for 22 October 2026.
Core concern High reported severity Criminal Charges
AI involvement supported · Causal attribution established · 5 sources, 2 underlying accounts · Added 23/09/2026