Apr 2024CanadaMeta AI
A Winnipeg man told CBC that in spring 2024, after a problem moving his Facebook account to a new phone, his wife found what looked like a Facebook customer support number online, and before calling it he asked the Meta AI search tool in Facebook Messenger whether it was legitimate. According to his account and a screenshot he gave CBC, Meta AI answered that the number was "indeed a legitimate Facebook support number". Facebook has no phone support line. When he called, the person on the line obtained his account details, opened his Facebook account and had him install an app giving access to his phone; during the call someone used his PayPal account to buy a $500 Apple gift card and tried to buy bitcoin, which his bank refused. He cancelled cards, locked bank accounts, filed fraud and police reports, and PayPal reversed the $500 charge. Meta told CBC that Meta AI can sometimes produce inaccurate information and that its own searches gave different results. Winnipeg police said they had an active investigation.
Core concern Low reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 02/11/2026
Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
Event date unknownChinaUnidentified video tool
Police in Nanchong, Sichuan, said on 29 October 2026 that their investigation found a man had secretly filmed or stolen image material of several female colleagues, commissioned other people to make AI face-swap obscene videos from it, and spread the videos for profit through social platforms in and outside China and a QQ group he ran, charging entry fees and selling goods. According to the police, a female colleague or colleagues (the account does not say how many) discovered what had happened and called the police; he was traced, caught and placed in administrative detention, and the case remains under investigation. The police did not say how they established that the videos were AI-made, how many colleagues were depicted or when the conduct took place.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 31/10/2026
16 Sept 2026UkraineUnidentified image tool
A district court in Ukraine's Poltava region fined the mother of a school pupil on 22 October 2026 after finding she had failed in her duty to bring up her son, who, according to the case materials as reported, used a neural network on 16 September 2026 to generate fake nude photos of his teacher from her image without her consent and sent one to a classmate. The mother admitted the offence and confirmed her son had made such images, saying he sent only one to a classmate and that she did not know how the photos spread further. The court imposed an administrative fine of 850 hryvnias plus court fees. The report does not name the AI tool, and no statement from the teacher is reported.
Core concern Medium reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 1 source · Added 30/10/2026
2019BelgiumGoogle Assistant
On 10 July 2019 the Belgian public broadcaster VRT NWS reported that it had listened to more than a thousand audio excerpts recorded by Google Home smart speakers and the Google Assistant phone app, passed to it by someone working for a Google subcontractor that transcribes Dutch-language recordings to improve Google's speech recognition. VRT said 153 of the excerpts were conversations in which "Okay Google" was clearly not said, and that it could hear addresses and other sensitive information, which let it find and visit people in Flanders who recognised their own or relatives' voices. Google said one of its language reviewers had leaked confidential Dutch audio data, and explained that its devices rarely have "false accepts", when background noise or words are interpreted as the hotword. Google suspended human review of Assistant audio in Europe, and the Hamburg data protection authority began an urgency procedure under Article 66 of the GDPR to stop the reviews for three months, according to TechCrunch.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources · Added 28/10/2026
14 Oct 2026BrazilUnidentified image tool
A 12-year-old girl in Vitória da Conquista, in the south-west of Bahia, Brazil, was threatened from 14 October 2026 by a 15-year-old who said he had intimate images of her and demanded money not to post them on social media. Frightened, she secretly took R$8,300 from money her father kept and handed it over; the suspect then demanded a further R$10,000. According to the Bahia Civil Police, its investigation found that the image used in the threats had been produced with artificial intelligence to simulate intimate content of the girl. On 23 October police identified the 15-year-old and three other adolescents aged 14 to 16 as suspects, recovered R$6,300 and an electric bicycle bought with part of the money, and returned the money to her father. The police opened a juvenile offence procedure and sent it to the Childhood and Youth Court. How police established that the image was AI-made is not disclosed.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 28/10/2026
15 Nov 2022 to 27 May 2023Event location unknownUnidentified video tool
On 26 September 2025 the Federal Court of Australia ordered a man to pay civil penalties of A$343,500 plus costs, in what the eSafety Commissioner said was the first proceeding to impose a civil penalty under the Online Safety Act 2021. On facts he admitted, he posted 12 non-consensual deepfake intimate images of six women ordinarily resident in Australia to a deepfake website between November 2022 and May 2023. He made each one by uploading a photo of the woman found online to a webpage that created semi-naked or naked images and saving the generated image. He refused eSafety's removal notice, so two images stayed online for almost a year, and he admitted posting some later images in retaliation against people involved in issuing the notice. Each woman complained to eSafety, and the court found the posts were likely to have caused them hurt and distress. The eSafety Commissioner called this kind of deepfake abuse a misuse of easily accessible AI tools.
Core concern High reported severity Regulatory Action
AI involvement supported · Causal attribution established · 5 sources · Added 23/10/2026
Event date unknownIsraelUnidentified image tool
Israel Police said in February 2025 that three boys aged 13 to 15 from Jerusalem were suspected of taking photos of girls from social media, editing them with artificial intelligence software into nude images and distributing them without consent. According to Ynet, at least 30 girls were harmed; police said investigators identified dozens of victims and that a search of the suspects' homes found edited nude images of several girls. The head of the Jerusalem district youth investigations unit described dozens of cases of girls' privacy being violated through nude images edited with AI technology. The three were questioned over publishing a sexual image without consent, and the case was passed to prosecutors to decide on charges.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026
27 Oct 2023BrazilUnidentified image tool
In late October 2023, fake nude images of girls at a private school in Rio de Janeiro circulated in messaging groups and on social media. Families said pupils in years 7 to 9 had used an artificial intelligence tool to put the faces of pupils aged 14 to 16 onto photos of naked bodies. The school sent parents a notice about pupils using AI to make intimate photo montages and said disciplinary measures would follow. The Rio de Janeiro Civil Police child-protection unit (DPCA) opened an inquiry; its head said the pupils were suspected of making fake nudes with AI and that more than 20 victims had been identified, including girls from other schools. A mother said the girls were having anxiety attacks and crying. The inquiry was placed under seal because minors were involved; its outcome is not known.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 4 sources · Added 22/10/2026
Dec 2019 to Jul 2020United StatesUnidentified facial recognition system
In a complaint filed in federal court in Pennsylvania on 19 December 2023, the US Federal Trade Commission alleged that the pharmacy chain Rite Aid used facial recognition in its stores to match customers against a database of people it suspected of shoplifting or other wrongdoing, and that staff acted on the match alerts by following, searching, ejecting and publicly accusing customers and by calling the police. The FTC says many alerts were false positives: employees recorded thousands of false-positive alerts between December 2019 and July 2020, staff stopped and searched an 11-year-old girl on a false match, and employees called the police on a Black woman matched to an image of a white woman with blonde hair. Rite Aid agreed to a proposed order barring it from using facial recognition in retail stores for five years, without admitting or denying the allegations.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026
Sept 2023AustraliaChatGPT
Victoria's Information Commissioner (OVIC) found in a report published on 24 September 2024 that a child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT in or around September 2023 to draft a Protection Application Report submitted to the Children's Court about a young child. On the balance of probabilities, OVIC found the worker entered personal information, including names, about the child, mother, father and carer, disclosing it to OpenAI; the worker admitted using ChatGPT but denied entering personal information. OVIC found generated content in the report described a doll that the father had reportedly used for sexual purposes as a parental strength ('age-appropriate toys'), downplaying the risk to the child, although the court's and the department's decisions did not change. The report was withdrawn and replaced, and the mother, father and carer described anxiety when told of the disclosure. OVIC found serious breaches of two privacy principles and issued a compliance notice requiring DFFH to ban and block generative AI text tools for child protection staff until November 2026; DFFH accepted the breach findings.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026
23 Sept 2024CanadaOtter.ai (reported)
An Ontario hospital reported to the provincial privacy commissioner that on 23 September 2024 the Otter.ai transcription tool, installed on a personal device by a physician who had left the hospital in June 2023 and was still on the meeting invite, joined a virtual hepatology rounds meeting, recorded it without notice and then emailed a summary and transcript access to the invite list. The personal health information of seven patients, including diagnoses and treatment, was captured; 12 of the 65 recipients appeared to have left the hospital. The commissioner's letter of 27 October 2025 recommended that the hospital itself ask Otter.ai to delete the retained patient data.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 21/10/2026
Event date unknownEvent location unknownUnidentified image tool
The Westpfalz police headquarters reported on 3 June 2026, in a release datelined Kaiserslautern, that a woman had been extorted with an AI-generated nude photo. According to the police's current findings, a man edited a picture of her with artificial intelligence; through a messaging service he demanded a mid four-figure sum and threatened to publish the photo. She went to the police on Tuesday 2 June and an investigation was opened.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 20/10/2026
Event date unknownNetherlandsUnidentified image tool
Dutch police said on 4 September 2025 that they had arrested a man in a Gelderland municipality the day before on suspicion of making sexually explicit deepfakes, which they call deepnudes, and spreading them through channels such as WhatsApp groups, and of sending women unsolicited photos of his genitals and sexual messages. According to the police, 130 victims from across the country reported to them over recent years and were regularly and repeatedly harassed; NOS reports, citing the police, that images were manipulated for some of them, that the exact number is unclear, and that the police suspect the conduct began in 2021 or 2022. The police seized digital data carriers and said the Public Prosecution Service would decide on the consequences. No tool is named.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 19/10/2026
Jun 2025PolandUnidentified image tool
In June 2025, according to OKO.press, a group of pupils at a primary school in central Poland took a classmate's photo from the internet, used an application that offers to "undress" people in uploaded photos to generate a nude image bearing her face, posted it on the school's Instagram profile and urged others to order more such images. Poland's Personal Data Protection Office (UODO) says the girl was under 15 and notified the police, but the police declined to open proceedings and the prosecutor's office upheld that decision, finding no prohibited act; Gazeta Prawna reports that they considered the AI-generated material not pornographic and the pupil unharmed. The UODO president appealed to the Prosecutor General, in January 2026 the authority announced that prosecutors had informed it they were taking up the case again, and in June 2026 it said its president had recently asked once more for the investigation to be resumed. The application is not named.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 19/10/2026
8 Nov 2024ItalyUnidentified video tool
The satirical television programme Striscia la Notizia, published by R.T.I., aired segments in which the image and voice of the journalist Enrico Mentana, director of La7's news bulletin, were, according to the Garante, manipulated with AI systems so that he appeared in his own studio making statements he never made (its decision describes real footage from his studio altered by AI dubbing); a November 2024 preview describes one such segment. After Mentana complained, Italy's data protection authority (Garante) found on 23 July 2026 that the realism of the images, the low perceptibility of the alteration and the plausibility of the statements could lead the public to think the content authentic, and that the disclaimers were not clear enough. It found breaches of GDPR Articles 5 and 25, issued a warning to R.T.I. and prohibited further processing of his data in that way. The Garante noted the numerous mocking or offensive messages he received on social media. R.T.I. argued that the segments were satire, that it only dubbed licensed footage with a computer-generated voice, and that its disclaimers made the deepfake evident. No fine was imposed.
Core concern Low reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 17/10/2026
Jul 2026Event location unknownUnidentified image tool
A 23-year-old woman told the news site Kaktus.media that in July 2026 she learned that acquaintances had received a nude image of her made with AI from her photograph, and that the sender was a classmate. She says he first told her an app had generated and sent the image by itself, then admitted that he had undressed her Instagram photo through AI himself. In a written statement to the outlet the accused says he used a Telegram bot offering AI photo processing in May or June 2022 and was shocked by the result, and that the images were sent from his Telegram account on the night of 11 to 12 July 2026 by people who had hacked it. The woman says she suffered severe psychological stress and harm to her reputation. She filed a complaint with a district police department on 21 July; after she complained to the prosecutor's office the matter moved to another district department. That department told Kaktus.media that, because the review period expired before expert results arrived, it had refused to open a criminal case and had ordered a new examination. Her lawyer says four motions filed on 5 August have gone unanswered.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 1 source · Added 17/10/2026
May 2025Event location unknownUnidentified video tool
In June 2025 the Stockholm police region warned that since the end of May it had received several complaints from people defrauded through social media adverts with AI-generated videos depicting doctors, who appeared to give advice and recommend medicines or vitamins. According to the police, viewers who followed the adverts to fraudulent websites were induced to enter card details, after which a considerably larger sum was charged and the details were stolen. Dagens Nyheter reported that the doctors used included the former state epidemiologist Anders Tegnell and the professor Agnes Wold, who told the paper of being furious. In July 2025 the Public Health Agency of Sweden said fake Facebook films imitating its former state epidemiologist were advertising products for diabetes or asthma, that it had reported them to the police and had asked Meta to remove them; he said it was sad that fraudsters were exploiting vulnerable people. Dagens Nyheter, as relayed by Omni, reported that the investigations were closed because the offences were judged to have been committed abroad. The number of defrauded people and their losses are not stated, and the police do not say how the AI generation was established.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 16/10/2026
Sept 2026PakistanClaude (reported)
A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.
Core + contextual relations Medium reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026
27 Sept 2026 to 29 Sept 2026IndiaUnidentified video tool
Deccan Herald reports, citing Bengaluru police, that a 23-year-old man lost Rs 1.85 lakh in an alleged sextortion scam. He matched with a woman on a dating app on 27 September 2026 and exchanged numbers; he told police that he then received a WhatsApp video call from her number lasting five to six seconds. Police said he then received an obscene video manipulated using AI and the sender threatened to circulate it unless he paid. Fearing exposure, he borrowed money from a friend and transferred Rs 1.85 lakh to several UPI IDs between 27 and 29 September as the threats continued, a police officer said. Police registered a first information report on his online cybercrime complaint and are trying to trace the suspects. The report does not say how police established that the video was AI-manipulated, and the tool is not named.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 12/10/2026