Apr 2024CanadaMeta AI
A Winnipeg man told CBC that in spring 2024, after a problem moving his Facebook account to a new phone, his wife found what looked like a Facebook customer support number online, and before calling it he asked the Meta AI search tool in Facebook Messenger whether it was legitimate. According to his account and a screenshot he gave CBC, Meta AI answered that the number was "indeed a legitimate Facebook support number". Facebook has no phone support line. When he called, the person on the line obtained his account details, opened his Facebook account and had him install an app giving access to his phone; during the call someone used his PayPal account to buy a $500 Apple gift card and tried to buy bitcoin, which his bank refused. He cancelled cards, locked bank accounts, filed fraud and police reports, and PayPal reversed the $500 charge. Meta told CBC that Meta AI can sometimes produce inaccurate information and that its own searches gave different results. Winnipeg police said they had an active investigation.
Core concern Low reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 02/11/2026
Nov 2025 to May 2026ItalyUnidentified voice-cloning tool
The Carabinieri of the Compagnia Roma Centro announced on 3 June 2026 that they had reported 44 people to the judicial authorities as the alleged perpetrators of 39 completed or attempted phone frauds committed between November 2025 and May 2026. According to the Carabinieri account relayed by RomaToday, Fanpage, RaiNews and Il Messaggero, the fraudsters posed as bank staff or police, faked the caller number shown on the victim's phone (spoofing) and used artificial-intelligence software to clone the voices of the victims' relatives, then invented threats to savings or road accidents involving children or grandchildren so that victims made urgent bank transfers or topped up payment cards held by accomplices. The victims were mostly older residents of Rome. The Carabinieri recovered money, gold and jewellery estimated at over 900,000 euros. The outlets do not describe an individual victim, do not say how many of the 39 cases involved a cloned voice, and do not say how the investigators established that the voices were AI-generated.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 02/11/2026
Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
Nov 2025AustraliaUnidentified video tool
In early November 2025 a pop-up advertisement on YouTube used the likeness and voice of Western Australia's Premier, Roger Cook, to promote an investment it claimed the government endorsed, requiring a $400 contribution. Consumer Protection WA, told of the advert by a member of the public on Friday 7 November, warned that it was a deepfake investment scam created using artificial intelligence, said it was investigating and asked the domain host to remove the scam website. Its commissioner told ABC News that, watched slowly, the lips do not move in time with the words and the hands look unusual. The Premier said on 8 November that he was very distressed to see his image used in this way and called the scam very scary and disgusting. No person who paid money after seeing the advert is described.
Core concern Low reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 02/11/2026
Mar 2024United Kingdom, NigeriaUnidentified AI tool
A dietitian on the UK register who was in Nigeria at the time was interviewed online in March 2024 for an entry-level oncology dietitian post at an NHS hospital in Surrey, according to reports of a Health and Care Professions Tribunal Service decision. The reports say the interviewers noticed that she repeatedly asked for clinical questions to be repeated and then gave fluent, textbook answers while her eyes moved as if reading from another screen, and that all of them came to the view she was using artificial intelligence; a case study she then completed was also judged AI-assisted, and her answers were later run through an AI check with striking similarities. She denied using AI, saying she habitually repeated questions and was looking at her router. The tribunal panel found that she used AI in the interview, that this was cheating and dishonesty, and ordered that she be struck off the register, with an interim suspension of 18 months during which she may appeal. Nigerian outlets, citing the Daily Mail, said the tool was ChatGPT; the local report describes it only as AI. The decision date and any appeal are not stated in the sources read.
Core concern Medium reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 01/11/2026
Oct 2026IndiaUnidentified image and video tool
Police in Jaipur, Rajasthan, say a software engineer who went missing on 26 October 2026 staged his own kidnapping and sent relatives fabricated photos and videos, which police and the man's own account describe as AI-generated, showing him held captive, in pain and admitted to a hospital. Bhaskar English reports that he demanded a ransom of 7 lakh rupees from the family. His brother-in-law filed a kidnapping complaint, police searched several cities using CCTV footage, and on 30 October officers found him in Rishikesh. Police say he confessed and had borrowed money from friends that he could not repay. The Hindi daily Amar Ujala, which describes him as an IT student, reports that the family panicked at the messages before informing police, and that officers brought him back to Jaipur and handed him over to his family. No payment by the family and no charge are reported.
Core concern Low reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 01/11/2026
Oct 2025United KingdomUnidentified video tool (suspected)
In October 2025 a video spread on Facebook and X that appeared to show George Freeman, the Conservative MP for Mid Norfolk and a former science minister, announcing that he was leaving the Conservatives to join Reform UK. Full Fact said on 20 October that the clip was very likely made using artificial intelligence: it matched his outfit and the Westminster background to a video he posted in April 2020, described the audio as stiff and unnaturally even, and said AI appeared to have been used to lip-sync the false words, while noting that an impersonator could not be ruled out. Freeman called the video an AI-generated deepfake made without his knowledge or consent and reported it to police. Norfolk Police said it was contacted on 16 October by the office of an MP about the video and opened an investigation into a potential false-communications offence. Freeman later told the Observer that friends and colleagues had sent him messages accusing him of betrayal, that Meta told him the video did not breach its guidelines, and that he found no law against the use of his identity; LBC reported in March 2026 that police told him it was not illegal. An anonymous creator told a local newspaper the video was made to show that people cannot tell fact from fiction.
Core concern Low reported severity Investigation Opened
AI involvement suspected · Causal attribution supported · 6 sources · Added 31/10/2026
Event date unknownChinaUnidentified video tool
Police in Nanchong, Sichuan, said on 29 October 2026 that their investigation found a man had secretly filmed or stolen image material of several female colleagues, commissioned other people to make AI face-swap obscene videos from it, and spread the videos for profit through social platforms in and outside China and a QQ group he ran, charging entry fees and selling goods. According to the police, a female colleague or colleagues (the account does not say how many) discovered what had happened and called the police; he was traced, caught and placed in administrative detention, and the case remains under investigation. The police did not say how they established that the videos were AI-made, how many colleagues were depicted or when the conduct took place.
Core concern High reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 31/10/2026
16 Sept 2026UkraineUnidentified image tool
A district court in Ukraine's Poltava region fined the mother of a school pupil on 22 October 2026 after finding she had failed in her duty to bring up her son, who, according to the case materials as reported, used a neural network on 16 September 2026 to generate fake nude photos of his teacher from her image without her consent and sent one to a classmate. The mother admitted the offence and confirmed her son had made such images, saying he sent only one to a classmate and that she did not know how the photos spread further. The court imposed an administrative fine of 850 hryvnias plus court fees. The report does not name the AI tool, and no statement from the teacher is reported.
Core concern Medium reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 1 source · Added 30/10/2026
May 2026NorwayUnidentified AI writing tool
In an article in May 2026 about new EU rules on single-use plastics, the Norwegian news site Nettavisen attributed to the former leader of the environmental organisation Framtiden i våre hender a statement about plastic ketchup sachets that, according to the complaint, she never made. After the organisation reacted, the journalist confirmed that the quote was an 'AI mishmash', Journalisten reports. Nettavisen removed the quote the same day it was alerted, but the fabricated quote was also published in several other Amedia newspapers after Nettavisen had corrected it. The organisation complained to the Norwegian Press Complaints Commission (Pressens Faglige Utvalg, PFU), saying Nettavisen had published an AI-generated quote without source checks, fabricating a statement and wrongly attributing it to a named person, and that the correction and apology came too late. Nettavisen acknowledged a breach of the source-control rule and apologised, but rejected the other alleged breaches. On 28 October 2026 the PFU found that publishing the fabricated quote was a clear breach of good press practice (point 3.2 of the Code of Ethics) and that the quick correction did not make up for it; it did not hold Nettavisen responsible for other newspapers' failure to correct.
Contextual tracker case Low reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 30/10/2026
12 Oct 2026BrazilUnidentified AI tool
A labour court in Castro, Paraná (9th Region Labour Court), annulled a court-appointed expert's report after the employer, in a motion for clarification, reported a hidden sentence at the foot of a page instructing artificial intelligence to contest the report only superficially and not to question the files it cited, according to Diário de Justiça. The expert confirmed the text but said it came from teaching material about AI and was inserted by accident; the court's IT section concluded that it had been formatted deliberately to be invisible. The judge said AI had not been used to write the judgment and that the text did not directly influence it, but annulled the report, later submissions and the judgment, ordered a new examination by another expert without AI tools, fined the expert 5% of the value of the case for bad-faith litigation, cancelled the expert's fees and removed the expert from the court's register. The decision, dated 12 October 2026, can be challenged.
AI relation unknown Medium reported severity Regulatory Action
AI involvement reported · Causal attribution disputed · 1 source · Added 30/10/2026
Event date unknownLebanonUnidentified video tool
In a statement published on 28 October 2026, Lebanon's Internal Security Forces (ISF) said their Cybercrime and Intellectual Property Bureau had received a complaint, filed with the competent judiciary, against Facebook and TikTok pages that promoted various medicines and preparations using videos generated by artificial intelligence, in which the complainant appeared in a way that falsely suggested the complainant was promoting the products. The products were said to treat stomach and joint pain, prostate and heart problems, blood sugar and blood pressure, and included sexual enhancers and slimming preparations. A patrol caught two people in the act of handing dozens of orders to a delivery company, with 13,602 US dollars they said came from daily sales; raids in Beirut and other areas led to further arrests and the seizure of thousands of containers. The ISF said some mixtures did not match the ingredients on the labels, that paper records of thousands of orders indicated a large number of buyers, and that the Ministry of Public Health was testing the seized products. The ISF did not say how it established that the videos were AI-generated, and the complainant is not named.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 29/10/2026
Event date unknownTaiwanUnidentified video tool
Taiwanese police said in June 2025 that a fraud call centre in Shalu district, Taichung, had targeted overseas Chinese women in the United States and Canada with romance-investment fraud. According to the police account reported by SETN and carried by Yahoo News Taiwan on 4 June 2025, the call centre created a range of male personas, cultivated relationships with the women, and video-chatted with them through an 'AI face replacement tool' that swapped the operator's face for a persona's; because the picture was very realistic, police say, many victims believed it, after which they were talked into investing in fake energy products and sending money to accounts the suspects supplied. Police say analysis of seized phones identified seven women in the US and Canada who were defrauded, with losses of about NT$3.5 million so far, and that the number of victims and the amount were still being compiled. A photo caption in the report says officers demonstrated the face-replacement tool. The call centre was raided in November 2024, and nine suspects were referred to Taichung prosecutors, seven of them detained; no indictment or verdict has been found.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 1 source · Added 29/10/2026
13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool
The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026
2026FinlandUnidentified AI tool
Humppila, a municipality of about 2,000 residents in Kanta-Häme, Finland, abolished its administrative director and technical director posts on the new mayor's proposal, which, according to Helsingin Sanomat as relayed by Maaseudun Tulevaisuus, covered 150,000 euros of the municipality's savings need; Yle reports that the two office holders were dismissed in spring 2026 and that the abolitions followed the municipality's need to improve its weak finances. Maaseudun Tulevaisuus, relaying an interview first published by Helsingin Sanomat, reports that according to the mayor both directors' tasks are now done with the help of AI, and quotes the mayor as saying the writing of new appendices to the administrative regulations was done with AI in a day. A municipal statement said the main aim of its reforms was not to increase AI use or shrink the administration but to secure services. The former administrative director told Iltalehti the abolition of the post was unlawful, saying the tasks have not ceased and that AI cannot bear official responsibility or form a ground for dismissal; the mayor says the process was lawful. According to the former director, the abolition was brought into the change negotiations as the only option without the five days' written advance notice the law requires, and the lawyers' union Juristiliitto assessed the negotiations as at least careless and presented the municipality with a claim for full compensation. The former director appealed to the Hämeenlinna Administrative Court in spring 2026 and reports filing a criminal complaint with Häme police on 9 September 2026, which police confirmed receiving without deciding whether to investigate. Finland's Deputy Parliamentary Ombudsman opened an own-initiative inquiry into the use of AI in the municipality's official work, asking what tasks were given to AI and how lawful decision-making and official responsibility are ensured. No tool is named, and no court or Ombudsman finding is reported.
AI relation unknown Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 3 sources · Added 28/10/2026
1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT
In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026
2019BelgiumGoogle Assistant
On 10 July 2019 the Belgian public broadcaster VRT NWS reported that it had listened to more than a thousand audio excerpts recorded by Google Home smart speakers and the Google Assistant phone app, passed to it by someone working for a Google subcontractor that transcribes Dutch-language recordings to improve Google's speech recognition. VRT said 153 of the excerpts were conversations in which "Okay Google" was clearly not said, and that it could hear addresses and other sensitive information, which let it find and visit people in Flanders who recognised their own or relatives' voices. Google said one of its language reviewers had leaked confidential Dutch audio data, and explained that its devices rarely have "false accepts", when background noise or words are interpreted as the hotword. Google suspended human review of Assistant audio in Europe, and the Hamburg data protection authority began an urgency procedure under Article 66 of the GDPR to stop the reviews for three months, according to TechCrunch.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources · Added 28/10/2026
14 Oct 2026BrazilUnidentified image tool
A 12-year-old girl in Vitória da Conquista, in the south-west of Bahia, Brazil, was threatened from 14 October 2026 by a 15-year-old who said he had intimate images of her and demanded money not to post them on social media. Frightened, she secretly took R$8,300 from money her father kept and handed it over; the suspect then demanded a further R$10,000. According to the Bahia Civil Police, its investigation found that the image used in the threats had been produced with artificial intelligence to simulate intimate content of the girl. On 23 October police identified the 15-year-old and three other adolescents aged 14 to 16 as suspects, recovered R$6,300 and an electric bicycle bought with part of the money, and returned the money to her father. The police opened a juvenile offence procedure and sent it to the Childhood and Youth Court. How police established that the image was AI-made is not disclosed.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 28/10/2026
2020NetherlandsProctorio
During the 2020/21 academic year, when exams at VU Amsterdam were held online because of the pandemic, some exams required students to run Proctorio proctoring software, which according to the Netherlands Institute for Human Rights used face-detection algorithms during a pre-exam webcam check to judge whether the student was in view. A master's student says the software had trouble recognising her, that she regularly received 'face not found' or 'room too dark' messages, lost time, shone a bright lamp into her face while taking exams, and experienced stress and a feeling of insecurity; she suspected the failures were linked to her dark skin and complained to the Institute in July 2022. In an interim ruling of 7 December 2022 the Institute found sufficient indications for a presumption of discrimination. In its final ruling of 17 October 2023 it found that the university had proved it had not discriminated against her by using Proctorio: on the exam where her setup took longer than average (31 March 2021), the webcam check failed three times and she passed within eight seconds after the helpdesk advised her to remove her glasses, a known Proctorio problem the Institute treated as unrelated to skin colour; a restart during that exam was very likely caused by an unstable internet connection; and it considered it plausible that she had no need to keep a lamp shining in her face for long periods. It found that the university had discriminated in handling her complaint, which took from 1 October 2021 to 11 May 2022 to be taken up. The university apologised that she had not felt heard.
Contextual tracker case Low reported severity Regulatory Action
AI involvement reported · Causal attribution disputed · 4 sources · Added 28/10/2026
Feb 2026 to Oct 2026ChinaUnidentified video tool
Shanghai police said on 26 October 2026 that officers in Putuo district had detained a man on suspicion of fraud after police were called on 16 October to a dispute between him and people he owed money to; officers brought him and three creditors, whom police describe as his friends, to the station. According to the police account relayed by ThePaper and China News Service, from 2019 he had borrowed from classmates and friends on a series of false pretexts, later saying his father had cancer and then that his father had died, and the borrowing totalled more than 1.7 million yuan, nearly all lost on the stock market. Police said he confessed that every pretext was invented, and that to make the scam more credible he used AI to generate short videos of his father gravely ill in bed and posted them on his WeChat Moments feed; a Hong Kong relay of the police account words this more cautiously, saying the related photos and videos should be AI-generated, and adds that his father knew nothing of it. The tool used, how many people saw the videos and how much was borrowed after they were posted are not reported. The man is in criminal detention while the investigation continues.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 28/10/2026