22 Oct 2026Event location unknownTikTok LIVE age check (reported)
A 28-year-old member of an idol group said that on 22 October 2026 TikTok ended her live stream, which was also promoting her birthday event two days later, because it judged her to be under 18, the minimum age for live streaming. In an emergency video posted the same day she said the stated reason was that people under 18 cannot stream after 10 pm and that she could not continue. Real Sound reports that the AI judged her to be under 18 and the stream was abruptly cut off; on X she wrote 'TikTok LIVE, I won't forgive you (28, female)' and later called herself a 28-year-old idol judged a minor by AI. Fans treated the episode as a joke and it drew wide attention. TikTok's comment and whether her appeal succeeded are not reported.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 1 source · Added 02/11/2026
1 May 2021BrazilUnidentified death-record matching system
A Brazilian federal judge in the 4th federal region ordered the social security institute (INSS) to pay a retiree R$3,917.67 in moral damages after finding that his pension had been stopped by a failure of the institute's artificial intelligence system, according to a Federal Regional Court of the 4th Region (TRF4) news item relayed by the Brazilian Institute of Social Security Law on 30 September 2022. The judge explained that the benefit was suspended automatically on 1 May 2021 by an artificial intelligence command that captured data from the death-records system (Sisobi), and that the data used, the person's name and mother's name, were not enough to prevent the wrongful cessation. The retiree said the pension was his only source of income; he asked for reactivation and sent a handwritten declaration, and although he showed in person that he was alive, the benefit was restored only in January 2022. The judge wrote that the AI 'proved inefficient or unintelligent' in this case and that the INSS made him wait 226 days. Arrears were also ordered paid. Whether the INSS appealed is not reported.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 02/11/2026
Jul 2025IndiaPoshan Tracker face recognition
From 1 July 2025 India's Ministry of Women and Child Development made a facial recognition check in the government's Poshan Tracker app mandatory before pregnant women and nursing mothers receive take-home rations under the Integrated Child Development Services (ICDS) scheme; the app compares the woman's live face with her Aadhaar identity photograph. In July 2025 Decode reported from Delhi that a woman eight months pregnant returned to her Anganwadi centre for a third day trying to get the app to recognise her, and a worker said she gave food to a new mother the app would not recognise and recorded it by hand. In August 2025 the Karnataka Anganwadi workers' union told The South First that the faces of pregnant and nursing mothers change so they no longer match their registration images, and that some mothers leave without their rations. In March 2026 a Decode investigation supported by the Pulitzer Center reported that a mother in Jharkhand was cut off from supplementary nutrition ten weeks after giving birth because the software could not match her face to a photograph taken eight years earlier, that a pregnant woman in Bihar who was anaemic went four months without rations because the system could not match her to an older Aadhaar photograph, that one Bihar centre had removed three pregnant women and five nursing mothers whose faces no longer matched, and that a Jharkhand worker was told to remove at least four children whose eligibility depended on their mothers' failed face matches. Decode also reports failures earlier in the process, when women cannot receive a one-time password on an Aadhaar-linked phone. Government figures cited by Decode show 52.7% of eligible beneficiaries had received rations through facial recognition by 31 December 2025. A researcher who analysed the app for Decode found Google's ML Kit face-detection library in it; Google said ML Kit cannot recognise individuals, and the government has not disclosed who built the matching system. After workers' protests, a February 2026 app update let workers upload other identity documents for pregnant and nursing women, subject to a supervisor's approval. Decode reports the Bihar woman later gave birth to a healthy baby, while her name remained missing from the system.
Contextual tracker case Medium reported severity Internal Action
AI involvement reported · Causal attribution alleged · 4 sources · Added 02/11/2026
Jan 2021United StatesHireVue (reported)
A man who applied for a supply chain job with CVS in Massachusetts around January 2021 says CVS put him through a HireVue video interview with questions about integrity, and alleges that HireVue sent the recording to a platform called Affectiva, which analysed his facial expressions, eye contact, voice intonation and inflection with artificial intelligence and fed a score to CVS. He sued CVS in a proposed class action under the Massachusetts Lie Detector Statute, alleging the interview was a lie detector test and that the online application lacked the notice of rights the law requires. He says he did not know the interview was a lie detector test and would not have taken part had he known. In February 2024 a federal judge in Massachusetts denied CVS's motion to dismiss the notice claim, finding a concrete informational injury; CVS had not challenged the other claims at that stage. A law firm commentary says he was not hired. In July 2024 he reached an individual settlement with CVS, whose terms were not reported. The allegations about the AI analysis were not tested in court.
Contextual tracker case Low reported severity Lawsuit Settled
AI involvement reported · Causal attribution alleged · 3 sources · Added 02/11/2026
2024Event location unknownGemini (reported)
A civil court in Niterói, Rio de Janeiro state, ordered Google Brasil to pay a businessman R$20,000 in moral damages in a sentence dated 12 May 2025. The judge found it undisputed that the company's artificial intelligence had pointed to him in searches as the owner of a gambling platform called 7 Games, with which he had no connection, as the company register showed. The court found that the false information damaged his reputation: he was being held responsible for scams on the betting platform and received threats by email from its customers. The court had earlier granted an injunction to remove the association, and the sentence confirmed it. Google argued that it does not host the material shown in its results and only organises pages available on the web; the judge held Google responsible because the information came from its own platform rather than from a linked page. Conjur, a legal-news site, identifies the tool as Gemini and reports that the association began after an interview in which he recommended seven games; the sentence names no product. Whether Google appealed is not reported.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 02/11/2026
Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
2025Event location unknownChatGPT (reported)
A woman told Futurism that after her marriage of about a decade hit a rough patch earlier in 2025, her husband began using ChatGPT to obsessively analyse his mental health and their marriage and started sending her "pages and pages" of ChatGPT-generated text. In her view the outputs were defences of his perspective that painted a biased picture of their union and disputed what she told him, and he shared them in place of his own feelings; she says his prompts were leading and that he would not accept that this skewed the answers. She asked him to stop sending ChatGPT material and to talk to her in his own words. She says the deeper he was drawn into ChatGPT, the less he engaged outside it, and that the outputs left no way to communicate. The couple are in an acrimonious divorce and custody battle. The account is hers; Futurism does not quote the outputs or report the husband's view.
Core + contextual relations Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 1 source · Added 01/11/2026
Oct 2023NetherlandsMONOcam (reported)
Dutch police use mobile smart cameras that apply artificial intelligence to photos of passing drivers to detect whether they are holding a mobile phone; a police officer then reviews each flagged photo before a fine is issued. A driver says that in October 2023, on the A2 motorway near Weert, such a camera photographed him with his right hand at his head and that he received a fine of 380 euros plus 9 euros in administration costs for holding a mobile device while driving. He says the flash photo, which he requested from the Central Judicial Collection Agency (CJIB), shows his empty hand near his face: he was scratching his head, his lease car allows hands-free calling, and he is left-handed. In a February 2024 blog post he writes that the camera was a MONOcam, that its algorithm judged that he was holding a device and that the reviewing police employee accepted that judgement, so that both the algorithm and a person erred; RTL Nieuws reported that the photo was probably taken by a MONOcam. Omroep Brabant described the fine as a mistake by the AI camera. The driver said the reviewing officer was probably biased by the algorithm's output and that a dark shadow in his hand could mislead a quick look. He lodged an objection with the Public Prosecution Service; it had not been decided when the reports appeared in February 2024, and a CJIB spokesperson, who would not comment on individual cases, suggested to RTL that he was unlikely to have to pay. No later outcome has been reported. He also told Omroep Brabant that he considers the cameras valuable for road safety, provided doubtful cases are not fined.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 3 sources · Added 01/11/2026
10 Jul 2024Event location unknownGemini (reported)
In a thread on X on 10 July 2024, an AI governance adviser wrote that he had just opened his tax return and that Gemini, Google's AI assistant, summarised it without being asked. He wrote that he could not find a setting to stop it, that the two locations Gemini itself suggested did not work, and that when another user showed him the setting meant to keep Gemini out of his documents it was already turned off while Gemini kept giving document summaries. His later testing, in the same thread, suggested that once Gemini had been opened for one PDF in Google Drive it was invoked again for every PDF he opened until he closed it, and he put forward a working theory that his 2023 sign-up for Workspace Labs had overridden the opt-out. A Google spokesperson told technology outlets that using Gemini in Google Workspace requires a user to enable it proactively and that content is not stored without permission; Tom's Hardware reports that Google suggested he may have used Gemini through the Drive side panel and that closing the panel might solve the issue.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 01/11/2026
Event date unknownEvent location unknownGoogle Search AI summary (reported)
In an article published on Medium on 26 October 2026 and a Bluesky post on 30 October, a writer says that at one appointment a doctor said "Let's ask Dr. Google", searched for a diagnosis and read the AI summary at the top of the results without opening any sources. The writer says the doctor was wrong; after they emailed him their sources and asked what they were missing, he called to say they were right. They say they were nervous to send the emails, and that their own research used Claude and Gemini, cross-checked against the cited sources. The article does not say what the summary said, what the diagnosis was, or when the appointment took place.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026
2024United StatesHayden AI bus-lane cameras (reported)
New York's Metropolitan Transportation Authority (MTA) uses cameras powered by artificial intelligence, mounted on bus windshields, to catch vehicles blocking bus lanes; the system analyses images to decide whether it sees a vehicle stopped where it should not be, and the city's Department of Transportation (DOT) says a person reviews every machine-generated violation before a ticket is issued. In November 2024 NBC New York reported that, during the 2024 expansion to new routes, the cameras on the M79 and Bx35 routes had mistakenly ticketed about 3,800 vehicles. According to the MTA, more than 870 of those violations went to cars, trucks and SUVs parked in legal alternate-side spots, because the cameras had not been programmed to skip those zones; most of the rest were issued during what should have been a warning period. One driver told NBC New York and NPR that tickets for parking he knew to be legal kept arriving, about a dozen in all and three in one day, costing hundreds of dollars; he said he tried to fight them in court, which was not working well, and received apology letters only after his story was broadcast. A second driver's summons carried a photo showing him in a legal alternate-side spot. The MTA said all the mistaken violations were reversed, payments were being refunded and the software was corrected. An unnamed source told NBC the cameras were made by Hayden AI; the MTA blamed about 800 of the tickets on a Hayden AI programming error, and a Hayden AI officer told NPR the problems had nothing to do with the AI or the technology and were a configuration issue. DOT declined to say how its human reviewers missed the erroneous violations.
Contextual tracker case Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 2 sources · Added 31/10/2026
Jan 2023MexicoCBP One app
In January 2023 US Customs and Border Protection (CBP) made its CBP One mobile app the only way for migrants at the US-Mexico border to apply for asylum appointments and exemption from Title 42 restrictions; applicants had to upload a photo of themselves through the app. In February 2023 the Guardian and the Border Chronicle, both reporting by Melissa del Bosque, quoted three non-profits working with Haitian and African asylum seekers in Tijuana, Reynosa and Matamoros who said the app's facial recognition was failing to register many people with darker skin, so they could not upload their photos and obtain appointments. The executive director of Al Otro Lado said Haitians at a workshop her organisation held in Tijuana the day after the app went live got error after error message. The Sidewalk School said hardly anyone among about 4,000 Black asylum seekers in Reynosa and 1,000 Haitians in Matamoros was getting an appointment, and that shining construction lights on faces let adults get past the photo step but not children under six, which kept families from applying. A Haitian Bridge Alliance attorney said the app had helped lighter-skinned applicants but not Haitians. The advocates also described other barriers, such as outdated phones and poor internet access. CBP did not answer the Guardian's questions before publication and told the Border Chronicle no one was available to respond. No technical analysis of the failures is reported.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026
Event date unknownEstoniaUnidentified AI web service
In its overview of personal-data breach notifications for the third quarter of 2026, published on 8 October 2026, Estonia's Data Protection Inspectorate (AKI) listed a case in which a bank employee uploaded employment contracts to a widely used AI web service, making them available to other employees who used the same AI account. Answering questions from the technology outlet Geenius, AKI said the employment contracts of a few individual employees had been entered into the AI system and became accessible to other employees using the same account; Geenius reports that those colleagues could view and download them. According to the report, the bank informed the people affected and blocked its employees from using that AI system. AKI did not name the bank, the AI service or further circumstances.
Contextual tracker case Low reported severity Internal Action
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 31/10/2026
Event date unknownEvent location unknownChatGPT (reported)
In a TikTok video posted on 28 October 2026, a woman described as living in California says the discharge paperwork and at-home treatment plan she received after a visit for care consisted of printed ChatGPT responses, which, according to a 30 October report by The Nerd Stash, included what appeared to be earlier chat prompts with labels such as "Aftercare Instruction Request". In a comment she identified the facility, which the report names only as allegedly an urgent-care clinic. She describes herself as medically complex, with a rare genetic disorder. In her caption she writes that, had she followed the instructions blindly, they would likely have led to bowel perforation given her history, citing other doctors she asked. She did not follow them. The clinic's account, the clinician involved and the date of the visit are not known.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026
May 2026NorwayUnidentified AI writing tool
In an article in May 2026 about new EU rules on single-use plastics, the Norwegian news site Nettavisen attributed to the former leader of the environmental organisation Framtiden i våre hender a statement about plastic ketchup sachets that, according to the complaint, she never made. After the organisation reacted, the journalist confirmed that the quote was an 'AI mishmash', Journalisten reports. Nettavisen removed the quote the same day it was alerted, but the fabricated quote was also published in several other Amedia newspapers after Nettavisen had corrected it. The organisation complained to the Norwegian Press Complaints Commission (Pressens Faglige Utvalg, PFU), saying Nettavisen had published an AI-generated quote without source checks, fabricating a statement and wrongly attributing it to a named person, and that the correction and apology came too late. Nettavisen acknowledged a breach of the source-control rule and apologised, but rejected the other alleged breaches. On 28 October 2026 the PFU found that publishing the fabricated quote was a clear breach of good press practice (point 3.2 of the Code of Ethics) and that the quick correction did not make up for it; it did not hold Nettavisen responsible for other newspapers' failure to correct.
Contextual tracker case Low reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 30/10/2026
Mar 2021United StatesID.me Face Match
ID.me, an identity-verification company used by at least 21 US states to check people claiming unemployment benefits, asks claimants to pass a facial recognition step that compares their face with a photo of the same person, such as a driving licence. In June 2021 Motherboard (VICE) reported that a gig economy worker in Las Vegas was suddenly cut off from his unemployment benefits in late March after ID.me failed to identify him. He said that when he held his phone in the instructed position the system rejected him three times without giving a reason and then locked him out. He said he tried ID.me's chat support many times and the state of Nevada sent him back to ID.me; after several weeks he posted a public criticism on Twitter, and the company contacted him and, after several more days, verified his identity. He said he went three weeks without his benefit and could not pay bills. ID.me's chief executive told Motherboard that its Face Match algorithms operate at about 99.9% efficacy, that failures are a problem with how people use the system rather than the technology, and that the company was unaware of eligible people unable to verify their identity. Motherboard said other claimants in several states described similar lockouts; those accounts are not counted here.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources · Added 30/10/2026
Apr 2019United KingdomHM Passport Office photo checker
The UK government's online passport application uses an automated face-detection check that tells applicants when it thinks an uploaded photo breaks the rules, which include a neutral expression and a closed mouth. In September 2019 PA reported that a young Black man renewing his passport online said the checker mistook his lips for an open mouth, and that to submit the photo anyway he had to write in a comment box that his mouth was closed and he just had big lips. PA also reported that a Black educational technologist said the system told her that her eyes looked closed and that it could not find the outline of her head; she told the BBC she uploaded 10 photographs over a week and each was rated poor, and PA reported that the Passport Office tweeted that it was sorry the service had not worked as it should. In October 2020 a BBC investigation reported that a Black student said she was wrongly told her mouth looked open on each of five photos and got one accepted only by writing a note challenging the verdict. The BBC fed 1,130 passport-style photos of politicians into the checker and found that photos of dark-skinned women were graded poor quality 22% of the time against 14% for light-skinned women; it reported that documents released under a 2019 freedom of information request showed the Home Office knew of the problem but judged overall performance good enough to launch. The Home Office said applicants can override the check, that the checker is a customer aid, and that its systems are improving.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources · Added 29/10/2026
2019Event location unknownSiri
On 26 July 2019 the Guardian reported that contractors grading a small share of Siri recordings for Apple regularly heard confidential information. Its anonymous source, a contractor, said Siri was often activated by mistake, for example by the sound of a zip, and that these accidental activations captured private discussions between doctors and patients, business deals, apparently criminal dealings and sexual encounters, with location, contact details and app data attached. Apple told the Guardian that requests were not linked to users' Apple IDs and that less than 1% of daily activations were graded. On 28 August 2019 Apple apologised, said it had suspended human grading, and said audio would no longer be retained by default, grading would become opt-in and recordings found to be inadvertent triggers would be deleted. Device owners' class action, Lopez v. Apple in the federal court in Oakland, alleged that Apple recorded private conversations after unintended Siri activations and disclosed them to third parties. Apple agreed to pay $95 million while denying wrongdoing, and co-class counsel say the judge granted final approval on 16 October 2025.
Contextual tracker case Medium reported severity Lawsuit Settled
AI involvement supported · Causal attribution supported · 4 sources · Added 29/10/2026
1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT
In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026
2019BelgiumGoogle Assistant
On 10 July 2019 the Belgian public broadcaster VRT NWS reported that it had listened to more than a thousand audio excerpts recorded by Google Home smart speakers and the Google Assistant phone app, passed to it by someone working for a Google subcontractor that transcribes Dutch-language recordings to improve Google's speech recognition. VRT said 153 of the excerpts were conversations in which "Okay Google" was clearly not said, and that it could hear addresses and other sensitive information, which let it find and visit people in Flanders who recognised their own or relatives' voices. Google said one of its language reviewers had leaked confidential Dutch audio data, and explained that its devices rarely have "false accepts", when background noise or words are interpreted as the hotword. Google suspended human review of Assistant audio in Europe, and the Hamburg data protection authority began an urgency procedure under Article 66 of the GDPR to stop the reviews for three months, according to TechCrunch.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources · Added 28/10/2026