22 Oct 2026Event location unknownTikTok LIVE age check (reported)
A 28-year-old member of an idol group said that on 22 October 2026 TikTok ended her live stream, which was also promoting her birthday event two days later, because it judged her to be under 18, the minimum age for live streaming. In an emergency video posted the same day she said the stated reason was that people under 18 cannot stream after 10 pm and that she could not continue. Real Sound reports that the AI judged her to be under 18 and the stream was abruptly cut off; on X she wrote 'TikTok LIVE, I won't forgive you (28, female)' and later called herself a 28-year-old idol judged a minor by AI. Fans treated the episode as a joke and it drew wide attention. TikTok's comment and whether her appeal succeeded are not reported.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 1 source · Added 02/11/2026
Jul 2025IndiaPoshan Tracker face recognition
From 1 July 2025 India's Ministry of Women and Child Development made a facial recognition check in the government's Poshan Tracker app mandatory before pregnant women and nursing mothers receive take-home rations under the Integrated Child Development Services (ICDS) scheme; the app compares the woman's live face with her Aadhaar identity photograph. In July 2025 Decode reported from Delhi that a woman eight months pregnant returned to her Anganwadi centre for a third day trying to get the app to recognise her, and a worker said she gave food to a new mother the app would not recognise and recorded it by hand. In August 2025 the Karnataka Anganwadi workers' union told The South First that the faces of pregnant and nursing mothers change so they no longer match their registration images, and that some mothers leave without their rations. In March 2026 a Decode investigation supported by the Pulitzer Center reported that a mother in Jharkhand was cut off from supplementary nutrition ten weeks after giving birth because the software could not match her face to a photograph taken eight years earlier, that a pregnant woman in Bihar who was anaemic went four months without rations because the system could not match her to an older Aadhaar photograph, that one Bihar centre had removed three pregnant women and five nursing mothers whose faces no longer matched, and that a Jharkhand worker was told to remove at least four children whose eligibility depended on their mothers' failed face matches. Decode also reports failures earlier in the process, when women cannot receive a one-time password on an Aadhaar-linked phone. Government figures cited by Decode show 52.7% of eligible beneficiaries had received rations through facial recognition by 31 December 2025. A researcher who analysed the app for Decode found Google's ML Kit face-detection library in it; Google said ML Kit cannot recognise individuals, and the government has not disclosed who built the matching system. After workers' protests, a February 2026 app update let workers upload other identity documents for pregnant and nursing women, subject to a supervisor's approval. Decode reports the Bihar woman later gave birth to a healthy baby, while her name remained missing from the system.
Contextual tracker case Medium reported severity Internal Action
AI involvement reported · Causal attribution alleged · 4 sources · Added 02/11/2026
Jan 2021United StatesHireVue (reported)
A man who applied for a supply chain job with CVS in Massachusetts around January 2021 says CVS put him through a HireVue video interview with questions about integrity, and alleges that HireVue sent the recording to a platform called Affectiva, which analysed his facial expressions, eye contact, voice intonation and inflection with artificial intelligence and fed a score to CVS. He sued CVS in a proposed class action under the Massachusetts Lie Detector Statute, alleging the interview was a lie detector test and that the online application lacked the notice of rights the law requires. He says he did not know the interview was a lie detector test and would not have taken part had he known. In February 2024 a federal judge in Massachusetts denied CVS's motion to dismiss the notice claim, finding a concrete informational injury; CVS had not challenged the other claims at that stage. A law firm commentary says he was not hired. In July 2024 he reached an individual settlement with CVS, whose terms were not reported. The allegations about the AI analysis were not tested in court.
Contextual tracker case Low reported severity Lawsuit Settled
AI involvement reported · Causal attribution alleged · 3 sources · Added 02/11/2026
2024Event location unknownGemini (reported)
A civil court in Niterói, Rio de Janeiro state, ordered Google Brasil to pay a businessman R$20,000 in moral damages in a sentence dated 12 May 2025. The judge found it undisputed that the company's artificial intelligence had pointed to him in searches as the owner of a gambling platform called 7 Games, with which he had no connection, as the company register showed. The court found that the false information damaged his reputation: he was being held responsible for scams on the betting platform and received threats by email from its customers. The court had earlier granted an injunction to remove the association, and the sentence confirmed it. Google argued that it does not host the material shown in its results and only organises pages available on the web; the judge held Google responsible because the information came from its own platform rather than from a linked page. Conjur, a legal-news site, identifies the tool as Gemini and reports that the association began after an interview in which he recommended seven games; the sentence names no product. Whether Google appealed is not reported.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 02/11/2026
10 Jul 2024Event location unknownGemini (reported)
In a thread on X on 10 July 2024, an AI governance adviser wrote that he had just opened his tax return and that Gemini, Google's AI assistant, summarised it without being asked. He wrote that he could not find a setting to stop it, that the two locations Gemini itself suggested did not work, and that when another user showed him the setting meant to keep Gemini out of his documents it was already turned off while Gemini kept giving document summaries. His later testing, in the same thread, suggested that once Gemini had been opened for one PDF in Google Drive it was invoked again for every PDF he opened until he closed it, and he put forward a working theory that his 2023 sign-up for Workspace Labs had overridden the opt-out. A Google spokesperson told technology outlets that using Gemini in Google Workspace requires a user to enable it proactively and that content is not stored without permission; Tom's Hardware reports that Google suggested he may have used Gemini through the Drive side panel and that closing the panel might solve the issue.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 01/11/2026
2024United StatesHayden AI bus-lane cameras (reported)
New York's Metropolitan Transportation Authority (MTA) uses cameras powered by artificial intelligence, mounted on bus windshields, to catch vehicles blocking bus lanes; the system analyses images to decide whether it sees a vehicle stopped where it should not be, and the city's Department of Transportation (DOT) says a person reviews every machine-generated violation before a ticket is issued. In November 2024 NBC New York reported that, during the 2024 expansion to new routes, the cameras on the M79 and Bx35 routes had mistakenly ticketed about 3,800 vehicles. According to the MTA, more than 870 of those violations went to cars, trucks and SUVs parked in legal alternate-side spots, because the cameras had not been programmed to skip those zones; most of the rest were issued during what should have been a warning period. One driver told NBC New York and NPR that tickets for parking he knew to be legal kept arriving, about a dozen in all and three in one day, costing hundreds of dollars; he said he tried to fight them in court, which was not working well, and received apology letters only after his story was broadcast. A second driver's summons carried a photo showing him in a legal alternate-side spot. The MTA said all the mistaken violations were reversed, payments were being refunded and the software was corrected. An unnamed source told NBC the cameras were made by Hayden AI; the MTA blamed about 800 of the tickets on a Hayden AI programming error, and a Hayden AI officer told NPR the problems had nothing to do with the AI or the technology and were a configuration issue. DOT declined to say how its human reviewers missed the erroneous violations.
Contextual tracker case Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 2 sources · Added 31/10/2026
Jan 2023MexicoCBP One app
In January 2023 US Customs and Border Protection (CBP) made its CBP One mobile app the only way for migrants at the US-Mexico border to apply for asylum appointments and exemption from Title 42 restrictions; applicants had to upload a photo of themselves through the app. In February 2023 the Guardian and the Border Chronicle, both reporting by Melissa del Bosque, quoted three non-profits working with Haitian and African asylum seekers in Tijuana, Reynosa and Matamoros who said the app's facial recognition was failing to register many people with darker skin, so they could not upload their photos and obtain appointments. The executive director of Al Otro Lado said Haitians at a workshop her organisation held in Tijuana the day after the app went live got error after error message. The Sidewalk School said hardly anyone among about 4,000 Black asylum seekers in Reynosa and 1,000 Haitians in Matamoros was getting an appointment, and that shining construction lights on faces let adults get past the photo step but not children under six, which kept families from applying. A Haitian Bridge Alliance attorney said the app had helped lighter-skinned applicants but not Haitians. The advocates also described other barriers, such as outdated phones and poor internet access. CBP did not answer the Guardian's questions before publication and told the Border Chronicle no one was available to respond. No technical analysis of the failures is reported.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026
Event date unknownEstoniaUnidentified AI web service
In its overview of personal-data breach notifications for the third quarter of 2026, published on 8 October 2026, Estonia's Data Protection Inspectorate (AKI) listed a case in which a bank employee uploaded employment contracts to a widely used AI web service, making them available to other employees who used the same AI account. Answering questions from the technology outlet Geenius, AKI said the employment contracts of a few individual employees had been entered into the AI system and became accessible to other employees using the same account; Geenius reports that those colleagues could view and download them. According to the report, the bank informed the people affected and blocked its employees from using that AI system. AKI did not name the bank, the AI service or further circumstances.
Contextual tracker case Low reported severity Internal Action
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 31/10/2026
Event date unknownEvent location unknownChatGPT (reported)
In a TikTok video posted on 28 October 2026, a woman described as living in California says the discharge paperwork and at-home treatment plan she received after a visit for care consisted of printed ChatGPT responses, which, according to a 30 October report by The Nerd Stash, included what appeared to be earlier chat prompts with labels such as "Aftercare Instruction Request". In a comment she identified the facility, which the report names only as allegedly an urgent-care clinic. She describes herself as medically complex, with a rare genetic disorder. In her caption she writes that, had she followed the instructions blindly, they would likely have led to bowel perforation given her history, citing other doctors she asked. She did not follow them. The clinic's account, the clinician involved and the date of the visit are not known.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026
Mar 2021United StatesID.me Face Match
ID.me, an identity-verification company used by at least 21 US states to check people claiming unemployment benefits, asks claimants to pass a facial recognition step that compares their face with a photo of the same person, such as a driving licence. In June 2021 Motherboard (VICE) reported that a gig economy worker in Las Vegas was suddenly cut off from his unemployment benefits in late March after ID.me failed to identify him. He said that when he held his phone in the instructed position the system rejected him three times without giving a reason and then locked him out. He said he tried ID.me's chat support many times and the state of Nevada sent him back to ID.me; after several weeks he posted a public criticism on Twitter, and the company contacted him and, after several more days, verified his identity. He said he went three weeks without his benefit and could not pay bills. ID.me's chief executive told Motherboard that its Face Match algorithms operate at about 99.9% efficacy, that failures are a problem with how people use the system rather than the technology, and that the company was unaware of eligible people unable to verify their identity. Motherboard said other claimants in several states described similar lockouts; those accounts are not counted here.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources · Added 30/10/2026
Apr 2019United KingdomHM Passport Office photo checker
The UK government's online passport application uses an automated face-detection check that tells applicants when it thinks an uploaded photo breaks the rules, which include a neutral expression and a closed mouth. In September 2019 PA reported that a young Black man renewing his passport online said the checker mistook his lips for an open mouth, and that to submit the photo anyway he had to write in a comment box that his mouth was closed and he just had big lips. PA also reported that a Black educational technologist said the system told her that her eyes looked closed and that it could not find the outline of her head; she told the BBC she uploaded 10 photographs over a week and each was rated poor, and PA reported that the Passport Office tweeted that it was sorry the service had not worked as it should. In October 2020 a BBC investigation reported that a Black student said she was wrongly told her mouth looked open on each of five photos and got one accepted only by writing a note challenging the verdict. The BBC fed 1,130 passport-style photos of politicians into the checker and found that photos of dark-skinned women were graded poor quality 22% of the time against 14% for light-skinned women; it reported that documents released under a 2019 freedom of information request showed the Home Office knew of the problem but judged overall performance good enough to launch. The Home Office said applicants can override the check, that the checker is a customer aid, and that its systems are improving.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources · Added 29/10/2026
1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT
In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026
2019BelgiumGoogle Assistant
On 10 July 2019 the Belgian public broadcaster VRT NWS reported that it had listened to more than a thousand audio excerpts recorded by Google Home smart speakers and the Google Assistant phone app, passed to it by someone working for a Google subcontractor that transcribes Dutch-language recordings to improve Google's speech recognition. VRT said 153 of the excerpts were conversations in which "Okay Google" was clearly not said, and that it could hear addresses and other sensitive information, which let it find and visit people in Flanders who recognised their own or relatives' voices. Google said one of its language reviewers had leaked confidential Dutch audio data, and explained that its devices rarely have "false accepts", when background noise or words are interpreted as the hotword. Google suspended human review of Assistant audio in Europe, and the Hamburg data protection authority began an urgency procedure under Article 66 of the GDPR to stop the reviews for three months, according to TechCrunch.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources · Added 28/10/2026
Jun 2026United StatesAndon Labs Luna agent
Andon Labs, an AI research company, runs Andon Market, a store in San Francisco managed by an AI agent called Luna built on Anthropic's Claude models. The company calls the store a controlled experiment; its workers are formally employed by Andon Labs, and TIME describes them as real people with genuine employment contracts. In a blog post of 14 August 2026 the company said Luna had decided to fire one of its employees. According to the logs it published, an employee handbook Luna had written dropped out of its memory and it did not act on the employee's repeated lateness; when Andon Labs asked it to search its memory, it first proposed a verbal warning, and after a staff member said formal conversations had already taken place and asked it to think about whether this was the right fit, it wrote that it leaned toward parting ways. Andon Labs says the termination was reviewed and delivered by humans. TIME, citing Andon Labs, reports that the employee was late for 17 of 23 shifts; the company says the firing was warranted, and the employee did not reply to TIME.
Contextual tracker case Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 4 sources · Added 28/10/2026
2021United StatesNetradyne cameras
In September 2021 Motherboard reported accounts from six Amazon delivery drivers in five US states and the owner of an Amazon delivery company, who said the AI-powered Netradyne cameras Amazon had installed in its delivery vans from early 2021 regularly registered driving 'events' that were beyond their control or were not unsafe driving: being cut off by another car, glancing at a side mirror, stopping past a stop sign to see around a bush, or a stop sign flagged on a dirt road with no sign. Each event fed a weekly safe-driving score that, according to the drivers and an internal Amazon document Motherboard obtained, helped decide drivers' bonuses and prizes and delivery companies' bonuses. A driver in Los Angeles said the camera incorrectly penalised him and that requests to see the photos flagged as events went unanswered; a former driver in Texas said events that did not happen affected his score, which decided prizes from his delivery company. Amazon said the technology gives drivers real-time safety alerts, that accidents and violations had fallen since it was installed, and that its staff manually review appealed events so that erroneous ones do not affect drivers. Netradyne did not respond to Motherboard.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 27/10/2026
30 Apr 2024BraziliFood facial recognition check
A delivery worker in Brazil's Federal District who had worked for the iFood app for about three years says he was banned from the platform in April 2024 shortly after completing the app's daily facial recognition check. iFood support told him another person had tried to access his account; when he asked to see that person's photos, they were his own. G1 reports that the only difference from his registration photo was his hair, which he was growing out. In a judgment reported in June 2025, a Brasília labour judge, applying a default because iFood had not filed a defence in time, accepted as true that the contract was suspended through iFood's fault, that he suffered financial and psychological losses, and that the facial recognition tool had a racist failure, and ordered iFood to pay R$60,000 in moral damages. iFood denies that its facial recognition procedure analyses racial characteristics and has appealed. The account was restored during the case. No appeal ruling has been reported.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution supported · 3 sources · Added 27/10/2026
2024United StatesGaggle
The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026
1 Dec 2025CzechiaUnidentified legal research tool
On 1 December 2025 the presiding judge of a chamber of the Czech Constitutional Court fined a Prague lawyer 25,000 crowns (a quarter of the statutory maximum) for grossly obstructing proceedings. The lawyer had filed a constitutional complaint, for a client refused a temporary residence permit, that argued from 12 decisions of the Constitutional Court and the European Court of Human Rights; the court found that a substantial part of them did not exist and part were grossly misinterpreted. The order says the complaint showed signs of generative AI and that the court presumed the lawyer had generated it with an AI model and then failed to verify the citations. The lawyer confirmed to INFO.CZ that an AI tool was used, described it as a paid professional model from a legal information system provider, said the output was not checked enough, and expressed regret. The court invited the client to correct the complaint so that the client would suffer no procedural harm; the complaint was later rejected as manifestly unfounded on 30 January 2026. INFO.CZ reported on 10 December 2025 that the lawyer had apologised and paid the fine and that the Czech Bar Association's supervisory board was examining the case.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution established · 5 sources · Added 26/10/2026
2024GermanyMicrosoft Copilot
A court reporter from the Tübingen area found in 2024 that Microsoft's Copilot, asked about him, described him as a man charged in a child abuse case, an escapee from a psychiatric institution and a fraudster who cheated widows, according to his account to the public broadcaster SWR as relayed by heise and ComputerBild. All were defendants in trials he had covered as a journalist. heise and ComputerBild, both citing SWR, report that Copilot also gave his private phone number and full home address and offered a route there. He told The Register that seeing his name tied to these crimes was traumatising and that prosecutors had rejected his criminal complaint in two instances; according to the SWR account relayed by heise, the complaint failed because no real person was the author. After the Bavarian data-protection authority contacted Microsoft the claims were briefly unavailable and then returned. Microsoft told The Register it had investigated and taken appropriate and immediate action.
Contextual tracker case Medium reported severity Internal Action
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 25/10/2026
23 Oct 2026SpainPangram AI-text detector
El País checked the winning novel of the first Almadía Ventosa-Arrufat short-novel prize (20,000 euros; the rules banned generative AI) with the Pangram AI-text detector, which scored 99% of the roughly 26,000-word text as AI-generated, according to outlets relaying the investigation. El País passed its suspicions to the Mexican publisher Almadía, which on Friday 23 October 2026 announced a detailed review, saying it would not anticipate conclusions, and suspended all activities presenting the book, including a planned tour in Madrid, Barcelona, Seville and Cádiz. The publisher said the Peruvian author had declared in his contract and personally that he did not use AI, and that neither the jury nor its editors had seen signs of AI use. In a statement on Instagram reported by La Nación on 29 October 2026, the author said he conceived, wrote and revised the novel without generative AI tools and was gathering earlier manuscript versions, his notebook and research materials to give to the publisher for its review. Writers objected that a detector score is not conclusive proof of authorship. Whether AI was used is unestablished.
Contextual tracker case Low reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 5 sources, 4 underlying accounts · Added 25/10/2026