10 Jul 2024Event location unknownGemini (reported)
In a thread on X on 10 July 2024, an AI governance adviser wrote that he had just opened his tax return and that Gemini, Google's AI assistant, summarised it without being asked. He wrote that he could not find a setting to stop it, that the two locations Gemini itself suggested did not work, and that when another user showed him the setting meant to keep Gemini out of his documents it was already turned off while Gemini kept giving document summaries. His later testing, in the same thread, suggested that once Gemini had been opened for one PDF in Google Drive it was invoked again for every PDF he opened until he closed it, and he put forward a working theory that his 2023 sign-up for Workspace Labs had overridden the opt-out. A Google spokesperson told technology outlets that using Gemini in Google Workspace requires a user to enable it proactively and that content is not stored without permission; Tom's Hardware reports that Google suggested he may have used Gemini through the Drive side panel and that closing the panel might solve the issue.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 01/11/2026
2024United StatesHayden AI bus-lane cameras (reported)
New York's Metropolitan Transportation Authority (MTA) uses cameras powered by artificial intelligence, mounted on bus windshields, to catch vehicles blocking bus lanes; the system analyses images to decide whether it sees a vehicle stopped where it should not be, and the city's Department of Transportation (DOT) says a person reviews every machine-generated violation before a ticket is issued. In November 2024 NBC New York reported that, during the 2024 expansion to new routes, the cameras on the M79 and Bx35 routes had mistakenly ticketed about 3,800 vehicles. According to the MTA, more than 870 of those violations went to cars, trucks and SUVs parked in legal alternate-side spots, because the cameras had not been programmed to skip those zones; most of the rest were issued during what should have been a warning period. One driver told NBC New York and NPR that tickets for parking he knew to be legal kept arriving, about a dozen in all and three in one day, costing hundreds of dollars; he said he tried to fight them in court, which was not working well, and received apology letters only after his story was broadcast. A second driver's summons carried a photo showing him in a legal alternate-side spot. The MTA said all the mistaken violations were reversed, payments were being refunded and the software was corrected. An unnamed source told NBC the cameras were made by Hayden AI; the MTA blamed about 800 of the tickets on a Hayden AI programming error, and a Hayden AI officer told NPR the problems had nothing to do with the AI or the technology and were a configuration issue. DOT declined to say how its human reviewers missed the erroneous violations.
Contextual tracker case Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 2 sources · Added 31/10/2026
2024United StatesGaggle
The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026
23 Feb 2024United KingdomMetropolitan Police live facial recognition
On 23 February 2024 Shaun Thompson, a London community volunteer whom the 2026 judgment describes as 39, walked past a Metropolitan Police live facial recognition deployment near London Bridge station. The High Court records as not in dispute that the system detected a high level of facial similarity between images of him and the watchlist image of his brother, who was the subject of an outstanding arrest warrant, and generated an alert. According to the court's account, officers stopped, detained and questioned him and made him prove his identity, and when he declined to have his fingerprints taken he was threatened with arrest; he says the experience left him angry and distressed. Officers ended the engagement after checking police records about his brother, and he confirmed his identity with a passport photograph on his phone. Big Brother Watch, whose director was his co-claimant, says he was held for almost 30 minutes despite showing several identity documents. His judicial review claim about the stop, issued in May 2024, was withdrawn under a consent order agreed on 18 December 2024 on terms including a settlement sum paid to him. An amended challenge to the Met's revised live facial recognition policy of September 2024, brought with Big Brother Watch's director, was dismissed by the Divisional Court on 21 April 2026; the court said it was not judging the merits of the technology, and the claimants announced plans to appeal.
Contextual tracker case Medium reported severity Lawsuit Dismissed
AI involvement supported · Causal attribution established · 4 sources, 3 underlying accounts · Added 26/10/2026
2024GermanyMicrosoft Copilot
A court reporter from the Tübingen area found in 2024 that Microsoft's Copilot, asked about him, described him as a man charged in a child abuse case, an escapee from a psychiatric institution and a fraudster who cheated widows, according to his account to the public broadcaster SWR as relayed by heise and ComputerBild. All were defendants in trials he had covered as a journalist. heise and ComputerBild, both citing SWR, report that Copilot also gave his private phone number and full home address and offered a route there. He told The Register that seeing his name tied to these crimes was traumatising and that prosecutors had rejected his criminal complaint in two instances; according to the SWR account relayed by heise, the complaint failed because no real person was the author. After the Bavarian data-protection authority contacted Microsoft the claims were briefly unavailable and then returned. Microsoft told The Register it had investigated and taken appropriate and immediate action.
Contextual tracker case Medium reported severity Internal Action
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 25/10/2026
May 2024ItalyUnidentified speech-to-text tool
In May 2024 a businessman questioned as a suspect in the Genoa prosecutors' inquiry into alleged bribes to the president of the Liguria region was recorded in the official transcript of his interrogation before the preliminary-investigations judge as saying that the president wanted 'finanziamenti illeciti' (unlawful financing). According to Corriere della Sera, on receiving the transcript he wrote to the judge to contest it, saying he had said 'finanziamenti leciti' (lawful financing); his lawyer said the legally valid handwritten record did not contain the word. Il Post reports that the passage had been highlighted in the headlines of many newspapers in the following days as confirming the prosecutors' accusations, and that a second hearing of the audio was needed to settle it. La Repubblica reported on 27 May 2024 that, at an ad hoc hearing, the businessman confirmed he had said 'leciti', with the prosecutor's agreement according to his lawyer, and the judge took note; it wrote that the fault appears to lie with the automatic software that transcribes words spoken in court. Il Post reports that checks found the error was not human and that the transcript had been produced by speech-to-text software. The software is not named.
Contextual tracker case Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 3 sources · Added 25/10/2026
7 Jun 2024NetherlandsChatGPT
A homeowner in the Netherlands sued his neighbour, whose permitted roof extension shaded his solar panels, claiming more than 21,000 euros for lost yield and investment. In a judgment of 7 June 2024 (ECLI:NL:RBGEL:2024:3636), the sub-district judge of the Rechtbank Gelderland, sitting in Nijmegen, held that the neighbour had to bear half of the damage and then calculated the damage, estimating the average lifespan of solar panels from 2009 and the current average electricity price partly with the help of ChatGPT, as the judgment states. Using a lifespan of 27.5 years, about 15 remaining years and a price of 0.30 euros per kWh, the judge put the yield loss at about 2,250 euros and the maximum damage at 3,323.40 euros; half of that was less than the 3,300 euros the neighbour had offered, so the claim was rejected and the homeowner, who had refused the offer, received nothing and was ordered to pay costs. On the neighbour's counterclaim, the judge assumed, again partly with ChatGPT, that insulation material the homeowner had thrown into water was no longer usable, and ordered him to pay damages of 2,619.02 euros in total. The judgment does not say what was asked or answered, and whether it was appealed is not reported.
Contextual tracker case Low reported severity Lawsuit Dismissed
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 24/10/2026
30 Sept 2024Event location unknownBaidu AI smart answer
A practising lawyer in Nanjing, China, found in September 2024 that Baidu search's 'AI smart answer' (AI 智能回答) feature, asked how many years he had been sentenced to, answered that he had been sentenced to three years in prison for a criminal offence and showed his photograph in a lawyer's robe. According to the first-instance judgment as quoted in the press, the answer was produced on 30 September 2024. The lawyer says he complained repeatedly to Baidu by letter, hotline and email without the content being fully removed, and he sued. The Jiangbei New Area People's Court in Nanjing found that Baidu had combined text and his picture through AI into false, disparaging content aimed at him, that Baidu was at fault, and that this was defamation; it ordered a written apology and rejected his claims for lost income and emotional damages for lack of evidence. Baidu argued that AI hallucinations could not be foreseen. The Nanjing Intermediate People's Court dismissed Baidu's appeal on 12 March 2026. The lawyer applied for enforcement when no apology came, and in September 2026 said he had received Baidu's written apology; Baidu has applied for a retrial.
Contextual tracker case Medium reported severity
AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 22/10/2026
Dec 2024 to Sept 2026AustraliaUnidentified AI writing tool
In December 2024 the Parole Board of Tasmania added a condition to the parole of Susan Neill-Fraser, released in 2022 after serving 13 years for murder and who maintains her innocence, barring her from communicating with media to claim innocence or wrongful conviction; a broader condition replaced it in May 2025. On 15 September 2026 the Supreme Court of Tasmania declared the conditions invalid. Her counsel told the court that the board's secretary had used artificial intelligence to prepare a rationale document justifying the condition and that it cited case law that did not exist. The Human Rights Law Centre, which represented her, says the State conceded that the board's decision-making was affected by a document containing legal authorities that were likely AI-generated hallucinations, and the ABC reports the court found the board relied on that document. The board had withdrawn the condition in August 2026. Tasmania's Attorney-General announced an independent investigation of the board's professional standards over its use of unverified AI, and the Justice Department announced a review of AI use in past parole decisions.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 6 sources, 4 underlying accounts · Added 06/10/2026
2024AustraliaTurnitin AI-text detector
The ABC reported on 9 October 2025 that Australian Catholic University (ACU) registered nearly 6,000 cases of alleged academic misconduct across its nine campuses in 2024, according to internal documents, and that about 90 per cent of the referrals related to AI use. The ABC reports that the university's case against a final-year paramedic student hinged on a single AI-generated report that, the student said, marked 84 per cent of an essay as AI-written; the student produced dozens of pages of evidence and the ABC describes the student as wrongly accused. Students the ABC spoke to said they were notified at the end of semester, had little time to respond and waited months to be cleared, and the ABC saw emails asking students for handwritten notes and internet search histories. A final-year nursing student was cleared after six months, during which her transcript read 'results withheld'; she believes this cost her a graduate position, and the report does not say what evidence prompted her referral. The ABC says internal documents show ACU knew of problems with the detector for more than a year before abandoning the Turnitin tool in March. ACU's deputy vice-chancellor called the figures substantially overstated, said cases resting solely on Turnitin's AI detection were dismissed immediately, acknowledged investigations were not always timely and said the university regretted the impact on some students.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 06/10/2026
Mar 2024 to May 2025United StatesOtter Notetaker
Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.
Contextual tracker case Low reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026
14 Feb 2024United StatesFlock Safety license plate readers
According to a lawsuit filed on 29 June 2026 and reported by The Herald (Rock Hill), a York County sheriff's deputy stopped Steven Melvin, 42, on 14 February 2024 as he pulled into his apartment complex near Lake Wylie, after receiving a Flock license-plate-reader alert that a stolen dark-coloured BMW sedan was in the area. The deputy approached Melvin's black BMW with his gun drawn and aimed at him and made him kneel with his hands over his head for more than five minutes; after calling for backup and checking his information, the deputy determined the car was not stolen. The camera had read the first letter of his South Carolina tag incorrectly, matching a stolen BMW one letter off. A sheriff's internal-affairs review in November 2024 found the deputy's actions reasonable and blamed an illegally tinted plate cover, for which Melvin received a verbal warning; an email cited in the filing says the cameras had read his plate correctly 13 times that month. Melvin says the stop caused him trauma and emotional distress. The sheriff's office removed the case to federal court in August 2026 and denies violating his rights.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 28/09/2026
1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition
In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system
Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
1 Nov 2024 to 28 Jan 2026United StatesTurnitin AI-text detector
Orion Newby, an Adelphi University first-year student with language and auditory processing disabilities, received a zero in November 2024 on a World Civilizations paper after the professor suspected it was AI-generated and the university relied in part on AI-detection software; he was ordered to attend a plagiarism workshop and his appeal was denied, leaving him one finding from suspension or expulsion. Newby — who had written the paper with 15-20 hours of tutor support through the university's own disability program — said the detectors flagged his citations, and two other detectors scored the paper as human. After the family sued, New York State Supreme Court Judge Randy Sue Marber in Nassau County ruled on 28 January 2026 that Adelphi's finding and its denial of his appeal were 'without valid basis and devoid of reason' and ordered his record expunged. The family spent six figures on legal costs.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 15/09/2026