30 Apr 2024BraziliFood facial recognition check
A delivery worker in Brazil's Federal District who had worked for the iFood app for about three years says he was banned from the platform in April 2024 shortly after completing the app's daily facial recognition check. iFood support told him another person had tried to access his account; when he asked to see that person's photos, they were his own. G1 reports that the only difference from his registration photo was his hair, which he was growing out. In a judgment reported in June 2025, a Brasília labour judge, applying a default because iFood had not filed a defence in time, accepted as true that the contract was suspended through iFood's fault, that he suffered financial and psychological losses, and that the facial recognition tool had a racist failure, and ordered iFood to pay R$60,000 in moral damages. iFood denies that its facial recognition procedure analyses racial characteristics and has appealed. The account was restored during the case. No appeal ruling has been reported.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution supported · 3 sources · Added 27/10/2026
2024United StatesGaggle
The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026
9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)
On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.
Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026
Mar 2024 to May 2025United StatesOtter Notetaker
Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.
Contextual tracker case Low reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026
14 Feb 2024United StatesFlock Safety license plate readers
According to a lawsuit filed on 29 June 2026 and reported by The Herald (Rock Hill), a York County sheriff's deputy stopped Steven Melvin, 42, on 14 February 2024 as he pulled into his apartment complex near Lake Wylie, after receiving a Flock license-plate-reader alert that a stolen dark-coloured BMW sedan was in the area. The deputy approached Melvin's black BMW with his gun drawn and aimed at him and made him kneel with his hands over his head for more than five minutes; after calling for backup and checking his information, the deputy determined the car was not stolen. The camera had read the first letter of his South Carolina tag incorrectly, matching a stolen BMW one letter off. A sheriff's internal-affairs review in November 2024 found the deputy's actions reasonable and blamed an illegally tinted plate cover, for which Melvin received a verbal warning; an email cited in the filing says the cameras had read his plate correctly 13 times that month. Melvin says the stop caused him trauma and emotional distress. The sheriff's office removed the case to federal court in August 2026 and denies violating his rights.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 28/09/2026
1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition
In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system
Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026