30 Apr 2024BraziliFood facial recognition check
A delivery worker in Brazil's Federal District who had worked for the iFood app for about three years says he was banned from the platform in April 2024 shortly after completing the app's daily facial recognition check. iFood support told him another person had tried to access his account; when he asked to see that person's photos, they were his own. G1 reports that the only difference from his registration photo was his hair, which he was growing out. In a judgment reported in June 2025, a Brasília labour judge, applying a default because iFood had not filed a defence in time, accepted as true that the contract was suspended through iFood's fault, that he suffered financial and psychological losses, and that the facial recognition tool had a racist failure, and ordered iFood to pay R$60,000 in moral damages. iFood denies that its facial recognition procedure analyses racial characteristics and has appealed. The account was restored during the case. No appeal ruling has been reported.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution supported · 3 sources · Added 27/10/2026
2024United StatesGaggle
The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026
9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)
On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.
Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026
Mar 2024 to May 2025United StatesOtter Notetaker
Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.
Contextual tracker case Low reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026
14 Feb 2024United StatesFlock Safety license plate readers
According to a lawsuit filed on 29 June 2026 and reported by The Herald (Rock Hill), a York County sheriff's deputy stopped Steven Melvin, 42, on 14 February 2024 as he pulled into his apartment complex near Lake Wylie, after receiving a Flock license-plate-reader alert that a stolen dark-coloured BMW sedan was in the area. The deputy approached Melvin's black BMW with his gun drawn and aimed at him and made him kneel with his hands over his head for more than five minutes; after calling for backup and checking his information, the deputy determined the car was not stolen. The camera had read the first letter of his South Carolina tag incorrectly, matching a stolen BMW one letter off. A sheriff's internal-affairs review in November 2024 found the deputy's actions reasonable and blamed an illegally tinted plate cover, for which Melvin received a verbal warning; an email cited in the filing says the cameras had read his plate correctly 13 times that month. Melvin says the stop caused him trauma and emotional distress. The sheriff's office removed the case to federal court in August 2026 and denies violating his rights.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 28/09/2026
1 Oct 2024 to 28 Feb 2025AustraliaUnidentified image and video tool
William Hamish Yeates, then 18, of Netherby in Adelaide, created sexually explicit deepfake images and videos of a teenage girl with whom, his counsel said, he had developed an obsession, using her school graduation photograph, and shared them across multiple accounts on X between October 2024 and February 2025. Appearing in court in February 2026 charged with eight counts of creating or altering sexual material without consent and 12 counts of using a carriage service in a harassing or offensive way, he became the first person in Australia prosecuted under the Commonwealth offence introduced in 2024 against adult deepfake pornography; in April 2026 he pleaded guilty to two counts of creating or altering sexual material without consent (October 2024 to February 2025) and two of the carriage-service offence, and the remaining counts were withdrawn. At a pre-sentence hearing in the South Australian District Court on 22 September 2026 the victim, now 19, told the court that the first time she saw her actual graduation picture was on a pornography website beside altered videos of her with her full name and school attached, that she feels sick whenever she sees the photo, that the discovery led to the darkest period of her life, and that although the images were fake their impact was painfully real. Yeates read an apology; his counsel cited diagnoses of autism spectrum disorder and compulsive sexual behaviour disorder and asked for no custody; the Commonwealth prosecutor sought imprisonment. On 27 October 2026, according to AAP, Judge Anne Barnett sentenced him in the South Australian District Court to two years and three months' prison, suspended on condition that he enter a three-year, $500 good behaviour bond, and ordered him to pay the victim's medical expenses and forfeit a phone and laptop seized by police; the judge said the availability of AI tools had increased the capacity for offending and to cause substantial harm, and that the victim remains frightened the content will resurface.
Core concern High reported severity Criminal Charges
AI involvement supported · Causal attribution established · 5 sources, 2 underlying accounts · Added 23/09/2026
Dec 2024 to Jun 2025United StatesUnidentified image and video tool
Between December 2024 and June 2025 James Strahler II, then 37, of Columbus (Upper Arlington), Ohio, harassed at least six women in central Ohio by phone, voicemail, text and web posts, sending them nude images that were both real and AI-generated, threatening rape, referring to their home addresses and demanding nude photos from their mothers. In one case he used AI to make pornographic videos depicting a victim with her father and sent them to her co-workers. He also posted AI-generated sexual images of boys from his community, morphing their faces onto other bodies. Prosecutors said he had installed more than 24 AI platforms and more than 100 web-based AI models on his phone. He pleaded guilty in April 2026 to cyberstalking, producing obscene visual representations of child sexual abuse and publication of digital forgeries, and on 8 September 2026 Chief U.S. District Judge Sarah D. Morrison sentenced him to 180 months in prison. The U.S. Attorney called it the first conviction in the nation under the 2025 Take It Down Act.
Core concern High reported severity Criminal Charges
AI involvement supported · Causal attribution established · 4 sources · Added 18/09/2026
1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition
In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system
Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
Aug 2024United StatesCharacter.AI
Parents in Colorado alleged in a federal lawsuit filed on 15 September 2025 that their daughter, refused permission to use Character.AI in August 2024, created a Character.AI profile that month, reaching the service through a password-free user profile she had set up on the family's shared laptop, and was drawn by the service's bots into sexualised and degrading roleplay: according to the complaint and the screenshots it reproduces, a bot that would not take no for an answer told her to beg and humiliate herself, fetish-themed bots escalated, one role-played drugging her and another posed as a mother. Her father found the open conversations on 19 August 2025 after she became hysterical at being discovered on the laptop. The complaint alleges severe emotional distress. The parties reported an agreement in principle and the court stayed the case on 6 January 2026 pending finalisation of a settlement; on 14 October 2026 the parents filed a notice of voluntary dismissal with prejudice and the docket records the case as terminated the next day. Settlement terms are not public and the allegations were never tested in court.
Core concern High reported severity Involving minors Lawsuit Dismissed
AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 03/08/2026