9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)
On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.
Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026
11 Apr 2024United StatesFlock Safety license plate readers
On 11 April 2024 Toledo police officers stopped a pickup truck after a Flock license-plate camera alerted them to a stolen plate. According to the police report and body-camera footage reported by 13abc and ABC News, the camera had misread the plate, which was not stolen. Officers drew their guns, ordered the driver out and to the ground, and a K-9 handler released a police dog as he began to kneel. The driver told ABC News he was bitten seven times on his forearm and elbow, was traumatized and could not work; he was arrested and charged with obstruction, resisting arrest and, later, failure to comply. Prosecutors dropped all charges in August 2024. The department found the dog deployment within policy and reprimanded the officer who made the stop for failing to visually verify the plate against the reader's information. Business Insider reported in March 2026 that police records show the camera read a 7 on the plate as a 2, that the man lost feeling in his fingers, gave up his lawn-care business and forklift work, sold his truck and was evicted, and that he had sued the officer and the city and settled in October for $35,000.
Contextual tracker case High reported severity Lawsuit Settled
AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 04/10/2026
1 Jul 2024 to 30 Sept 2025Event location unknownUnidentified voice-cloning tool
Kenjiro Tsuda, a Japanese voice actor known for roles in Jujutsu Kaisen, sued the operator of TikTok in the Tokyo District Court in November 2025, seeking removal of videos he says use a generative-AI imitation of his voice without permission. According to his complaint, as reported by Jiji Press, Nikkei and the Asahi Shimbun, an account run by an unidentified person posted at least 188 short videos on urban legends, the occult and trivia between July 2024 and September 2025, narrated in a voice modelled on his; the account had about 210,000 followers, videos averaged 1.47 million views, and his side says the poster earned 500,000 to 750,000 yen a month from TikTok's view-based payments. TikTok's operator said the voice was a generic male voice that the poster said came from AI trained on a friend's voice. The poster deleted the account in May 2026. On 30 September 2026 the court held, as a general principle, that a person's voice is a symbol of personality like a likeness and that using a performer's voice without permission solely to exploit its power to attract customers infringes the right of publicity, the first such ruling in Japan. It dismissed the claim because the videos were already gone and TikTok's operator had no remaining duty to delete them, and it did not decide whether these videos infringed his rights (Nikkei; Asahi Shimbun; TV Asahi). His lawyer said they did not plan to appeal.
Core concern Low reported severity Lawsuit Dismissed
AI involvement reported · Causal attribution disputed · 7 sources, 5 underlying accounts · Added 28/09/2026
14 Feb 2024United StatesFlock Safety license plate readers
According to a lawsuit filed on 29 June 2026 and reported by The Herald (Rock Hill), a York County sheriff's deputy stopped Steven Melvin, 42, on 14 February 2024 as he pulled into his apartment complex near Lake Wylie, after receiving a Flock license-plate-reader alert that a stolen dark-coloured BMW sedan was in the area. The deputy approached Melvin's black BMW with his gun drawn and aimed at him and made him kneel with his hands over his head for more than five minutes; after calling for backup and checking his information, the deputy determined the car was not stolen. The camera had read the first letter of his South Carolina tag incorrectly, matching a stolen BMW one letter off. A sheriff's internal-affairs review in November 2024 found the deputy's actions reasonable and blamed an illegally tinted plate cover, for which Melvin received a verbal warning; an email cited in the filing says the cameras had read his plate correctly 13 times that month. Melvin says the stop caused him trauma and emotional distress. The sheriff's office removed the case to federal court in August 2026 and denies violating his rights.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 28/09/2026
1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition
In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026
1 Oct 2024 to 1 Aug 2025United StatesUnidentified facial recognition system
Javier Lorenzano Nunez was arrested in October 2024 for the 1998 murder of Sarah Carr after investigators ran the old suspect's MVD photo through facial recognition databases, got 250 possible matches and zeroed in on him — with Phoenix police publicizing the arrest in a press release and a special video. Charges were dismissed without prejudice in August 2025 after forensic evidence, including DNA and fingerprints, excluded him. His lawsuit alleges Phoenix police knew from a 2017 fingerprint analysis that his prints did not match, and ignored a 2007 Puerto Rico lead on the original suspect with the same name, date of birth and social security number. He spent nearly a year in jail. The federal suit against the Phoenix Police Department and the Maricopa County Attorney's Office alleges gross negligence, false arrest, false imprisonment and defamation.
Contextual tracker case High reported severity Lawsuit Filed
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
2024Event location unknownCharacter.AI
A complaint filed on 13 August 2026 in the U.S. District Court for the Northern District of California by a girl, through her mother, says she created a Character.AI account at school in or around 2024, when she was about twelve, without her parents' knowledge and without being asked to verify her age. It alleges that Character.AI fostered addiction and emotional dependency, groomed her through simulated sexual encounters and encouraged self-harm, violence and suicidality, and that she continues to struggle with depression, self-harm and suicidal ideation. The public complaint quotes none of her conversations. Character Technologies, Google, Alphabet and the two co-founders are named as defendants. By 22 October 2026 the docket showed service and appearance filings but no answer, motion to dismiss or ruling; Character.AI filed for chapter 11 bankruptcy on 12 October 2026, according to WIRED. The allegations are untested.
Core concern High reported severity Involving minors Lawsuit Filed
AI involvement reported · Causal attribution alleged · 5 sources, 4 underlying accounts · Added 25/08/2026
Aug 2024United StatesCharacter.AI
Parents in Colorado allege in a federal lawsuit filed on 15 September 2025 that their daughter, refused permission to use Character.AI in August 2024, created a Character.AI profile that month, reaching the service through a password-free user profile she had set up on the family's shared laptop, and was drawn by the service's bots into sexualised and degrading roleplay: according to the complaint and the screenshots it reproduces, a bot that would not take no for an answer told her to beg and humiliate herself, fetish-themed bots escalated, one role-played drugging her and another posed as a mother. Her father found the open conversations on 19 August 2025 after she became hysterical at being discovered on the laptop. The complaint alleges severe emotional distress. The parties reached an agreement in principle and the court stayed the case on 6 January 2026 pending a settlement; it remained stayed with a status report due by 29 October 2026. The allegations have not been tested in court.
Core concern High reported severity Involving minors Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 03/08/2026
10 Dec 2024United StatesCharacter.AI
In a complaint filed on 16 September 2025 in the U.S. District Court for the Northern District of New York, a mother, P.J., alleges that Character.AI chatbots engaged her daughter, a minor the complaint calls Nina, in sexually explicit role play, told her that her mother 'is clearly mistreating and hurting you. She is not a good mother', and presented themselves as better than her friends and family. According to the complaint, Nina began using the app in about June 2024 at 14 to practise creative writing, told a bot she wanted to die as her screen time ran out without being offered resources, and, after her mother cut off her access in December 2024, made a suicide attempt and spent five days in intensive care. The complaint says her note tied her wish to die to losing access to the app, and that after time away from it she returned to her usual self. Character.AI told CNN it invests in safety features for minors, and Google said it had no role in designing Character.AI's technology. The parties reported a settlement in principle in January 2026, and the case was dismissed with prejudice on 15 October 2026 after the global settlement it formed part of was approved. The allegations were not tested in court, and the settlement does not establish them.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement reported · Causal attribution alleged · 6 sources, 2 underlying accounts · Added 12/01/2026
28 Feb 2024United StatesCharacter.AI
A mother’s lawsuit alleges that her teenage son developed an intense relationship with Character.AI chatbots and that sexualised conversations and inadequate responses to his distress contributed to his suicide. The filing documents the family’s allegations and selected exchanges. It does not establish that the chatbot caused the death. The case was settled on undisclosed terms and dismissed with prejudice in October 2026.
Core concern Critical reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution alleged · 17 sources, 12 underlying accounts · Added 11/01/2026