2024United StatesGaggle
The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026
2024GermanyMicrosoft Copilot
A court reporter from the Tübingen area found in 2024 that Microsoft's Copilot, asked about him, described him as a man charged in a child abuse case, an escapee from a psychiatric institution and a fraudster who cheated widows, according to his account to the public broadcaster SWR as relayed by heise and ComputerBild. All were defendants in trials he had covered as a journalist. heise and ComputerBild, both citing SWR, report that Copilot also gave his private phone number and full home address and offered a route there. He told The Register that seeing his name tied to these crimes was traumatising and that prosecutors had rejected his criminal complaint in two instances; according to the SWR account relayed by heise, the complaint failed because no real person was the author. After the Bavarian data-protection authority contacted Microsoft the claims were briefly unavailable and then returned. Microsoft told The Register it had investigated and taken appropriate and immediate action.
Contextual tracker case Medium reported severity Internal Action
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 25/10/2026
13 Apr 2024BrazilUnidentified facial recognition system
During the half-time interval of the Sergipe state football championship final at the Batistão stadium in Aracaju on 13 April 2024, military police took a personal trainer from the stands to a police room after the stadium's facial recognition system flagged him as a man with an open arrest warrant; he was searched and questioned and released once police confirmed he was not the person sought (G1, his lawyer and the military police). Sergipe's governor publicly regretted 'the failure of the facial recognition tool' and suspended its use until a new protocol was adopted. In June 2024 the man sued the state for 550,000 reais in moral damages; the state argued that the Aracaju municipality, not the state, had contracted the system. In December 2025 the judge rejected that preliminary objection, according to Mangue Jornalismo, which read the court file. No final judgment is reported.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 24/10/2026
23 Sept 2024CanadaOtter.ai (reported)
An Ontario hospital reported to the provincial privacy commissioner that on 23 September 2024 the Otter.ai transcription tool, installed on a personal device by a physician who had left the hospital in June 2023 and was still on the meeting invite, joined a virtual hepatology rounds meeting, recorded it without notice and then emailed a summary and transcript access to the invite list. The personal health information of seven patients, including diagnoses and treatment, was captured; 12 of the 65 recipients appeared to have left the hospital. The commissioner's letter of 27 October 2025 recommended that the hospital itself ask Otter.ai to delete the retained patient data.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 21/10/2026