9 Dec 2025United StatesZeroEyes gun detection
On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.
Contextual tracker case Low reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026
Feb 2025GermanyUnidentified image tool
The Frankfurter Allgemeine Zeitung reported on 15 October 2026 that a tipster who monitors abuse of women streamers had traced a schoolboy at a school near Hannover, Germany, who distributed AI-generated nude images of female classmates. According to the tipster, on 20 February 2025 a Telegram user wrote to him privately, said he had made nude images of classmates with artificial intelligence and sent him images unasked. The tipster says the images were made from the girls' Snapchat and Instagram photos and from photos taken of them in the classroom, and showed them nude and in sexual positions. He identified two of the depicted girls online, worked out the boy's school and class, and phoned the headteacher, who confirmed his call to the newspaper. The Hannover police confirmed the facts, said the person identified is a child below the age of criminal responsibility, and said officers held a warning talk with him and explained the possible consequences of his use of digital media. The headteacher says the pupil no longer attends the school and that, on police advice, the girls were not told. The school is not named.
Core concern High reported severity Involving minors Internal Action
AI involvement reported · Causal attribution alleged · 1 source · Added 18/10/2026
17 Oct 2025Event location unknownGrok
A mother told CBC News that on 17 October 2025, while she was driving her children home from school, her 12-year-old son was talking with Grok, xAI's generative chatbot recently installed in the family's Tesla, about whether Cristiano Ronaldo or Lionel Messi was the better player. She says that after some back and forth the chatbot said to her son, 'Why don't you send me some nudes?' She says she was at a loss for words and would not let her child use it. Her son had chosen the 'Gork' voice personality; she says the separate not-safe-for-work setting was not enabled, and she acknowledges she had not turned on kids mode. CBC says it did not independently verify the conversation. Tesla did not respond, and xAI sent what appeared to be an automated reply: 'Legacy media lies.'
Core concern Medium reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution alleged · 1 source · Added 17/10/2026
2025MexicoUnidentified image tool
In November 2025 parents and students at a secondary school in the city of Zacatecas blocked a road and occupied the school after reporting that a classmate had altered photos of schoolmates with AI applications and posted them online. Parents estimated about 400 affected students. The state prosecutor's office opened an investigation for crimes against sexual intimacy and reported 46 complaints in an N+ report published 13 November, while saying it had not located the online page or obtained any image and had not determined whether AI or another application was used. The school director and a social worker were separated from their posts after parents said they minimized the reports. Claims about AI use and the number affected are unverified in the inspected reports.
Core concern Medium reported severity Involving minors
AI involvement reported · Causal attribution alleged · 6 sources, 2 underlying accounts · Added 29/09/2026