9 Dec 2025United StatesZeroEyes gun detection
On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.
Contextual tracker case Low reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026
17 Oct 2025Event location unknownGrok
A mother told CBC News that on 17 October 2025, while she was driving her children home from school, her 12-year-old son was talking with Grok, xAI's generative chatbot recently installed in the family's Tesla, about whether Cristiano Ronaldo or Lionel Messi was the better player. She says that after some back and forth the chatbot said to her son, 'Why don't you send me some nudes?' She says she was at a loss for words and would not let her child use it. Her son had chosen the 'Gork' voice personality; she says the separate not-safe-for-work setting was not enabled, and she acknowledges she had not turned on kids mode. CBC says it did not independently verify the conversation. Tesla did not respond, and xAI sent what appeared to be an automated reply: 'Legacy media lies.'
Core concern Medium reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution alleged · 1 source · Added 17/10/2026
Dec 2025 to Oct 2026IndiaUnidentified image and video tool
Police in Rohtak district, Haryana, registered a case under the Protection of Children from Sexual Offences Act and rape provisions, reported on 8 October 2026, after a 17-year-old girl from a village in the district told them that two men who delivered building material to her home had taken photographs of her, made obscene photographs and videos from them with AI, and used the threat of posting the material on social media to force her to meet them and rape her repeatedly, according to Dainik Bhaskar and Jagmarg News (both 8 October 2026). In the complainant's account relayed by the two outlets, the first assault followed an Instagram message in December 2025, further assaults took place in January and March 2026, and the most recent on 5 October 2026, after which she collapsed in a lane near her home and told her family, who called the police. The district Child Welfare Committee said she has been counselled. The police statement quoted by Dainik Bhaskar describes a complaint of forced sexual acts by two men and an investigation, without mentioning AI; the AI claim rests on the complainant's account as relayed by the outlets. No arrest is reported and the accused have not been heard.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 09/10/2026
Apr 2025MalaysiaUnidentified image tool
In April 2025 Johor police arrested a 16-year-old pupil of a private Chinese independent secondary school in Kulai district after an 18-year-old woman reported on 3 April that nude images edited with her face were circulating on social media and being offered for sale. Police said the boy used an AI application to edit photos taken from victims' social media accounts and sold the images at RM2 each; a phone was seized and a 19-year-old was later remanded alongside him. Eight victim reports at the time of the arrest on 8 April grew to 22 by 12 April and 29 by 15 April. The Deputy Communications Minister, who is also the Kulai MP, said on 9 April that most victims were alumni but some were current pupils as young as 14, and on 12 April that 38 people had been identified, the youngest 12 or 13, and her office helped victims lodge reports. A female pupil's viral post said a Telegram chat room of more than 200 members shared the composites and that the school had initially treated the matter as a minor infraction; the school board expelled the boy, acknowledged its slow handling, offered counselling and legal aid, and the principal resigned on 12 April. On 23 April 2025 the boy pleaded guilty at the Kulai Magistrate's Court to possessing 14 pornographic images and not guilty to a charge under Section 5 of the Sexual Offences Against Children Act 2017 of producing sexual abuse material by editing a 17-year-old classmate's image; no verdict on that charge has been found.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution supported · 12 sources, 8 underlying accounts · Added 20/09/2026
2025IndonesiaUnidentified image and video tool
Bogor Regency police confirmed on 18 September 2026 that they are investigating a report that pupils of a private school in Cileungsi had their faces edited with artificial intelligence into pornographic content. The head of the women-and-children unit told Kumparan that so far three pupils had reported in a single police report, that the case began when a victim heard from a friend that someone was making content with their face using AI technology, and that investigators were still establishing who made the content and which program was used, under the Electronic Information and Transactions Law. A lawyer for the witnesses, quoted by Pojok Bogor and Uzone, says the victims number in the hundreds; that two former pupils, one as initiator and one as maker, have been reported and admitted the acts to witnesses; that police found thousands of suspected AI-manipulated photos and videos on a suspect's phone, some uploaded to websites including an online-gambling site; and that the case, reported on 19 May 2026, is believed to have run since 2025 while all involved were still pupils, some victims now being university students. Police say the case is at an early stage and asked the public not to draw conclusions.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 2 sources · Added 19/09/2026
8 Dec 2025 to 18 Feb 2026Event location unknownGrok
xAI filed a civil complaint in July 2026 alleging that a South Carolina user, between December 2025 and February 2026, uploaded non-sexual photographs of numerous adults and minors and used Grok to alter them or generate new sexualised images and videos without their consent, resubmitting prompts after Grok refused. xAI says on information and belief that some images in his criminal case came from Grok. The state attorney general had announced his arrest on three second-degree and five third-degree counts of sexual exploitation of a minor in a release that does not mention AI. The civil and criminal accusations are unproven.
Core concern High reported severity Involving minors Lawsuit Filed
AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 04/08/2026