9 Dec 2025United StatesZeroEyes gun detection
On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.
Contextual tracker case Low reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026
Aug 2026ChinaUnidentified symptom-analysis tool
A Guangming Daily feature on AI symptom-checking, republished by Bingtuan Daily on Sina Finance on 8 October 2026, recounts a case from August 2026 in Zhejiang and closes it with a quotation from the head of paediatrics at a provincial hospital, who says the family did not heed the doctor's advice. A three-year-old boy with a history of asthma was brought in; his mother had entered keywords such as allergy, asthma, cough and night-time wheezing into an AI tool, which quickly returned a diagnosis of an acute bronchial asthma attack. On that basis, the account says, she declined the chest X-ray the doctor recommended and insisted on taking home only nebuliser medication. Two days later the child's condition worsened with rapid breathing; on an overnight return to the hospital, examination found extensive inflammatory lesions in both lungs, and he was diagnosed with human metapneumovirus pneumonia with a superimposed bacterial infection and admitted as an emergency. The paediatrics head is quoted saying the illness would not have become so severe had the family listened earlier. The AI tool is not named. The case is told in the newspaper's voice, and the feature does not say where its account came from beyond the paediatrics head's quotation; no statement from the family is reported.
Contextual tracker case Medium reported severity Involving minors
AI involvement reported · Causal attribution alleged · 1 source · Added 09/10/2026
2 Aug 2020United StatesUnidentified license plate reader
On 2 August 2020 Aurora police officers stopped an SUV they believed to be stolen, ordered the woman driving it and four children to lie on the ground at gunpoint, and handcuffed two of the children. The Denver Post reported that a license plate reader at an Aurora intersection had alerted police because the SUV had the same plate number as a stolen motorcycle from Montana, and that officers did not check the reading or the vehicle description. Prosecutors declined to charge the officers in January 2021 and called what happened unacceptable and preventable. The department said all officers were repeating training on license plate scanners. Sentinel Colorado reported that the department's system had flagged the SUV, which carried Colorado plates, and that the City of Aurora agreed in February 2024 to a $1.9 million settlement with the woman and the children to resolve a lawsuit over the officers' actions. One officer was suspended for 160 hours. The woman said the stop destroyed her mentally and that one of the children became withdrawn.
Contextual tracker case Medium reported severity Involving minors Lawsuit Settled
AI involvement reported · Causal attribution supported · 2 sources · Added 05/10/2026
2 Sept 2026United StatesMeta AI
On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.
Contextual tracker case Low reported severity Involving minors Internal Action
AI involvement supported · Causal attribution supported · 4 sources · Added 18/09/2026
Mar 2017IrelandSimSimi
In late March 2017 the SimSimi chatbot app, which answers typed text with replies other users have taught it, topped Irish download charts while schools in the Republic of Ireland sent letters and text messages warning parents that pupils' names were being linked to insulting replies (The Irish Times, 26 March 2017). A parent told TheJournal.ie that she and other parents had searched their children's names and found vile comments on each, and that the company said her request would take 15 days to handle. A Dublin secondary teacher told the BBC that primary pupils who typed in their names received personal insults, and that a friend of her 15-year-old son found something mean every time he looked up his name, which hurt him a lot and left him very down. Police in County Down posted a warning on Facebook. From 29 March 2017 the app answered users in Ireland with "I do not talk in Ireland for a while", while remaining available in Northern Ireland. The South Korean developer did not respond to the outlets' requests for comment, and no inspected source says whether access was later restored.
Core + contextual relations Medium reported severity Involving minors Internal Action
AI involvement reported · Causal attribution supported · 7 sources, 4 underlying accounts · Added 12/01/2026