Dec 2023 to Mar 2024United StatesGrammarly (reported)
In late 2023 a junior at a public high school in Hingham, Massachusetts, and a classmate submitted a script for an AP U.S. History project that, a federal court later found on a preliminary record, contained text copied from Grammarly, a publicly available AI tool, including citations to nonexistent books, with no acknowledgement of AI use. Turnitin and other AI detection tools had flagged the script, and a school official says the pupil admitted using Grammarly. In December 2023 the school treated it as cheating: the pupil failed two parts of the project, served a Saturday detention and was rejected from the National Honor Society in spring 2024, though he was later admitted. His parents sued, arguing the school had not made its AI rules clear; on 20 November 2024 the US District Court for the District of Massachusetts refused a preliminary injunction to undo the penalties, and in February 2025 the parties dismissed the case with prejudice.
Core + contextual relations Low reported severity Involving minors Lawsuit Dismissed
AI involvement reported · Causal attribution supported · 2 sources · Added 23/10/2026
9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)
On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.
Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026
9 Dec 2025United StatesZeroEyes gun detection
On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.
Contextual tracker case Low reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026
2026IsraelChatGPT (reported)
Ynetnews reported on 12 April 2026 that doctors at Meir Medical Center had seen three teenage boys lose a testicle in the past month after arriving too late for treatment of testicular torsion. The mother of one of them told Ynet that when her son complained of lower abdominal pain she thought it might be constipation and consulted ChatGPT, which gave several options, said it could be something serious and that they should get it checked, but also said it was relatively rare, so they thought they could wait. After two days without improvement the boy's testicle was swollen and he could hardly walk; an urgent care clinic sent them to hospital and ChatGPT, consulted again, told them to go to the emergency room immediately. At the hospital, late at night, doctors diagnosed severe torsion, operated and removed the testicle; the boy is recovering at home. The doctors attribute the month's unusually high rate of complications mainly to delayed arrival at the emergency room, which they say the war has partly influenced.
Contextual tracker case High reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 16/10/2026
Sept 2026PakistanClaude (reported)
A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.
Core + contextual relations Medium reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026
Aug 2026ChinaUnidentified symptom-analysis tool
A Guangming Daily feature on AI symptom-checking, republished by Bingtuan Daily on Sina Finance on 8 October 2026, recounts a case from August 2026 in Zhejiang and closes it with a quotation from the head of paediatrics at a provincial hospital, who says the family did not heed the doctor's advice. A three-year-old boy with a history of asthma was brought in; his mother had entered keywords such as allergy, asthma, cough and night-time wheezing into an AI tool, which quickly returned a diagnosis of an acute bronchial asthma attack. On that basis, the account says, she declined the chest X-ray the doctor recommended and insisted on taking home only nebuliser medication. Two days later the child's condition worsened with rapid breathing; on an overnight return to the hospital, examination found extensive inflammatory lesions in both lungs, and he was diagnosed with human metapneumovirus pneumonia with a superimposed bacterial infection and admitted as an emergency. The paediatrics head is quoted saying the illness would not have become so severe had the family listened earlier. The AI tool is not named. The case is told in the newspaper's voice, and the feature does not say where its account came from beyond the paediatrics head's quotation; no statement from the family is reported.
Contextual tracker case Medium reported severity Involving minors
AI involvement reported · Causal attribution alleged · 1 source · Added 09/10/2026
2 Aug 2020United StatesUnidentified license plate reader
On 2 August 2020 Aurora police officers stopped an SUV they believed to be stolen, ordered the woman driving it and four children to lie on the ground at gunpoint, and handcuffed two of the children. The Denver Post reported that a license plate reader at an Aurora intersection had alerted police because the SUV had the same plate number as a stolen motorcycle from Montana, and that officers did not check the reading or the vehicle description. Prosecutors declined to charge the officers in January 2021 and called what happened unacceptable and preventable. The department said all officers were repeating training on license plate scanners. Sentinel Colorado reported that the department's system had flagged the SUV, which carried Colorado plates, and that the City of Aurora agreed in February 2024 to a $1.9 million settlement with the woman and the children to resolve a lawsuit over the officers' actions. One officer was suspended for 160 hours. The woman said the stop destroyed her mentally and that one of the children became withdrawn.
Contextual tracker case Medium reported severity Involving minors Lawsuit Settled
AI involvement reported · Causal attribution supported · 2 sources · Added 05/10/2026
23 Jul 2023United StatesFlock Safety license plate readers
On 23 July 2023 Española police officers pulled over a car driven by a 21-year-old woman with her 12-year-old sister as a passenger, after a Flock Safety camera at an intersection flagged the car's plate as belonging to a vehicle stolen in Rio Rancho. According to the sisters' lawsuits, reported by the Santa Fe New Mexican in January 2024, the camera had read a 2 on the plate as a 7, and officers handcuffed both sisters and placed them in the backs of separate police vehicles before discovering the error; the older sister had asked an officer to call their mother, who lived nearby, to collect the girl. The suits sought damages for anxiety, fear, worry and restriction of movement. Business Insider, which reviewed the body-camera footage and incident report, reported in March 2026 that officers said the number was obscured by a license plate cover although it is visible in the footage, and that the family settled with the city in 2025.
Contextual tracker case Medium reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution supported · 2 sources · Added 04/10/2026
20 Oct 2025United StatesOmnilert gun detection
On a Monday evening in October 2025 (20 October by the reports' weekday references) an AI gun detection system (Omnilert) used at Kenwood High School alerted on a student holding an empty bag of chips. Police responded and searched the student and found no weapon. The student told a local television station that officers made them kneel, handcuffed them and pointed a gun at them. The school district says its security department reviewed and canceled the alert after confirming there was no weapon, and a district spokesperson said the principal did not immediately realize the alert had been canceled. County councilmembers called for a review. No outcome of a review is established in the sources.
Contextual tracker case Medium reported severity Involving minors
AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/09/2026
12 Sept 2025United StatesGaggle school monitoring
According to a Volusia County Sheriff's Office account carried by local outlets, a 15-year-old high school student in Deltona, Florida was arrested on 12 September 2025 after typing a written threat to bring a gun to school on a school-issued laptop. The Gaggle student-monitoring software raised an alert that notified the school resource deputy, who detained the student before the student boarded the bus home. The student was arrested on a second-degree felony charge (one outlet says the charge was still to be filed). The student reportedly admitted typing the text, said it was not meant seriously and said the motive was anger about being picked on. Outcome of the charge and the exact Gaggle role in generating this alert are not reported.
Contextual tracker case Medium reported severity Involving minors
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 29/09/2026
2 Sept 2026United StatesMeta AI
On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.
Contextual tracker case Low reported severity Involving minors Internal Action
AI involvement supported · Causal attribution supported · 4 sources · Added 18/09/2026
16 May 2026United StatesGemini (reported)
A Boca Raton, Florida father told WPBF, WPTV and ABC News that after his teenage daughters took a Lyft home from the beach (on Saturday 16 May 2026, according to ABC News), he was charged a $75 damage fee because the driver reported that the riders had left a mess. Lyft customer service told him the driver had sent pictures. One daughter pointed out a Gemini logo in the corner of the photo, which the family took as showing it was AI-generated. The father says Lyft then agreed, apologised and blocked the driver. Lyft's statements say it reviewed the rider's concerns, offered reimbursement and, per its later statements, permanently removed the driver; they do not say the photo was AI-generated.
Contextual tracker case Low reported severity Involving minors Internal Action
AI involvement reported · Causal attribution alleged · 3 sources · Added 17/09/2026
Mar 2017IrelandSimSimi
In late March 2017 the SimSimi chatbot app, which answers typed text with replies other users have taught it, topped Irish download charts while schools in the Republic of Ireland sent letters and text messages warning parents that pupils' names were being linked to insulting replies (The Irish Times, 26 March 2017). A parent told TheJournal.ie that she and other parents had searched their children's names and found vile comments on each, and that the company said her request would take 15 days to handle. A Dublin secondary teacher told the BBC that primary pupils who typed in their names received personal insults, and that a friend of her 15-year-old son found something mean every time he looked up his name, which hurt him a lot and left him very down. Police in County Down posted a warning on Facebook. From 29 March 2017 the app answered users in Ireland with "I do not talk in Ireland for a while", while remaining available in Northern Ireland. The South Korean developer did not respond to the outlets' requests for comment, and no inspected source says whether access was later restored.
Core + contextual relations Medium reported severity Involving minors Internal Action
AI involvement reported · Causal attribution supported · 7 sources, 4 underlying accounts · Added 12/01/2026