{"meta":{"exportedAt":"2026-09-30T07:09:10.004Z","formatVersion":2,"selection":{"q":"","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"","response":"minors","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":3,"coverage":{"cases":3,"countries":1,"languages":1,"unknownLocation":0,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":0,"regulatory":0,"minors":3,"coreRelations":0,"contextualRelations":3,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-baltimore-county-md-school-ai-gun-alert-chip-bag-student-searched","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"after an AI-driven security system flagged the teen's empty bag of chips as a possible firearm","relation":"supports","source_id":"s1"},{"locator":"How did it come to be that we had police officers with guns drawn approaching a kid because of a bag of Doritos?","relation":"supports","source_id":"s3"},{"locator":"Omnilert AI Gun Detection System warned school leaders at Kenwood High School that a student had a gun.","relation":"supports","source_id":"s3"},{"locator":"Police officers responded to the school, searched the individual, and quickly confirmed that they were not in possession of any weapons.","relation":"supports","source_id":"s3"}],"assertion":"An AI gun detection system (Omnilert) alerted on a Kenwood High School student in Baltimore County, the object was a bag of chips and not a weapon, and police searched the student.","causal_attribution":"The reports connect the police response to the alert. The district and the vendor say the system operated as designed and that humans review alerts, so responsibility for the police response is contested between the system, the review steps and the responding staff."},{"id":"c2","status":"reported","evidence":[{"locator":"They made me get on my knees, put my hands behind my back, and cuffed me,","relation":"supports","source_id":"s1"},{"locator":"they had a gun pointed at me","relation":"supports","source_id":"s1"},{"locator":"handcuffed and searched","relation":"supports","source_id":"s2"}],"assertion":"The student reported being made to kneel, being handcuffed and searched, and having a gun pointed at them.","causal_attribution":"First-person account given to a local television station and relayed by the CNN wire and the Guardian (one chain). CNN also states the handcuffing in its own voice without naming a source other than the student interview. Police statements inspected confirm a search only."},{"id":"c3","status":"reported","evidence":[{"locator":"reviewed and canceled the gun detection alert after confirming there was no weapon","relation":"supports","source_id":"s1"},{"locator":"The principal didn't immediately realize the alert had been canceled","relation":"supports","source_id":"s1"},{"locator":"she reported the matter to Kenwood's school resource officer, who called local police for support","relation":"supports","source_id":"s1"},{"locator":"The Department of School Safety and Security reviewed and canceled the initial alert after confirming there was no weapon.","relation":"supports","source_id":"s3"}],"assertion":"The school district security department reviewed and canceled the alert after confirming there was no weapon. A district spokesperson said the principal did not immediately realize the alert had been canceled. The principal reported the matter to the school resource officer, who called police.","causal_attribution":"Account of the review sequence comes from the principal letter and district spokespeople. It attributes the police response to a communication gap after human review and does not exonerate the alert."},{"id":"c4","status":"reported","evidence":[{"locator":"Baltimore County officials say they want a review of the process that led to Monday's police response.","relation":"supports","source_id":"s1"},{"locator":"Baltimore County councilmembers are calling on school officials and police to review an A.I. gun detection system","relation":"supports","source_id":"s3"},{"locator":"Our counselors will provide direct support to the students who were involved in this incident","relation":"supports","source_id":"s2"}],"assertion":"County councilmembers called for a review of the AI system, and the school said counselors would support the students involved.","causal_attribution":"Institutional responses reported by the outlets. The outcome of any review is not established in the inspected sources."}],"effects":[{"label":"Student searched by armed police after a false AI weapon alert","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://abc7.com/post/student-handcuffed-doritos-bag-mistaken-gun-schools-ai-security-system-baltimore-county-maryland/18073796/","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"wbal-relay"},{"id":"s2","url":"https://www.theguardian.com/us-news/2025/oct/24/baltimore-student-ai-gun-detection-system-doritos","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"wbal-relay"},{"id":"s3","url":"https://www.cbsnews.com/baltimore/news/false-alarm-gun-detection-kenwood-maryland-artificial-intelligence-review/","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"wjz-cbs-baltimore"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","public_services"],"unknowns":["Event date is derived from the reports' \"Monday\" references relative to their publication dates (23 to 26 October 2025). The inspected bodies do not print the calendar date of the event.","The handcuffing and gun-pointing account is one first-person account relayed by two outlets, and CNN also states the handcuffing in its own voice without another named source. Police statements inspected confirm only a search after a report of a suspicious person with a weapon.","The outcome of the county review is not reported in the inspected sources.","The student's exact age is not stated. Sources call the student a teen and a child.","Vendor and district statements say the system worked as designed and that humans review alerts. Whether the review step or the alert caused the police dispatch is not settled."],"geography":{"basis":"The reports place the event at a high school in Baltimore County, Maryland, with the county police department and county council responding. Country is stated by place names in the inspected reports and is not inferred from outlet or vendor headquarters.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Three news reports read in full (one via Internet Archive capture). The AI alert, the absence of a weapon and the search are separately reported. The handcuffing account is attributed to the student. The student's name is omitted because the student is a minor.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"Two separately reported chains say the AI alert flagged the object: the CNN wire with a vendor statement (its student account is WBAL-derived, as is the Guardian, a WBAL relay), and local CBS reporting with vendor and superintendent statements. Both also report human review steps between the alert and the police response.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Baltimore County, Maryland: school AI gun alert on a bag of chips leads to police search of a student","summary":"On a Monday evening in October 2025 (20 October by the reports' weekday references) an AI gun detection system (Omnilert) used at Kenwood High School alerted on a student holding an empty bag of chips. Police responded and searched the student and found no weapon. The student told a local television station that officers made them kneel, handcuffed them and pointed a gun at them. The school district says its security department reviewed and canceled the alert after confirming there was no weapon, and a district spokesperson said the principal did not immediately realize the alert had been canceled. County councilmembers called for a review. No outcome of a review is established in the sources.","incidentDate":"2025-10-20","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-10-23","aiSystem":"Omnilert AI Gun Detection System (video analytics on school security cameras)","aiProduct":"Omnilert gun detection","aiCompany":"Omnilert","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["loss_of_liberty","psychological_distress"],"harmOutcomeSummary":"A student was searched by police after the AI alert and reported being handcuffed at gunpoint and fearing for their life (student account relayed by CNN and the Guardian). The school letter confirms a search and offers counseling.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"One student who was searched. Other students who witnessed the event are mentioned in the school letter but are not counted without a reported harm to each.","victimAgeRange":"minor","platformType":"other","primarySourceUrl":"https://www.cbsnews.com/baltimore/news/false-alarm-gun-detection-kenwood-maryland-artificial-intelligence-review/","primarySourceLabel":"CBS Baltimore (WJZ): A.I. gun detection false alarm at school has Baltimore County leaders calling for review, 23 October 2025","firstPublishedAt":"2026-09-29T12:42:19.255568+00:00","updatedAt":"2026-09-30T01:16:56.487109+00:00","scopeVersion":"facts-v3","tags":["historical-2025"]},{"id":"2025-deltona-florida-gaggle-alert-student-arrest-school-laptop-threat","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"Deputies said a 15-year-old wrote a threat on his school laptop to bring a gun to ... and shoot another student.","relation":"supports","source_id":"s1"},{"locator":"The threat triggered a Gaggle alert, which notified the school resource deputy, who responded and detained the teen before he got on the bus to go home.","relation":"supports","source_id":"s1"},{"locator":"That threat triggered a Gaggle alert and immediately notified the school resource deputy.","relation":"supports","source_id":"s2"}],"assertion":"On 12 September 2025 a 15-year-old high school student in Deltona, Florida was detained after typing a threat on a school-issued laptop to bring a gun to school and shoot another student, and a Gaggle alert notified the school resource deputy, who detained the student before boarding the bus home.","causal_attribution":"Police account relayed by two outlets that trace to one Sheriff's Office statement. The alert is reported as the trigger of the deputy's response."},{"id":"c2","status":"reported","evidence":[{"locator":"Both students were arrested on second-degree felony charges and transported to the Volusia Family Resource Center for processing.","relation":"supports","source_id":"s1"},{"locator":"They will be charged with second-degree felony charges, VSO said.","relation":"supports","source_id":"s2"}],"assertion":"The student was arrested on a second-degree felony charge.","causal_attribution":"Arrest follows the alert and detention in the police account. The source does not separate the alert from the content of the text as cause. Fox 35 says the students 'will be charged'; the filed charge is not confirmed."},{"id":"c3","status":"reported","evidence":[{"locator":"The teen admitted he typed the threat, didn’t mean it, and was just angry about being picked on.","relation":"supports","source_id":"s1"}],"assertion":"The student admitted typing the threat, said it was not meant, and said the motive was anger about being picked on.","causal_attribution":"Reported statement from the Sheriff's Office. It is not an independent account by the student or family."},{"id":"c4","status":"reported","evidence":[{"locator":"With the help of artificial intelligence , technology can dip into online conversations and immediately notify both school officials and law enforcement.","relation":"supports","source_id":"s3"}],"assertion":"Associated Press reporting describes school-monitoring software 'like Gaggle and Lightspeed Alert' as using artificial intelligence to watch students' online conversations and notify school officials and law enforcement.","causal_attribution":"Description of a software class. It does not establish the mechanism of the alert in this case."}],"effects":[{"label":"Felony arrest of a minor following an automated alert","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.wesh.com/article/volusia-county-school-threats-mental-health-awareness/66929047","kind":"news_report","access":"read","language":"en","translation_note":"Body read from a Wayback capture of the same URL because the live page returned 451.","independence_group":"vso-volusia-2025-09-12"},{"id":"s2","url":"https://www.fox35orlando.com/news/two-volusia-county-students-arrested-school-threats-officials-say","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"vso-volusia-2025-09-12"},{"id":"s3","url":"https://www.yahoo.com/news/articles/schools-using-ai-surveillance-protect-110342650.html","kind":"news_report","access":"read","language":"en","translation_note":"Associated Press investigation on AI school surveillance, cited only for the description of software like Gaggle. It does not mention this student.","independence_group":"ap-ai-surveillance-2025"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","justice"],"unknowns":["Whether the alert in this case was generated by an AI model, by keyword rules, or reviewed by a Gaggle or school human reviewer before reaching the deputy.","Outcome of the felony charge, any court or school discipline, and the family's account.","The Sheriff's Office statement (a Facebook post per Fox 35) was read only through outlet rewrites.","Whether the student's family disputes the arrest is not reported."],"geography":{"basis":"Sources place the events at a high school in Deltona, Volusia County, Florida, and name the county Sheriff's Office.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Three inspected news bodies: two rewrites of one Sheriff's Office statement for the event and one AP piece for the product description. The record states the police account as reported and does not treat the alert as established cause of the arrest.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"Sheriff's Office account carried by local outlets says a Gaggle alert notified the deputy. AP reporting describes monitoring software like Gaggle as AI-assisted in general. No source states how this specific alert was generated or reviewed.","status":"reported"},"person_relations":["made_claim_about"]},"name":"Deltona, Florida: Gaggle school-laptop alert leads to felony arrest of a 15-year-old over a typed gun threat the student said was not serious","summary":"According to a Volusia County Sheriff's Office account carried by local outlets, a 15-year-old high school student in Deltona, Florida was arrested on 12 September 2025 after typing a written threat to bring a gun to school on a school-issued laptop. The Gaggle student-monitoring software raised an alert that notified the school resource deputy, who detained the student before the student boarded the bus home. The student was arrested on a second-degree felony charge (one outlet says the charge was still to be filed). The student reportedly admitted typing the text, said it was not meant seriously and said the motive was anger about being picked on. Outcome of the charge and the exact Gaggle role in generating this alert are not reported.","incidentDate":"2025-09-12","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-09-13","aiSystem":"Gaggle, a student-safety monitoring service for school-provided devices (school-monitoring software of the kind Associated Press reporting describes as using artificial intelligence)","aiProduct":"Gaggle school monitoring","aiCompany":"Gaggle","severity":"medium","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["loss_of_liberty","legal_harm"],"harmOutcomeSummary":"The Sheriff's Office says a Gaggle alert on the student's typed threat led a deputy to detain the student before the bus ride home, and the student was arrested on a second-degree felony charge (police account; the student reportedly said the text was not meant seriously).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"One student (the 15-year-old arrested). The other Volusia students arrested in the same days are not counted: the sources tie a Gaggle alert only to this student.","victimAgeRange":"minor","platformType":"other","primarySourceUrl":"https://www.wesh.com/article/volusia-county-school-threats-mental-health-awareness/66929047","primarySourceLabel":"WESH 2, Volusia County deputies arrest four children accused of making school threats","firstPublishedAt":"2026-09-29T12:42:12.865194+00:00","updatedAt":"2026-09-30T01:17:00.789359+00:00","scopeVersion":"facts-v3","tags":["historical-2025"]},{"id":"2026-utah-meta-ai-suggested-prompts-children-profile","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'Meta AI posed a series of invasive prompts under the video, such as \"Who's the child passenger?\" and \"Where does Kalie Robins live?\"'; 'pulled information from her past posts ... including her location'; 'drew on other profiles, such as her mother's account'.","relation":"supports","source_id":"s1"},{"locator":"'Who's the child passenger?'; 'their names, birth information, pictures and videos of them'; 'It pieced together my information to show people where I live'.","relation":"supports","source_id":"s3"},{"locator":"'suggested questions aimed at uncovering information about her children — including their names, birthdates, videos, newborn photos, even photos that had been deleted — and, ultimately, her live location'.","relation":"supports","source_id":"s2"}],"assertion":"Meta AI suggested prompts under Robins's 1 September car video including 'Who's the child passenger?' and 'Where does Kalie Robins live?', and clicking them produced her daughters' names, birth details, photos and videos from her own and relatives' posts, and assembled her likely location.","causal_attribution":"Robins's account given in separate interviews to CNET, NewsNation and Futurism; Meta does not dispute that the prompts were generated."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'A Meta spokesperson told CNET in an email that it \"fixed\" the issue and that Meta AI will no longer suggest inappropriate, personal questions on users' posts'.","relation":"supports","source_id":"s1"},{"locator":"'\"While the content was available to this user, these prompts should never have been generated,\" Meta spokesperson Dina El-Kassaby said, according to The Verge'.","relation":"supports","source_id":"s4"},{"locator":"'its AI search feature \"missed the mark\"'; '\"fixed that issue\"'.","relation":"supports","source_id":"s3"}],"assertion":"Meta said the prompts 'missed the mark' and 'should never have been generated', that responses draw only on information the user can already access, and that it fixed the issue so Meta AI no longer suggests personal questions about people in posts.","causal_attribution":"Meta statements to three outlets."},{"id":"c3","status":"disputed","evidence":[{"locator":"'Meta also denied Robins' claim that its AI accessed a photo deleted years ago. Instead, Meta told CNET that the photo of Robins' kids was deleted right before the video was made and that a temporary bug briefly kept it visible. Robins disputed this'.","relation":"supports","source_id":"s1"}],"assertion":"Robins says one surfaced photo had been deleted years earlier; Meta says the photo was deleted shortly before the video and remained briefly visible because of a temporary bug.","causal_attribution":"Competing accounts from Robins and Meta reported by CNET."}],"effects":[{"label":"Meta AI prompts compiled a mother's young daughters' names, birth details and photos and her likely location; the mother reported distress and lost trust; Meta changed the feature","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.cnet.com/tech/services-and-software/meta-ai-viral-video-personal-prompts-about-kids/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 (CNET, 12 Sep 2026). Direct interview with Robins plus Meta's emailed statement to CNET and its dispute of the deleted-photo detail.","independence_group":"cnet"},{"id":"s2","url":"https://www.newsnationnow.com/business/tech/ai/mom-meta-ai-analyzing-posts-about-kids/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 via the MSN content API copy (NewsNation, 17 Sep 2026; the newsnationnow.com host returns 403 to this box). Interview with Robins including the distress quotation.","independence_group":"newsnation"},{"id":"s3","url":"https://torontosun.com/news/world/utah-mom-sounds-alarm-after-meta-ai-digs-up-details-about-her-children-im-done","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 via the MSN content API copy (Toronto Sun, 15 Sep 2026). Relays Futurism's interview and Meta's statement to Futurism; treated as the Futurism chain.","independence_group":"futurism"},{"id":"s4","url":"https://www.dexerto.com/entertainment/meta-changes-ai-prompts-after-chatbot-asked-mother-to-identify-her-child-3408508/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 (Dexerto, 12 Sep 2026). Relays The Verge's report of Meta spokesperson Dina El-Kassaby's statement; treated as The Verge chain.","independence_group":"verge"}],"version":1,"ai_roles":["own_use","institutional_use"],"contexts":["privacy","everyday_life","relationships"],"unknowns":["What Meta changed and how many other users saw similar prompts about children is not disclosed.","Whether the compiled information was shown to anyone other than Robins is not established.","No regulator has announced an inquiry in the inspected sources."],"geography":{"basis":"Robins is described as a Utah mother (Toronto Sun/Futurism; TRT Haber); the posts and prompts occurred on her US Instagram/Facebook accounts. No court.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as a privacy and made-claim-about case: an AI feature compiled identifying details about two young children and a named adult's location, the adult reported distress and loss of control, and the company acknowledged the prompts should not have been generated. Four sources across four reporting chains read; the children's details are not reproduced. Low severity.","reviewed_on":"2026-09-18"},"ai_involvement":{"basis":"Meta acknowledged to CNET and The Verge that its AI generated the suggested prompts and that they 'should never have been generated', and said it fixed the issue. The AI made claims about identified people (the children's identities and the mother's location) rather than conversing with them; the mother's clicks on the prompts are recorded as own_use, and the platform's default feature as institutional_use.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Utah: Meta AI's suggested prompts under a mother's Instagram video compiled her young daughters' names, birth details and old photos and her likely home location; Meta said the prompts 'missed the mark' and changed the feature","summary":"On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.","incidentDate":"2026-09-02","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2026-09-10","aiSystem":"Meta AI (suggested-question prompts under Instagram and Facebook posts, drawing on the user's and related accounts' content)","aiProduct":"Meta AI","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"A mother experienced distress and a loss of control over her children's privacy after Meta AI's suggested prompts compiled her two young daughters' identifying details and her likely location from scattered family posts; Meta acknowledged the prompts should not have been generated and changed the feature.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":2,"affectedCountStatus":"exact","affectedCountEvidence":"Kalie Robins (who used the prompts and reported distress) and her two daughters, whose identifying details were compiled. Exact count of three; her mother and other relatives whose posts were drawn on are not counted as harmed.","victimAgeRange":"minor","jurisdiction":"US","platformType":"assistant","outcomeType":"internal_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.cnet.com/tech/services-and-software/meta-ai-viral-video-personal-prompts-about-kids/","primarySourceLabel":"CNET, 12 Sep 2026: Mother calls for 'accountability' after Meta AI mines family posts for info on minors (interview with Kalie Robins; Meta statement)","firstPublishedAt":"2026-09-18T03:25:15.671921+00:00","updatedAt":"2026-09-30T01:17:58.137201+00:00","scopeVersion":"facts-v3","tags":["meta-ai","instagram","facebook","privacy","children","profiling","suggested-prompts","united-states","utah","made-claim-about"]}]}