{"meta":{"exportedAt":"2026-09-30T07:16:31.379Z","formatVersion":2,"selection":{"q":"x","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"","response":"minors","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":1,"languages":1,"unknownLocation":0,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":0,"regulatory":0,"minors":2,"coreRelations":0,"contextualRelations":2,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-deltona-florida-gaggle-alert-student-arrest-school-laptop-threat","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"Deputies said a 15-year-old wrote a threat on his school laptop to bring a gun to ... and shoot another student.","relation":"supports","source_id":"s1"},{"locator":"The threat triggered a Gaggle alert, which notified the school resource deputy, who responded and detained the teen before he got on the bus to go home.","relation":"supports","source_id":"s1"},{"locator":"That threat triggered a Gaggle alert and immediately notified the school resource deputy.","relation":"supports","source_id":"s2"}],"assertion":"On 12 September 2025 a 15-year-old high school student in Deltona, Florida was detained after typing a threat on a school-issued laptop to bring a gun to school and shoot another student, and a Gaggle alert notified the school resource deputy, who detained the student before boarding the bus home.","causal_attribution":"Police account relayed by two outlets that trace to one Sheriff's Office statement. The alert is reported as the trigger of the deputy's response."},{"id":"c2","status":"reported","evidence":[{"locator":"Both students were arrested on second-degree felony charges and transported to the Volusia Family Resource Center for processing.","relation":"supports","source_id":"s1"},{"locator":"They will be charged with second-degree felony charges, VSO said.","relation":"supports","source_id":"s2"}],"assertion":"The student was arrested on a second-degree felony charge.","causal_attribution":"Arrest follows the alert and detention in the police account. The source does not separate the alert from the content of the text as cause. Fox 35 says the students 'will be charged'; the filed charge is not confirmed."},{"id":"c3","status":"reported","evidence":[{"locator":"The teen admitted he typed the threat, didn’t mean it, and was just angry about being picked on.","relation":"supports","source_id":"s1"}],"assertion":"The student admitted typing the threat, said it was not meant, and said the motive was anger about being picked on.","causal_attribution":"Reported statement from the Sheriff's Office. It is not an independent account by the student or family."},{"id":"c4","status":"reported","evidence":[{"locator":"With the help of artificial intelligence , technology can dip into online conversations and immediately notify both school officials and law enforcement.","relation":"supports","source_id":"s3"}],"assertion":"Associated Press reporting describes school-monitoring software 'like Gaggle and Lightspeed Alert' as using artificial intelligence to watch students' online conversations and notify school officials and law enforcement.","causal_attribution":"Description of a software class. It does not establish the mechanism of the alert in this case."}],"effects":[{"label":"Felony arrest of a minor following an automated alert","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.wesh.com/article/volusia-county-school-threats-mental-health-awareness/66929047","kind":"news_report","access":"read","language":"en","translation_note":"Body read from a Wayback capture of the same URL because the live page returned 451.","independence_group":"vso-volusia-2025-09-12"},{"id":"s2","url":"https://www.fox35orlando.com/news/two-volusia-county-students-arrested-school-threats-officials-say","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"vso-volusia-2025-09-12"},{"id":"s3","url":"https://www.yahoo.com/news/articles/schools-using-ai-surveillance-protect-110342650.html","kind":"news_report","access":"read","language":"en","translation_note":"Associated Press investigation on AI school surveillance, cited only for the description of software like Gaggle. It does not mention this student.","independence_group":"ap-ai-surveillance-2025"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","justice"],"unknowns":["Whether the alert in this case was generated by an AI model, by keyword rules, or reviewed by a Gaggle or school human reviewer before reaching the deputy.","Outcome of the felony charge, any court or school discipline, and the family's account.","The Sheriff's Office statement (a Facebook post per Fox 35) was read only through outlet rewrites.","Whether the student's family disputes the arrest is not reported."],"geography":{"basis":"Sources place the events at a high school in Deltona, Volusia County, Florida, and name the county Sheriff's Office.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Three inspected news bodies: two rewrites of one Sheriff's Office statement for the event and one AP piece for the product description. The record states the police account as reported and does not treat the alert as established cause of the arrest.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"Sheriff's Office account carried by local outlets says a Gaggle alert notified the deputy. AP reporting describes monitoring software like Gaggle as AI-assisted in general. No source states how this specific alert was generated or reviewed.","status":"reported"},"person_relations":["made_claim_about"]},"name":"Deltona, Florida: Gaggle school-laptop alert leads to felony arrest of a 15-year-old over a typed gun threat the student said was not serious","summary":"According to a Volusia County Sheriff's Office account carried by local outlets, a 15-year-old high school student in Deltona, Florida was arrested on 12 September 2025 after typing a written threat to bring a gun to school on a school-issued laptop. The Gaggle student-monitoring software raised an alert that notified the school resource deputy, who detained the student before the student boarded the bus home. The student was arrested on a second-degree felony charge (one outlet says the charge was still to be filed). The student reportedly admitted typing the text, said it was not meant seriously and said the motive was anger about being picked on. Outcome of the charge and the exact Gaggle role in generating this alert are not reported.","incidentDate":"2025-09-12","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-09-13","aiSystem":"Gaggle, a student-safety monitoring service for school-provided devices (school-monitoring software of the kind Associated Press reporting describes as using artificial intelligence)","aiProduct":"Gaggle school monitoring","aiCompany":"Gaggle","severity":"medium","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["loss_of_liberty","legal_harm"],"harmOutcomeSummary":"The Sheriff's Office says a Gaggle alert on the student's typed threat led a deputy to detain the student before the bus ride home, and the student was arrested on a second-degree felony charge (police account; the student reportedly said the text was not meant seriously).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"One student (the 15-year-old arrested). The other Volusia students arrested in the same days are not counted: the sources tie a Gaggle alert only to this student.","victimAgeRange":"minor","platformType":"other","primarySourceUrl":"https://www.wesh.com/article/volusia-county-school-threats-mental-health-awareness/66929047","primarySourceLabel":"WESH 2, Volusia County deputies arrest four children accused of making school threats","firstPublishedAt":"2026-09-29T12:42:12.865194+00:00","updatedAt":"2026-09-30T01:17:00.789359+00:00","scopeVersion":"facts-v3","tags":["historical-2025"]},{"id":"2026-utah-meta-ai-suggested-prompts-children-profile","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'Meta AI posed a series of invasive prompts under the video, such as \"Who's the child passenger?\" and \"Where does Kalie Robins live?\"'; 'pulled information from her past posts ... including her location'; 'drew on other profiles, such as her mother's account'.","relation":"supports","source_id":"s1"},{"locator":"'Who's the child passenger?'; 'their names, birth information, pictures and videos of them'; 'It pieced together my information to show people where I live'.","relation":"supports","source_id":"s3"},{"locator":"'suggested questions aimed at uncovering information about her children — including their names, birthdates, videos, newborn photos, even photos that had been deleted — and, ultimately, her live location'.","relation":"supports","source_id":"s2"}],"assertion":"Meta AI suggested prompts under Robins's 1 September car video including 'Who's the child passenger?' and 'Where does Kalie Robins live?', and clicking them produced her daughters' names, birth details, photos and videos from her own and relatives' posts, and assembled her likely location.","causal_attribution":"Robins's account given in separate interviews to CNET, NewsNation and Futurism; Meta does not dispute that the prompts were generated."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'A Meta spokesperson told CNET in an email that it \"fixed\" the issue and that Meta AI will no longer suggest inappropriate, personal questions on users' posts'.","relation":"supports","source_id":"s1"},{"locator":"'\"While the content was available to this user, these prompts should never have been generated,\" Meta spokesperson Dina El-Kassaby said, according to The Verge'.","relation":"supports","source_id":"s4"},{"locator":"'its AI search feature \"missed the mark\"'; '\"fixed that issue\"'.","relation":"supports","source_id":"s3"}],"assertion":"Meta said the prompts 'missed the mark' and 'should never have been generated', that responses draw only on information the user can already access, and that it fixed the issue so Meta AI no longer suggests personal questions about people in posts.","causal_attribution":"Meta statements to three outlets."},{"id":"c3","status":"disputed","evidence":[{"locator":"'Meta also denied Robins' claim that its AI accessed a photo deleted years ago. Instead, Meta told CNET that the photo of Robins' kids was deleted right before the video was made and that a temporary bug briefly kept it visible. Robins disputed this'.","relation":"supports","source_id":"s1"}],"assertion":"Robins says one surfaced photo had been deleted years earlier; Meta says the photo was deleted shortly before the video and remained briefly visible because of a temporary bug.","causal_attribution":"Competing accounts from Robins and Meta reported by CNET."}],"effects":[{"label":"Meta AI prompts compiled a mother's young daughters' names, birth details and photos and her likely location; the mother reported distress and lost trust; Meta changed the feature","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.cnet.com/tech/services-and-software/meta-ai-viral-video-personal-prompts-about-kids/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 (CNET, 12 Sep 2026). Direct interview with Robins plus Meta's emailed statement to CNET and its dispute of the deleted-photo detail.","independence_group":"cnet"},{"id":"s2","url":"https://www.newsnationnow.com/business/tech/ai/mom-meta-ai-analyzing-posts-about-kids/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 via the MSN content API copy (NewsNation, 17 Sep 2026; the newsnationnow.com host returns 403 to this box). Interview with Robins including the distress quotation.","independence_group":"newsnation"},{"id":"s3","url":"https://torontosun.com/news/world/utah-mom-sounds-alarm-after-meta-ai-digs-up-details-about-her-children-im-done","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 via the MSN content API copy (Toronto Sun, 15 Sep 2026). Relays Futurism's interview and Meta's statement to Futurism; treated as the Futurism chain.","independence_group":"futurism"},{"id":"s4","url":"https://www.dexerto.com/entertainment/meta-changes-ai-prompts-after-chatbot-asked-mother-to-identify-her-child-3408508/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 (Dexerto, 12 Sep 2026). Relays The Verge's report of Meta spokesperson Dina El-Kassaby's statement; treated as The Verge chain.","independence_group":"verge"}],"version":1,"ai_roles":["own_use","institutional_use"],"contexts":["privacy","everyday_life","relationships"],"unknowns":["What Meta changed and how many other users saw similar prompts about children is not disclosed.","Whether the compiled information was shown to anyone other than Robins is not established.","No regulator has announced an inquiry in the inspected sources."],"geography":{"basis":"Robins is described as a Utah mother (Toronto Sun/Futurism; TRT Haber); the posts and prompts occurred on her US Instagram/Facebook accounts. No court.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as a privacy and made-claim-about case: an AI feature compiled identifying details about two young children and a named adult's location, the adult reported distress and loss of control, and the company acknowledged the prompts should not have been generated. Four sources across four reporting chains read; the children's details are not reproduced. Low severity.","reviewed_on":"2026-09-18"},"ai_involvement":{"basis":"Meta acknowledged to CNET and The Verge that its AI generated the suggested prompts and that they 'should never have been generated', and said it fixed the issue. The AI made claims about identified people (the children's identities and the mother's location) rather than conversing with them; the mother's clicks on the prompts are recorded as own_use, and the platform's default feature as institutional_use.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Utah: Meta AI's suggested prompts under a mother's Instagram video compiled her young daughters' names, birth details and old photos and her likely home location; Meta said the prompts 'missed the mark' and changed the feature","summary":"On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.","incidentDate":"2026-09-02","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2026-09-10","aiSystem":"Meta AI (suggested-question prompts under Instagram and Facebook posts, drawing on the user's and related accounts' content)","aiProduct":"Meta AI","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"A mother experienced distress and a loss of control over her children's privacy after Meta AI's suggested prompts compiled her two young daughters' identifying details and her likely location from scattered family posts; Meta acknowledged the prompts should not have been generated and changed the feature.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":2,"affectedCountStatus":"exact","affectedCountEvidence":"Kalie Robins (who used the prompts and reported distress) and her two daughters, whose identifying details were compiled. Exact count of three; her mother and other relatives whose posts were drawn on are not counted as harmed.","victimAgeRange":"minor","jurisdiction":"US","platformType":"assistant","outcomeType":"internal_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.cnet.com/tech/services-and-software/meta-ai-viral-video-personal-prompts-about-kids/","primarySourceLabel":"CNET, 12 Sep 2026: Mother calls for 'accountability' after Meta AI mines family posts for info on minors (interview with Kalie Robins; Meta statement)","firstPublishedAt":"2026-09-18T03:25:15.671921+00:00","updatedAt":"2026-09-30T01:17:58.137201+00:00","scopeVersion":"facts-v3","tags":["meta-ai","instagram","facebook","privacy","children","profiling","suggested-prompts","united-states","utah","made-claim-about"]}]}