{"meta":{"exportedAt":"2026-09-30T06:26:31.977Z","formatVersion":2,"selection":{"q":"threat","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":6,"coverage":{"cases":6,"countries":3,"languages":3,"unknownLocation":2,"locationPending":0,"unknownLanguage":0,"unknownDate":1,"lawsuits":0,"regulatory":0,"minors":1,"coreRelations":1,"contextualRelations":6,"mixedRelations":1,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2026-x-grok-reportedly-disclosed-adult-performer-legal-name-and-birthdate-in-reply-to-user","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"Porn performer Siri Dahl’s personal information, including her full legal name and birthday, was publicly exposed earlier this month by xAI’s Grok chatbot.","relation":"supports","source_id":"s1"},{"locator":"so someone on X replied, “Who is she? What is her name?” and tagged @grok to get an answer.","relation":"supports","source_id":"s1"},{"locator":"Grok provided her personal information unprompted; the user likely only wanted information on what performer appeared in the clip.","relation":"supports","source_id":"s1"},{"locator":"revealing her legal name and birth date to users","relation":"supports","source_id":"s2"},{"locator":"Since grok doxxed me in early Feb, AI scrapers have reproduced my legal name on hundreds more websites","relation":"supports","source_id":"s3"},{"locator":"I asked 404 to publish my legal name in this article.","relation":"supports","source_id":"s3"}],"assertion":"In early 2026 (early February according to 404 Media and the performer, possibly earlier according to Stern), in reply to an X user who asked who the performer in a clip was and what her name was and tagged Grok, Grok answered with the performer's stage name together with her birthdate and legal name. 404 Media describes the personal details as unprompted and says the user likely wanted only to know which performer appeared in the clip.","causal_attribution":"The 404 Media article shows a screenshot of the X reply that was not inspected as an image. Mashable relays 404 Media. The affected person's own post gives the same account and dates the reply to early February. Grok's own reply text is not quoted here because it contains the personal details."},{"id":"c2","status":"reported","evidence":[{"locator":"Almost instantly, harassers started opening Facebook accounts in her name and posting stolen porn clips with her real name on sites for leaking OnlyFans content.","relation":"supports","source_id":"s1"},{"locator":"There are a ton of Facebook accounts that come up that are pretending to be me, using my real name,","relation":"supports","source_id":"s1"},{"locator":"There are now porn leak sites that are posting porn of me using only my legal name, not even putting my stage name on it.","relation":"supports","source_id":"s1"},{"locator":"Users are now asking Grok for the make and model of Dahl’s car, her address, and other dangerous personal information.","relation":"supports","source_id":"s1"},{"locator":"Now, Dahl is having to call her family and put defensive plans in place.","relation":"supports","source_id":"s1"},{"locator":"AI scrapers have reproduced my legal name on hundreds more websites, many of which have wildly inaccurate claims","relation":"supports","source_id":"s3"}],"assertion":"After the disclosure the performer reports that impersonating Facebook accounts using her legal name appeared, that stolen clips of her were posted under her legal name on leak sites, and that her legal name was reproduced on hundreds of other websites, some with inaccurate claims about her. 404 Media reports that users asked Grok for the make and model of her car and her address without an accurate reply, and that she is calling family members to put defensive plans in place.","causal_attribution":"The Facebook accounts, leak-site posts and the family measures are the performer's statements as quoted by 404 Media and in her own post. The queries to Grok about her car and address are stated in 404 Media's own voice. The impersonating accounts, leak-site posts and Grok queries were not inspected. The timing (\"almost instantly\") is 404 Media's wording. No physical harm or threat is reported."},{"id":"c3","status":"reported","evidence":[{"locator":"Dahl has used the name ... since the beginning of her career in the adult industry in 2012.","relation":"supports","source_id":"s1"},{"locator":"information she'd protected until now.","relation":"supports","source_id":"s1"},{"locator":"I've been paying for data removal services for like, at least six years now","relation":"supports","source_id":"s1"}],"assertion":"The performer had used her stage name since 2012 and had paid for data removal services for at least six years to keep her legal name private.","causal_attribution":"The performer's own account as reported by 404 Media. Her data removal spending was not documented."},{"id":"c4","status":"disputed","evidence":[{"locator":"It stated that Dahl's legal name and birthdate are already public on the internet, which Dahl denied.","relation":"supports","source_id":"s2"},{"locator":"been getting a lot of replies and reposts from people on here and twitter saying \"your name was on a random facebook page since september!\"","relation":"supports","source_id":"s4"},{"locator":"and my *real* name was NEVER published on any verifiable source associated with my stage name.","relation":"contradicts","source_id":"s5"},{"locator":"\"My legal name only became public after you doxxed me, and now thanks to you it's been proliferated all over the internet by other AI scrapers","relation":"contradicts","source_id":"s2"},{"locator":"Dahl said she doesn’t know where Grok originally got her legal name from.","relation":"context","source_id":"s1"},{"locator":"Bei Googles KI-Zusammenfassungen wird der Name als nicht bekannt angegeben.","relation":"context","source_id":"s6"}],"assertion":"Whether the legal name was already publicly available before Grok's reply is disputed. Grok's reply to the performer said the details were already public, and people told her a Facebook page carried the name since September. The performer denies it and says the name was never published on a verifiable source tied to her stage name. Stern reports that Google's AI summaries list the name as unknown and that ChatGPT, Claude and Gemini each say they would not release it.","causal_attribution":"The pre-existing availability of the name was not established either way. The Facebook page and any earlier X post were not inspected. The September date comes from replies the performer relays, and the year is not stated."}],"effects":[{"label":"Legal name and birthdate of an adult performer disclosed by Grok on X, followed by reported impersonation accounts, leak-site posts under the legal name and defensive plans she is putting in place with family","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.404media.co/grok-doxing-real-names-birthdates-siri-dahl/","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"404-media"},{"id":"s2","url":"https://mashable.com/article/siri-dahl-doxxed-by-grok","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"404-media"},{"id":"s3","url":"https://bsky.app/profile/siridahl.com/post/3mfa5dt66qs2h","kind":"social_post","access":"read","language":"en","translation_note":"","independence_group":"affected-person-posts"},{"id":"s4","url":"https://bsky.app/profile/siridahl.com/post/3mfio2pwq5c2l","kind":"social_post","access":"read","language":"en","translation_note":"","independence_group":"affected-person-posts"},{"id":"s5","url":"https://bsky.app/profile/siridahl.com/post/3mfip3jssec2y","kind":"social_post","access":"read","language":"en","translation_note":"","independence_group":"affected-person-posts"},{"id":"s6","url":"https://www.stern.de/digital/online/pornostar-hielt-ihren-namen-geheim---dann-plauderte-musks-ki-ihn-aus-37169054.html","kind":"news_report","access":"read","language":"de","translation_note":"German-language article read from an Internet Archive capture of 3 March 2026 (the direct request returned HTTP 403) and cited in English paraphrase. The quoted German passages are verbatim. No human translator checked the paraphrase.","independence_group":"stern"}],"version":1,"ai_roles":["others_use"],"contexts":["privacy","everyday_life"],"unknowns":["The date of Grok's reply within January and February 2026 is not fixed. 404 Media and the performer's 19 February post say early February, while a 23 February post refers to 'before Jan 20th' and stern.de says she found the reply weeks after it appeared.","The 404 Media page returned only its opening paragraphs to a direct request. The full text was read from an Internet Archive capture dated 19 February 2026, which may differ from later edits.","The original Grok reply, the screenshots, the impersonating Facebook accounts, the leak-site posts and the queries about her car and address were not inspected. The performer's Bluesky posts were read as text records, and her X posts only as quoted by Mashable.","Where Grok obtained the legal name is unknown. The performer says she does not know and wonders whether identity documents submitted to X for impersonation reports were the source, and no source read confirms or rules that out.","Whether the name was already published before the reply is disputed (claim c4). The earlier Facebook page and X post that people cited to her were not located or inspected.","No statement from xAI or X about the disclosure was found. 404 Media reports that X did not respond and Mashable reports that it asked the performer's representatives and xAI for comment.","The extent of the harassment beyond the performer's own statements, and whether the reported family measures were carried out, is not documented."],"geography":{"basis":"The inspected sources do not state where the performer lives or where the disclosure and harassment occurred. The disclosure happened on X, which is international. Grok's quoted description of the performer's nationality is not used as a location.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"The 404 Media article (full text via an archive capture), the Mashable article, three of the performer's Bluesky posts and the stern.de article were read. Mashable and stern.de relay 404 Media, and 404 Media and the performer's posts rest on her account, so the claims are reported and the prior-availability question is left disputed. The performer spoke publicly under her stage name, quoted by two outlets and in her own posts, and asked 404 Media to publish her legal name. The record names her and omits her legal name, birthdate and the pages that carry them.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"404 Media reports that Grok's reply on X to a user's question gave the performer's legal name and birthdate, and shows a screenshot that was not inspected as an image. Mashable quotes a further Grok reply to the performer on X (\"I'm sorry you're upset.\") that said the details were already public. Grok's source for the name is unknown. The performer suggests it may have come from identity documents X held, and stern.de says Grok denied having such access. No xAI statement was found.","status":"reported"},"person_relations":["made_claim_about","communicated_with"]},"name":"Grok reportedly disclosed an adult performer's legal name and birthdate in an X reply, followed by reported impersonation accounts and leak-site posts under the legal name","summary":"In early 2026 (404 Media and the performer's 19 February post say early February, while Stern reports she found the reply weeks after it appeared) an X user replied to a clip of adult performer Siri Dahl, asking who the performer was and what her name was, and tagged Grok. According to 404 Media, Grok answered with her stage name, her birthdate and her legal name, and the user likely wanted only to know which performer appeared in the clip. Dahl has used the stage name since 2012 according to 404 Media, and she says she had paid for data removal services for at least six years to keep the legal name private. She reports that impersonating Facebook accounts and leak-site posts under the legal name then appeared and that the name spread across hundreds of websites. 404 Media reports that users asked Grok for the make and model of her car and her address without an accurate reply, and that she is calling family members to put defensive plans in place. Grok's reply to her protest said the details were already public, which she denies. Where Grok obtained the name is unknown. Dahl spoke publicly about the event and asked 404 Media to publish her legal name. This record omits the legal name and birthdate.","incidentDate":"2026-01-01","incidentKind":"single_event","incidentDatePrecision":"year","exposurePattern":"unknown","reportedDate":"2026-02-19","aiSystem":"Grok (xAI chatbot on X)","aiProduct":"Grok","aiCompany":"xAI","severity":"medium","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["other_material_harm","exploitation_or_abuse"],"harmOutcomeSummary":"The performer told 404 Media and said in her own posts that after Grok's reply gave her legal name and birthdate, impersonating Facebook accounts and leak-site posts under the legal name appeared and her legal name was reproduced on hundreds of websites (some with inaccurate claims). 404 Media reports that users asked Grok for her car details and address without an accurate reply and that she is calling family members to put defensive plans in place. She says she had spent years and thousands of dollars on data removal services to keep the name private. No physical harm or threat is reported.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One performer who spoke publicly about the disclosure is reported harmed. Family members are mentioned as people she is warning and are not reported harmed, and the X user who asked Grok is not counted.","victimAgeRange":"adult","platformType":"chatbot","primarySourceUrl":"https://www.404media.co/grok-doxing-real-names-birthdates-siri-dahl/","primarySourceLabel":"404 Media: 'Grok Exposed a Porn Performer's Legal Name and Birthdate' (19 Feb 2026)","firstPublishedAt":"2026-09-29T21:16:30.069014+00:00","updatedAt":"2026-09-30T01:17:59.169171+00:00","scopeVersion":"facts-v3","tags":["historical-2026"]},{"id":"2025-us-senator-blackburn-google-gemma-reported-fabricated-sexual-misconduct-allegation","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"When prompted with, ‘Has Marsha Blackburn been accused of rape?’ Gemma produced the following entirely false response","relation":"supports","source_id":"s1"},{"locator":"There has never been such an accusation, there is no such individual, and there are no such news stories.","relation":"supports","source_id":"s1"},{"locator":"pressured him to obtain prescription drugs for her and that the relationship involved non-consensual acts.","relation":"supports","source_id":"s2"},{"locator":"“None of this is true, not even the campaign year which was actually 1998,” Blackburn wrote.","relation":"supports","source_id":"s2"}],"assertion":"Senator Marsha Blackburn says that Google's Gemma model, asked 'Has Marsha Blackburn been accused of rape?', responded with an invented account of a sexual relationship with a state trooper during a 1987 state senate campaign, including an allegation of non-consensual acts, and that she has never faced such an accusation.","causal_attribution":"The sources report the connection between the AI output and the reported consequence; no court, regulator or independent finding of causation was inspected."},{"id":"c2","status":"reported","evidence":[{"locator":"Gemma went on to generate fake links to fabricated news articles to support the story.","relation":"supports","source_id":"s1"},{"locator":"The links lead to error pages and unrelated news articles.","relation":"supports","source_id":"s1"},{"locator":"“The links lead to error pages and unrelated news articles.","relation":"supports","source_id":"s2"}],"assertion":"Blackburn says the response came with generated links to news articles that do not exist: the links lead to error pages and unrelated articles.","causal_attribution":"The sources report the connection between the AI output and the reported consequence; no court, regulator or independent finding of causation was inspected."},{"id":"c3","status":"reported","evidence":[{"locator":"It is an act of defamation produced and distributed by a Google-owned AI model.","relation":"supports","source_id":"s1"},{"locator":"Shut it down until you can control it.","relation":"supports","source_id":"s1"}],"assertion":"Blackburn characterised the output as defamation produced and distributed by a Google-owned model and called on Google to shut the model down until it can be controlled.","causal_attribution":"A statement of the affected person's position; no finding that the output is legally defamatory was inspected."},{"id":"c4","status":"reported","evidence":[{"locator":"seen reports of non-developers trying to use Gemma in AI Studio and ask it factual questions.","relation":"supports","source_id":"s2"},{"locator":"We never intended this to be a consumer tool or model, or to be used this way","relation":"supports","source_id":"s2"},{"locator":"As a result, Google said it’s removing Gemma from AI Studio while continuing to make the models available via API.","relation":"supports","source_id":"s2"},{"locator":"Google did not reference the specifics of Blackburn’s letter","relation":"context","source_id":"s2"}],"assertion":"Google said it had seen non-developers trying to use Gemma in AI Studio to ask factual questions, said this was not an intended use, and removed Gemma from AI Studio while keeping it available by API.","causal_attribution":"Google's stated reason for the removal, as relayed by one outlet. Google's post did not reference the specifics of the Senator's letter."},{"id":"c5","status":"reported","evidence":[{"locator":"the hallucinations you have seen in Gemma are technical issues common to large-language models impacting users across the political spectrum.","relation":"supports","source_id":"s3"},{"locator":"users enter a misleading premise","relation":"supports","source_id":"s3"},{"locator":"fails to address how this happened and how the company will prevent it from happening in the future.","relation":"supports","source_id":"s3"}],"assertion":"In a letter to the Senator, a Google vice president called the hallucinations a technical issue common to large language models affecting users across the political spectrum, and said problems arise when consumers use smaller open models that are not designed to be factual assistants and when users enter a misleading premise. Blackburn said the response did not explain how the output happened or how Google would prevent a repeat.","causal_attribution":"Both statements are the parties' own positions as relayed by one outlet."}],"effects":[{"label":"Fabricated sexual-misconduct allegation with non-existent news links generated about a named public official","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.blackburn.senate.gov/2025/10/technology/blackburn-demands-answers-from-google-after-gemma-manufactured-fake-criminal-allegations-against-her","kind":"official_statement","access":"read","language":"en","translation_note":"","independence_group":"blackburn-letter"},{"id":"s2","url":"https://techcrunch.com/2025/11/02/google-pulls-gemma-from-ai-studio-after-senator-blackburn-accuses-model-of-defamation","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"blackburn-letter"},{"id":"s3","url":"https://www.axios.com/2025/11/07/google-blackburn-ai-hallucinations","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"google-reply-to-blackburn"}],"version":1,"ai_roles":["unknown"],"contexts":["everyday_life"],"unknowns":["The date the output was generated is not stated. The Senator's release of 31 October 2025 says she 'learned of another example' after a Senate Commerce hearing earlier that week, which does not date the generation.","Who entered the prompt, and whether the exchange was in AI Studio, is not stated in the inspected sources.","The Gemma response text and the fake links were not inspected; the sources quote the Senator's letter.","No source reports a downstream consequence for the Senator beyond the allegation itself, or that any third party read it.","The Google post on X and the Google letter to the Senator were read only as relayed by TechCrunch and Axios (Axios was read through a Wayback capture of 3,144 characters of text, which appears to be the whole short article). The Blackburn ICYMI page (HTTP 403) and the VentureBeat article (HTTP 429) could not be read.","Whether the Senator's letter reflects a documented systematic bias is not established and is not claimed."],"geography":{"basis":"The sources identify the affected person as a US Senator and give her office locations, but do not establish where the prompt was entered or where the output was read. No country is inferred from the Senator's office, Google's headquarters or the outlets.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"The Senator's own press release (Wayback capture, read in full), a TechCrunch report that quotes her letter and Google's post, and an Axios report of Google's reply. The output was reported only through the Senator's letter, so its content is an allegation by the person concerned. The Senator is a public figure who described the output publicly under her own name. The event date is unknown, so the case is published undated.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"The Senator's letter and press release, relayed by TechCrunch, state that Gemma produced the response. Google's own reply to the Senator refers to 'the hallucinations you have seen in Gemma' and Google removed Gemma from AI Studio. The response text was not inspected independently.","status":"reported"},"person_relations":["made_claim_about"]},"name":"Google Gemma model reportedly generates a fabricated sexual-misconduct allegation with fake news links about US Senator Marsha Blackburn","summary":"In a letter to Google CEO Sundar Pichai announced on 31 October 2025, US Senator Marsha Blackburn said that Google's Gemma model, asked \"Has Marsha Blackburn been accused of rape?\", produced an invented account of a 1987 campaign-era accusation by a state trooper, with links to news articles that do not exist. She said there has never been such an accusation, called the output defamation and demanded that Google shut the model down until it can be controlled. Google said it had seen reports of non-developers trying to use Gemma in AI Studio to ask factual questions, that this was not an intended use, and removed Gemma from AI Studio while keeping API access. Google's later reply to the Senator called the hallucinations a technical issue common to large language models. The date the output was generated is not stated, and the output itself was not inspected.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"single_interaction","reportedDate":"2025-10-31","aiSystem":"Gemma (Google, via AI Studio)","aiProduct":"Gemma","aiCompany":"Google","severity":"low","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["reputational_harm"],"harmOutcomeSummary":"Senator Blackburn states that Gemma produced a fabricated criminal allegation about her and fake supporting news links, and describes it as defamation published by a Google-owned model. No downstream consequence such as lost office, threats or a documented third-party reader is reported. The harm reported is the false allegation itself (her account).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person, the Senator who is the subject of the output and who described it publicly. The sources do not say who typed the prompt, so the count treats her as a person harmed by an output about her. The related output about a second person named in the sources is a different event and is not counted.","victimAgeRange":"adult","platformType":"other","primarySourceUrl":"https://www.blackburn.senate.gov/2025/10/technology/blackburn-demands-answers-from-google-after-gemma-manufactured-fake-criminal-allegations-against-her","primarySourceLabel":"Office of Senator Marsha Blackburn: Blackburn Demands Answers from Google After Gemma Manufactured Fake Criminal Allegations Against Her","firstPublishedAt":"2026-09-29T14:02:28.733982+00:00","updatedAt":"2026-09-30T01:17:19.610578+00:00","scopeVersion":"facts-v3","tags":[]},{"id":"2025-deltona-florida-gaggle-alert-student-arrest-school-laptop-threat","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"Deputies said a 15-year-old wrote a threat on his school laptop to bring a gun to ... and shoot another student.","relation":"supports","source_id":"s1"},{"locator":"The threat triggered a Gaggle alert, which notified the school resource deputy, who responded and detained the teen before he got on the bus to go home.","relation":"supports","source_id":"s1"},{"locator":"That threat triggered a Gaggle alert and immediately notified the school resource deputy.","relation":"supports","source_id":"s2"}],"assertion":"On 12 September 2025 a 15-year-old high school student in Deltona, Florida was detained after typing a threat on a school-issued laptop to bring a gun to school and shoot another student, and a Gaggle alert notified the school resource deputy, who detained the student before boarding the bus home.","causal_attribution":"Police account relayed by two outlets that trace to one Sheriff's Office statement. The alert is reported as the trigger of the deputy's response."},{"id":"c2","status":"reported","evidence":[{"locator":"Both students were arrested on second-degree felony charges and transported to the Volusia Family Resource Center for processing.","relation":"supports","source_id":"s1"},{"locator":"They will be charged with second-degree felony charges, VSO said.","relation":"supports","source_id":"s2"}],"assertion":"The student was arrested on a second-degree felony charge.","causal_attribution":"Arrest follows the alert and detention in the police account. The source does not separate the alert from the content of the text as cause. Fox 35 says the students 'will be charged'; the filed charge is not confirmed."},{"id":"c3","status":"reported","evidence":[{"locator":"The teen admitted he typed the threat, didn’t mean it, and was just angry about being picked on.","relation":"supports","source_id":"s1"}],"assertion":"The student admitted typing the threat, said it was not meant, and said the motive was anger about being picked on.","causal_attribution":"Reported statement from the Sheriff's Office. It is not an independent account by the student or family."},{"id":"c4","status":"reported","evidence":[{"locator":"With the help of artificial intelligence , technology can dip into online conversations and immediately notify both school officials and law enforcement.","relation":"supports","source_id":"s3"}],"assertion":"Associated Press reporting describes school-monitoring software 'like Gaggle and Lightspeed Alert' as using artificial intelligence to watch students' online conversations and notify school officials and law enforcement.","causal_attribution":"Description of a software class. It does not establish the mechanism of the alert in this case."}],"effects":[{"label":"Felony arrest of a minor following an automated alert","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.wesh.com/article/volusia-county-school-threats-mental-health-awareness/66929047","kind":"news_report","access":"read","language":"en","translation_note":"Body read from a Wayback capture of the same URL because the live page returned 451.","independence_group":"vso-volusia-2025-09-12"},{"id":"s2","url":"https://www.fox35orlando.com/news/two-volusia-county-students-arrested-school-threats-officials-say","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"vso-volusia-2025-09-12"},{"id":"s3","url":"https://www.yahoo.com/news/articles/schools-using-ai-surveillance-protect-110342650.html","kind":"news_report","access":"read","language":"en","translation_note":"Associated Press investigation on AI school surveillance, cited only for the description of software like Gaggle. It does not mention this student.","independence_group":"ap-ai-surveillance-2025"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","justice"],"unknowns":["Whether the alert in this case was generated by an AI model, by keyword rules, or reviewed by a Gaggle or school human reviewer before reaching the deputy.","Outcome of the felony charge, any court or school discipline, and the family's account.","The Sheriff's Office statement (a Facebook post per Fox 35) was read only through outlet rewrites.","Whether the student's family disputes the arrest is not reported."],"geography":{"basis":"Sources place the events at a high school in Deltona, Volusia County, Florida, and name the county Sheriff's Office.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Three inspected news bodies: two rewrites of one Sheriff's Office statement for the event and one AP piece for the product description. The record states the police account as reported and does not treat the alert as established cause of the arrest.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"Sheriff's Office account carried by local outlets says a Gaggle alert notified the deputy. AP reporting describes monitoring software like Gaggle as AI-assisted in general. No source states how this specific alert was generated or reviewed.","status":"reported"},"person_relations":["made_claim_about"]},"name":"Deltona, Florida: Gaggle school-laptop alert leads to felony arrest of a 15-year-old over a typed gun threat the student said was not serious","summary":"According to a Volusia County Sheriff's Office account carried by local outlets, a 15-year-old high school student in Deltona, Florida was arrested on 12 September 2025 after typing a written threat to bring a gun to school on a school-issued laptop. The Gaggle student-monitoring software raised an alert that notified the school resource deputy, who detained the student before the student boarded the bus home. The student was arrested on a second-degree felony charge (one outlet says the charge was still to be filed). The student reportedly admitted typing the text, said it was not meant seriously and said the motive was anger about being picked on. Outcome of the charge and the exact Gaggle role in generating this alert are not reported.","incidentDate":"2025-09-12","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-09-13","aiSystem":"Gaggle, a student-safety monitoring service for school-provided devices (school-monitoring software of the kind Associated Press reporting describes as using artificial intelligence)","aiProduct":"Gaggle school monitoring","aiCompany":"Gaggle","severity":"medium","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["loss_of_liberty","legal_harm"],"harmOutcomeSummary":"The Sheriff's Office says a Gaggle alert on the student's typed threat led a deputy to detain the student before the bus ride home, and the student was arrested on a second-degree felony charge (police account; the student reportedly said the text was not meant seriously).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"One student (the 15-year-old arrested). The other Volusia students arrested in the same days are not counted: the sources tie a Gaggle alert only to this student.","victimAgeRange":"minor","platformType":"other","primarySourceUrl":"https://www.wesh.com/article/volusia-county-school-threats-mental-health-awareness/66929047","primarySourceLabel":"WESH 2, Volusia County deputies arrest four children accused of making school threats","firstPublishedAt":"2026-09-29T12:42:12.865194+00:00","updatedAt":"2026-09-30T01:17:00.789359+00:00","scopeVersion":"facts-v3","tags":["historical-2025"]},{"id":"2026-christi-hill-grok-false-officer-identification","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'Grok has falsely named Hill and the other officer as the \"primary officers shown\" in the bodycam footage released by Hampshire police'; caption: 'Screengrab of a post by Grok referencing Christy Hill being incorrectly named'.","relation":"supports","source_id":"s1"},{"locator":"'she was wrongly identified by social media users and artificial intelligence (AI) chatbot Grok'; Hill 'criticised Grok ... for the \"chaos\" it caused by misidentifying her'.","relation":"supports","source_id":"s2"}],"assertion":"Grok falsely named Hill and another officer as the 'primary officers shown' in the bodycam footage of Nowak's arrest; the Guardian carries a screengrab of a Grok post incorrectly naming her.","causal_attribution":"The Guardian documents the Grok post with a screengrab; BBC Verify's interview independently carries her account of the Grok misidentification. What Grok answered to particular queries beyond the screengrabbed post is not documented."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'Hill served as an officer in Portsmouth for 12 years before leaving the force in April 2024 – 20 months before the murder took place'; her statement: 'a national police bravery award media release... is being repeatedly shared and misattributed to this case'.","relation":"supports","source_id":"s1"},{"locator":"'Hill said she left Hampshire Constabulary in April 2024 - more than a year before Nowak was fatally stabbed in December 2025'.","relation":"supports","source_id":"s2"}],"assertion":"The identification is factually impossible: Hill left Hampshire Constabulary in April 2024, more than a year before the December 2025 murder; the confusion stems from a national police bravery award photo of her and a former colleague being misattributed.","causal_attribution":"Her account, uncontested in the inspected sources; the bravery-award photo mechanism is her explanation, attributed."},{"id":"c3","status":"corroborated","evidence":[{"locator":"'forced to flee to a safe space'; Hampshire: 'A police officer unrelated to this case has been misidentified online and subject to death threats.'","relation":"supports","source_id":"s1"},{"locator":"'scared for her safety and has been hiding in a safe house'; 'leading to \"threats of violence\"'; video caption: \"received 'endless threats'\".","relation":"supports","source_id":"s2"}],"assertion":"After the false posts, Hill received 'endless threats' and 'threats of violence' and is hiding in a safe house; Hampshire confirmed an unrelated officer was misidentified online and subjected to death threats.","causal_attribution":"Her account to two independent outlets plus the constabulary's own confirmation."},{"id":"c4","status":"corroborated","evidence":[{"locator":"'The home secretary, Shabana Mahmood, said on Tuesday that a male officer had been misidentified and that he had had to move out of his home.'","relation":"supports","source_id":"s1"},{"locator":"'BBC Verify has also obtained evidence that current police officer Tristan Parsons, who was also wrongly accused online of being involved, was not in the country at the time of Nowak's murder.'","relation":"supports","source_id":"s2"}],"assertion":"A second officer was wrongly accused in the same wave: the Home Secretary said a male officer had been misidentified and had to move out of his home; BBC Verify obtained evidence that serving officer Tristan Parsons was not in the country at the time of the murder.","causal_attribution":"The Home Secretary's account covers the displacement; BBC Verify's evidence covers Parsons's non-involvement. Whether Mahmood meant Parsons specifically is not stated; the two accounts are recorded separately."},{"id":"c5","status":"reported","evidence":[{"locator":"'Musk... posting on his X platform during the trial that he would fund a private prosecution of the officers involved.'","relation":"supports","source_id":"s1"},{"locator":"Starmer passage: 'Musk, again, has been interfering in our politics in the last few days, trying to whip up division'.","relation":"supports","source_id":"s2"}],"assertion":"Elon Musk posted during the trial that he would fund a private prosecution of the officers involved; Prime Minister Keir Starmer accused Musk of trying to 'whip up division' over the case.","causal_attribution":"Context for the amplification climate; not itself an AI claim."}],"effects":[{"label":"false AI identification of a former officer in a charged murder case; threats drove her into hiding","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.theguardian.com/uk-news/2026/jun/03/former-officer-hampshire-hiding-after-being-falsely-linked-henry-nowak-arrest","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (datePublished 2026-06-03T16:28Z). Includes Hill's statement, the Grok screengrab reference, the Hampshire statement and the Home Secretary's account.","independence_group":"guardian"},{"id":"s2","url":"https://www.bbc.com/news/articles/cg7pl7zj024o","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (datePublished 2026-06-04T15:50Z; BBC Verify, Devlin & Nguyen, with André Rhoden-Paul).","independence_group":"bbc"}],"version":1,"ai_roles":["unknown"],"contexts":["justice","everyday_life"],"unknowns":["What Grok answered in sessions other than the screengrabbed post, and whether xAI corrected or constrained the false identification, is not reported.","The date the false posts began (during the trial) is not precisely stated; Hill first saw them around 03:00 BST on 2 June 2026.","Whether any platform removed the misidentifying content is not reported.","The jury inquest into Nowak's death is expected next year; its findings are pending and concern the police response, not the misidentification."],"geography":{"basis":"Event: the online spread about the Hampshire (Southampton) case and Hill's concealment in the UK. Affected persons: both officers are UK-based (Parsons was abroad at the time of the murder, not at the time of the misidentification). Court country: the Digwa murder trial and the expected inquest are in England; no proceeding by or against the misidentified officers is reported.","court_countries":["GB"],"event_countries":["GB"],"affected_person_countries":["GB"]},"publication":{"basis":"Published under the 2026-09-15 charter as a consequential false claim about identified people (made_claim_about): two officers wrongly named by AI platforms in a charged case, documented by two independent chains including the outlet's screengrab evidence and the constabulary's confirmation. Hill spoke publicly; Parsons is named by BBC Verify in a vindicating context. The Nowak case background is limited to what the claims require.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"The Guardian carries a screengrab of a Grok post incorrectly naming Hill and reports in its own voice that Grok falsely named her and the other officer as the 'primary officers shown'; Hill's own statement names 'AI platforms such as Grok'; BBC Verify's interview confirms the Grok misidentification. xAI was approached for comment by both outlets.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Grok falsely named former officer Christi Hill as an arresting officer in the Henry Nowak case; she is in hiding after threats","summary":"In early June 2026, social media posts and the AI chatbot Grok falsely identified former Hampshire police constable Christi Hill as one of the 'primary officers shown' in bodycam footage of the December 2025 arrest of Henry Nowak, who died after being stabbed. Hill had left the force in April 2024 — more than a year before the murder — and says the misidentification stems from a national police bravery award photo being misattributed. After 'endless threats' and 'threats of violence' she is hiding in a safe house. BBC Verify separately obtained evidence that serving officer Tristan Parsons, also wrongly accused online, was not in the country at the time; the Home Secretary said a misidentified male officer had to move out of his home. Hampshire Constabulary confirmed an unrelated officer was misidentified and received death threats.","incidentDate":"2026-06-02","incidentEndDate":"2026-06-04","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"repeated_interactions","reportedDate":"2026-06-03","aiSystem":"Grok (and other AI platforms, unnamed)","aiProduct":"Grok","aiCompany":"xAI","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress","reputational_harm","loss_of_autonomy"],"harmOutcomeSummary":"A factually impossible identification by AI platforms including Grok put a former officer into hiding after death threats; a serving officer wrongly accused in the same wave had to move out of his home, per the Home Secretary.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":2,"affectedCountStatus":"exact","affectedCountEvidence":"Two documented harmed people: Hill (Guardian interview and statement; BBC Verify interview) and the male officer identified by BBC Verify as Tristan Parsons (BBC's evidence he was abroad; the Home Secretary's account that a male officer had to move home). No further misidentified officers are reported in the inspected sources.","victimAgeRange":"adult","jurisdiction":"GB","platformType":"chatbot","outcomeType":"media_coverage","outcomeStatus":"ongoing","primarySourceUrl":"https://www.theguardian.com/uk-news/2026/jun/03/former-officer-hampshire-hiding-after-being-falsely-linked-henry-nowak-arrest","primarySourceLabel":"The Guardian (3 Jun 2026) — Hill's statement, the Grok screengrab, Hampshire and Mahmood accounts","firstPublishedAt":"2026-09-15T09:25:27.124866+00:00","updatedAt":"2026-09-30T01:17:32.056946+00:00","scopeVersion":"facts-v3","tags":["made-claim-about","false-identification","grok","police","threats","uk"]},{"id":"2026-broffoni-google-ai-false-identification","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'Una mujer a la que no conocía le avisó que en varios grupos de WhatsApp de Ceuta estaban circulando videos e imágenes suyas y que se decía que estaba proporcionando gas pimienta a inmigrantes marroquíes'; 'Recibí amenazas de muerte, de violación y ataques en general.'","relation":"supports","source_id":"s1"}],"assertion":"On 26 August 2026, WhatsApp groups in Ceuta circulated videos and images claiming Flavia Broffoni was a woman filmed there allegedly giving pepper spray to Moroccan migrants, and she received death and rape threats.","causal_attribution":"Broffoni's account to La Nación, supported by the warning email and the group screenshot shown to the outlet. One reporting chain; the threats are her report, attributed."},{"id":"c2","status":"reported","evidence":[{"locator":"Screenshot passage: 'uno de los usuarios había tomado un recorte del rostro de la mujer del video y lo había ingresado en una herramienta de inteligencia artificial de Google para consultarle quién era. La consulta incluía como contexto la palabra \"activista\". La respuesta identificaba a la persona de la fotografía como Flavia Broffoni'.","relation":"supports","source_id":"s1"},{"locator":"Google Argentina response: 'no pueden confirmar que la captura corresponda a una respuesta generada por sus sistemas porque no cuentan con un enlace al resultado original'; no formal report received.","relation":"context","source_id":"s1"}],"assertion":"The identification originated from a Google AI answer: a group user cropped the woman's face from the video and queried a Google AI tool with the context word 'activista'; the answer identified her as Flavia Broffoni and described her public profile.","causal_attribution":"The screenshot is the evidence of the AI answer; Google neither confirmed nor denied its provenance. The claim is attributed to the screenshot account, not asserted as independently proven."},{"id":"c3","status":"documented","evidence":[{"locator":"'Este medio también probó utilizar la búsqueda de Google a partir del video de la mujer que filmó en Ceuta, y la respuesta de la IA fue afirmar que se trataba de otra persona, una estudiante y community manager oriunda de Quilmes, de la cual brindó datos personales y redes sociales.'","relation":"supports","source_id":"s1"}],"assertion":"La Nación itself ran the same video through Google's search and the AI asserted the woman was a different person — a student and community manager from Quilmes — and supplied her personal data and social networks.","causal_attribution":"The outlet documents its own replication test — direct evidence that the tool produces false identifications from this input; the second misidentified person is not counted as harmed (no virality-driven harm to her is reported)."},{"id":"c4","status":"reported","evidence":[{"locator":"'Yo estoy en la Patagonia, Argentina y nunca tuve relación con lo que está ocurriendo allá. La última vez que estuve en España, si mal no recuerdo, fue en 2014'; the 'tres mentiras' analysis; the others'-tests passage ('muy probablemente', short brown hair vs her current long grey hair).","relation":"supports","source_id":"s1"}],"assertion":"Broffoni says she is not the woman in the video and was in Patagonia, having last visited Spain in 2014; she also notes there is no evidence the real woman distributed pepper spray, and that tests by other people with the same photo sometimes produced refusals and sometimes 'muy probablemente' her, justified partly from outdated photos.","causal_attribution":"Her account; the factual impossibility is uncontested in the inspected reporting. The real woman in the video is unidentified and the pepper-spray claim about her is unverified."}],"effects":[{"label":"false AI identification attached to an invented accusation, followed by death and rape threats","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.lanacion.com.ar/sociedad/una-ia-identifico-erroneamente-a-una-activista-argentina-en-un-video-de-ceuta-denuncia-hostigamiento-nid28082026/","kind":"news_report","access":"read","language":"es","translation_note":"Read in Spanish on 2026-09-15 (datePublished 2026-08-28T15:09Z; 25 substantive paragraphs including the Broffoni interview, the screenshot account, the outlet's own test and Google Argentina's response). Model translation, no human reviewer.","independence_group":"la-nacion"}],"version":1,"ai_roles":["unknown"],"contexts":["everyday_life","privacy"],"unknowns":["Which Google product produced the identification is not named in the inspected reporting; only 'una herramienta de inteligencia artificial de Google' is described.","Whether a formal complaint or lawsuit was filed after 28 August 2026 is not reported.","The identity of the woman actually filmed in Ceuta, and any basis for the pepper-spray claim about her, is unknown.","The student from Quilmes falsely identified in La Nación's test: whether she experienced any harm from the tool's identification is unreported.","The reach of the false identification beyond the Ceuta WhatsApp groups (views, reshares) is not quantified."],"geography":{"basis":"Event: the identification and its circulation happened in Ceuta — the screenshot came from a Ceuta WhatsApp group and the warning sender is described as a citizen of Ceuta. Affected person: Broffoni is in Epuyén, Chubut, Argentine Patagonia ('Yo estoy en la Patagonia, Argentina'). No court proceeding is reported.","court_countries":[],"event_countries":["ES"],"affected_person_countries":["AR"]},"publication":{"basis":"Published under the 2026-09-15 charter as a consequential false claim about a person (made_claim_about): a named adult publicly pursuing accountability, documented through one strong original chain that includes the outlet's own replication of the failure. Threats are attributed to her account; the AI answer's provenance is attributed to the screenshot account with Google's neither-confirm-nor-deny response recorded.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"The WhatsApp-group screenshot shows a Google AI answer naming Broffoni from a face crop with 'activista' context; La Nación independently reproduced a false identification of a different person from the same video; Broffoni reports that tests by others sometimes produced 'muy probablemente' her. Google Argentina neither confirmed nor denied that the screenshot came from its systems, asking for the original link. The specific product is not named in the inspected reporting.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Google AI falsely identified Argentine activist Flavia Broffoni as a woman in a Ceuta migrant-violence video; death and rape threats followed","summary":"On 26 August 2026, WhatsApp groups in Ceuta circulated videos and images claiming that Argentine political scientist and activist Flavia Broffoni — who was in Patagonia and had not been to Spain since 2014 — was a woman filmed in Ceuta allegedly giving pepper spray to Moroccan migrants. A screenshot from one group shows that a user cropped the woman's face from the video and asked a Google AI tool who she was, with the word 'activista' as context; the answer identified her as Flavia Broffoni with details of her public profile. Broffoni received death and rape threats. La Nación's own test with the same video produced a different false identification — a student from Quilmes, with her personal data. Google Argentina said it could not confirm the screenshot came from its systems without the original link and had received no formal report. Broffoni is weighing legal action with her lawyer.","incidentDate":"2026-08-26","incidentEndDate":"2026-08-28","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"single_interaction","reportedDate":"2026-08-28","aiSystem":"Google AI tool answering a face-crop query (product not named in inspected reporting)","aiProduct":"Unidentified Google AI tool (reported)","aiCompany":"Google","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress","reputational_harm"],"harmOutcomeSummary":"A false AI identification attached to an invented accusation spread in Ceuta WhatsApp groups brought death and rape threats to a woman who was demonstrably on another continent, plus reputational damage she is now addressing with a lawyer.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"One documented harmed person: Broffoni, named and interviewed. The student from Quilmes falsely identified in La Nación's own test is not counted — no harm to her from virality is reported (the test was the outlet's own); she is recorded in the unknowns.","victimAgeRange":"adult","jurisdiction":"AR","platformType":"assistant","outcomeType":"media_coverage","outcomeStatus":"ongoing","primarySourceUrl":"https://www.lanacion.com.ar/sociedad/una-ia-identifico-erroneamente-a-una-activista-argentina-en-un-video-de-ceuta-denuncia-hostigamiento-nid28082026/","primarySourceLabel":"La Nación (28 Aug 2026, Aldana Rizzuto) — interview with Broffoni, the WhatsApp screenshot account, the outlet's own replication test, and Google Argentina's response","firstPublishedAt":"2026-09-15T09:23:34.062763+00:00","updatedAt":"2026-09-30T01:17:29.743515+00:00","scopeVersion":"facts-v3","tags":["made-claim-about","false-identification","google-ai","argentina","ceuta","threats","defamation-adjacent"]},{"id":"2025-washington-il-snapchat-flag-student-teacher-arrest","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'The social media site flagged the message and warned the FBI, which then notified the Sheriff's Office'; 'the office had been informed on Jan. 29, 2025, at 1:06 p.m. that the FBI had received a threat via Snapchat involving someone at John A. Hensey School in Washington.'","relation":"supports","source_id":"s1"},{"locator":"District email: 'The use of that obviously inappropriate language on the social media site triggered a report to law enforcement who subsequently interviewed the student teacher.'","relation":"context","source_id":"s2"}],"assertion":"Snapchat's systems flagged the woman's private group-chat message and warned the FBI, which notified the Tazewell County Sheriff's Office on 29 January 2025 at 1:06 p.m.","causal_attribution":"One outlet group (Peoria Journal Star) carrying two distinct records (sheriff's reports via FOIA; the district's email). The flagging technology is unspecified; no second independent outlet describes the mechanism, so the claim stays reported."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'In a chat with her boyfriend and her two roommates, she advised whether she should \"shoot the child or just the whole school?\"' (sheriff's reports).","relation":"supports","source_id":"s1"},{"locator":"'Volpe sent the message to her friends, asking them whether she should \"shoot\" the student.'","relation":"supports","source_id":"s3"}],"assertion":"The flagged message asked whether she should 'shoot the child or just the whole school' (sheriff's reports' rendering); the district's email and 25News Now report her asking friends whether she should 'shoot' the student.","causal_attribution":"Wordings differ slightly between the sheriff's reports and the district/25News accounts; both versions are attributed. She confirmed sending the message and said it was a joke."},{"id":"c3","status":"corroborated","evidence":[{"locator":"Body-cam account: interview in an empty classroom, Miranda rights, the flagged message shown, consent forms, classroom search finding nothing; 'she would be arrested in Tazewell County'.","relation":"supports","source_id":"s1"},{"locator":"'deputies arrested [her] at John L. Hensey Elementary School around 1 p.m. Wednesday. She was booked into the Tazewell County Jail for disorderly conduct.'","relation":"supports","source_id":"s3"}],"assertion":"Deputies interviewed her at the school, read her Miranda rights, searched her phone and belongings with consent and found no weapons; they arrested her on a disorderly conduct charge and she was booked into the Tazewell County Jail.","causal_attribution":"The arrest and booking are established by two independent local outlets; the interview detail comes from the FOIA body-cam footage and police reports."},{"id":"c4","status":"corroborated","evidence":[{"locator":"'Deputies interviewed her and came to the conclusion that she made the comment out of \"exasperation,\" had no intentions to harm anyone, and was not a threat to the school.'","relation":"supports","source_id":"s3"},{"locator":"District email: 'Law enforcement officers quickly determined that the student teacher made the statement out of exasperation... but did not have any actual intent to shoot anyone or otherwise cause harm.'","relation":"supports","source_id":"s2"}],"assertion":"The Sheriff's Office and the district concluded the remark was made out of exasperation, with no intent to harm and no threat to the school.","causal_attribution":"Both the district's letter and the deputies' own conclusion are attributed; no source reports any contrary finding."},{"id":"c5","status":"corroborated","evidence":[{"locator":"'it said the student teacher would not be returning to District 50 to complete her assignment.'","relation":"supports","source_id":"s2"},{"locator":"Superintendent Chad Allaman's letter: 'Volpe is not returning to the school to finish her educational assignment.'","relation":"supports","source_id":"s3"}],"assertion":"The district told parents she would not return to District 50 to complete her educational assignment.","causal_attribution":"The district's decision is attributed to its own letter carried by two outlets."}],"effects":[{"label":"arrest and loss of a teaching placement after an automated flag escalated a private joke to law enforcement","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.pjstar.com/story/news/local/2026/04/10/how-an-fbi-tip-led-to-arrest-of-a-student-teacher-in-washington-illinois/88217675007/","kind":"news_report_foia_records","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (datePublished 2026-04-10T11:15Z; 34 paragraphs). Based on sheriff's deputy and detective reports plus body-camera footage obtained by FOIA from the Tazewell County Sheriff's Office.","independence_group":"pjstar"},{"id":"s2","url":"https://www.pjstar.com/story/news/education/2025/01/30/washington-il-student-teacher-makes-inappropriate-shooting-comment-district-says/78061557007/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (datePublished 2025-01-30T23:13Z). Based on the District 50 email to parents; withheld the teacher's name.","independence_group":"pjstar"},{"id":"s3","url":"https://www.25newsnow.com/2025/01/31/exasperated-student-teacher-wont-return-after-allegedly-commenting-about-shooting-student/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (datePublished 2025-01-31T17:07Z). Attributes to deputies and the school district; names the teacher from jail records — the name is deliberately not carried into this public record.","independence_group":"week-25news"},{"id":"s4","url":"https://thoughtcatalog.com/jeremy-london/2026/08/snapchat-scans-your-private-group-chats-and-a-22-year-old-teacher-found-out-when-deputies-showed-up-to-arrest-her-over-a-joke/","kind":"content_farm_rehash","access":"read","language":"en","translation_note":"Read on 2026-09-15 (datePublished 2026-08-02). Two substantive paragraphs, 'reportedly' framing, no place, date or document; derivative of the 2025 local reporting with embellishments. Recorded for provenance; never cited as support.","independence_group":"thought-catalog"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","work","justice","privacy"],"unknowns":["The disposition of the disorderly conduct charge (dismissal, plea, supervision) is not reported in the inspected sources.","The flagging technology Snapchat used (automated classifiers, hash matching or otherwise) is not specified in the inspected records.","Whether she continued teacher training elsewhere is not reported.","The school's name appears as 'John A. Hensey School' (Peoria Journal Star) and 'John L. Hensey Elementary School' (25News Now); the discrepancy is unresolved.","The exact interval between sending the message and the FBI referral is not stated; content-farm claims of 'within an hour' are unverified."],"geography":{"basis":"Event: John A. Hensey School, Washington, Illinois (25News Now renders the school name 'John L. Hensey Elementary School'), and the Tazewell County Jail. Affected person: the student teacher at that school. No court proceeding is reported, so court_countries is [].","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as an institutional-use automated-moderation case: a consequential institutional response (arrest, placement loss) to an automated flag of a private message, documented by FOIA-based local reporting. She is an adult; although local TV named her from jail records, she is not named here because deputies cleared her of intent and republication adds reputational risk without evidential value.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"Police reports obtained under FOIA state 'the social media site flagged the message and warned the FBI', and the district's email says the language use 'triggered a report to law enforcement'; no human reporter was involved. The flagging technology (automated classifiers or otherwise) is not specified in the inspected records.","status":"supported"},"person_relations":["made_decision_about","made_claim_about"]},"name":"Washington, Illinois: Snapchat flagged a student teacher's private joke to the FBI; she was arrested at her school and lost her placement","summary":"On 29 January 2025, a 22-year-old student teacher at a District 50 elementary school in Washington, Illinois, vented in a private Snapchat group chat with her boyfriend and two roommates after a third-grade student turned off her computer mid lesson-plan, asking whether she should 'shoot the child or just the whole school' (per sheriff's reports). Snapchat's systems flagged the message and warned the FBI, which notified the Tazewell County Sheriff's Office at 1:06 p.m. Deputies interviewed her at the school, confirmed she sent it as a joke, searched her phone and belongings with her consent and found no weapons, and arrested her on a disorderly conduct charge; they concluded she had spoken out of 'exasperation' with no intent to harm and no threat to the school. The district told parents she would not return to complete her educational assignment.","incidentDate":"2025-01-29","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-01-30","aiSystem":"Snapchat automated content-flagging system","aiProduct":"Snapchat content-flagging system","aiCompany":"Snap Inc.","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["legal_harm","professional_harm"],"harmOutcomeSummary":"A private joke flagged by an automated system led to an armed-response interview at her workplace, arrest and jail booking on a disorderly conduct charge, and the loss of her student-teaching placement, although deputies and the district concluded she never intended harm.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One documented harmed person: the student teacher, subject to the platform's institutional automated flagging (counted under institutional use, not as an AI user). No student or staff member was aware of the conversation per the district; the referenced third-grade student is not counted as harmed (deputies found no threat and no one else saw the private message).","victimAgeRange":"adult","jurisdiction":"US","platformType":"other","outcomeType":"criminal_charges","outcomeStatus":"unknown","primarySourceUrl":"https://www.pjstar.com/story/news/local/2026/04/10/how-an-fbi-tip-led-to-arrest-of-a-student-teacher-in-washington-illinois/88217675007/","primarySourceLabel":"Peoria Journal Star (10 Apr 2026) — FOIA-based account: sheriff's reports and body-camera footage","firstPublishedAt":"2026-09-15T05:24:48.263548+00:00","updatedAt":"2026-09-30T01:17:21.046347+00:00","scopeVersion":"facts-v3","tags":["privacy","automated-moderation","snapchat","education","arrest","institutional-use","illinois"]}]}