{"meta":{"exportedAt":"2026-10-17T09:08:28.623Z","formatVersion":2,"selection":{"q":"television","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"2025","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":1,"languages":1,"unknownLocation":1,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":1,"regulatory":0,"minors":1,"coreRelations":0,"contextualRelations":2,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-baltimore-county-md-school-ai-gun-alert-chip-bag-student-searched","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"after an AI-driven security system flagged the teen's empty bag of chips as a possible firearm","relation":"supports","source_id":"s1"},{"locator":"How did it come to be that we had police officers with guns drawn approaching a kid because of a bag of Doritos?","relation":"supports","source_id":"s3"},{"locator":"Omnilert AI Gun Detection System warned school leaders at Kenwood High School that a student had a gun.","relation":"supports","source_id":"s3"},{"locator":"Police officers responded to the school, searched the individual, and quickly confirmed that they were not in possession of any weapons.","relation":"supports","source_id":"s3"}],"assertion":"An AI gun detection system (Omnilert) alerted on a Kenwood High School student in Baltimore County, the object was a bag of chips and not a weapon, and police searched the student.","causal_attribution":"The reports connect the police response to the alert. The district and the vendor say the system operated as designed and that humans review alerts, so responsibility for the police response is contested between the system, the review steps and the responding staff."},{"id":"c2","status":"reported","evidence":[{"locator":"They made me get on my knees, put my hands behind my back, and cuffed me,","relation":"supports","source_id":"s1"},{"locator":"they had a gun pointed at me","relation":"supports","source_id":"s1"},{"locator":"handcuffed and searched","relation":"supports","source_id":"s2"}],"assertion":"The student reported being made to kneel, being handcuffed and searched, and having a gun pointed at them.","causal_attribution":"First-person account given to a local television station and relayed by the CNN wire and the Guardian (one chain). CNN also states the handcuffing in its own voice without naming a source other than the student interview. Police statements inspected confirm a search only."},{"id":"c3","status":"reported","evidence":[{"locator":"reviewed and canceled the gun detection alert after confirming there was no weapon","relation":"supports","source_id":"s1"},{"locator":"The principal didn't immediately realize the alert had been canceled","relation":"supports","source_id":"s1"},{"locator":"she reported the matter to Kenwood's school resource officer, who called local police for support","relation":"supports","source_id":"s1"},{"locator":"The Department of School Safety and Security reviewed and canceled the initial alert after confirming there was no weapon.","relation":"supports","source_id":"s3"}],"assertion":"The school district security department reviewed and canceled the alert after confirming there was no weapon. A district spokesperson said the principal did not immediately realize the alert had been canceled. The principal reported the matter to the school resource officer, who called police.","causal_attribution":"Account of the review sequence comes from the principal letter and district spokespeople. It attributes the police response to a communication gap after human review and does not exonerate the alert."},{"id":"c4","status":"reported","evidence":[{"locator":"Baltimore County officials say they want a review of the process that led to Monday's police response.","relation":"supports","source_id":"s1"},{"locator":"Baltimore County councilmembers are calling on school officials and police to review an A.I. gun detection system","relation":"supports","source_id":"s3"},{"locator":"Our counselors will provide direct support to the students who were involved in this incident","relation":"supports","source_id":"s2"}],"assertion":"County councilmembers called for a review of the AI system, and the school said counselors would support the students involved.","causal_attribution":"Institutional responses reported by the outlets. The outcome of any review is not established in the inspected sources."}],"effects":[{"label":"Student searched by armed police after a false AI weapon alert","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://abc7.com/post/student-handcuffed-doritos-bag-mistaken-gun-schools-ai-security-system-baltimore-county-maryland/18073796/","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"wbal-relay"},{"id":"s2","url":"https://www.theguardian.com/us-news/2025/oct/24/baltimore-student-ai-gun-detection-system-doritos","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"wbal-relay"},{"id":"s3","url":"https://www.cbsnews.com/baltimore/news/false-alarm-gun-detection-kenwood-maryland-artificial-intelligence-review/","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"wjz-cbs-baltimore"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","public_services"],"unknowns":["Event date is derived from the reports' \"Monday\" references relative to their publication dates (23 to 26 October 2025). The inspected bodies do not print the calendar date of the event.","The handcuffing and gun-pointing account is one first-person account relayed by two outlets, and CNN also states the handcuffing in its own voice without another named source. Police statements inspected confirm only a search after a report of a suspicious person with a weapon.","The outcome of the county review is not reported in the inspected sources.","The student's exact age is not stated. Sources call the student a teen and a child.","Vendor and district statements say the system worked as designed and that humans review alerts. Whether the review step or the alert caused the police dispatch is not settled."],"geography":{"basis":"The reports place the event at a high school in Baltimore County, Maryland, with the county police department and county council responding. Country is stated by place names in the inspected reports and is not inferred from outlet or vendor headquarters.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Three news reports read in full (one via Internet Archive capture). The AI alert, the absence of a weapon and the search are separately reported. The handcuffing account is attributed to the student. The student's name is omitted because the student is a minor.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"Two separately reported chains say the AI alert flagged the object: the CNN wire with a vendor statement (its student account is WBAL-derived, as is the Guardian, a WBAL relay), and local CBS reporting with vendor and superintendent statements. Both also report human review steps between the alert and the police response.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Baltimore County, Maryland: school AI gun alert on a bag of chips leads to police search of a student","summary":"On a Monday evening in October 2025 (20 October by the reports' weekday references) an AI gun detection system (Omnilert) used at Kenwood High School alerted on a student holding an empty bag of chips. Police responded and searched the student and found no weapon. The student told a local television station that officers made them kneel, handcuffed them and pointed a gun at them. The school district says its security department reviewed and canceled the alert after confirming there was no weapon, and a district spokesperson said the principal did not immediately realize the alert had been canceled. County councilmembers called for a review. No outcome of a review is established in the sources.","incidentDate":"2025-10-20","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-10-23","aiSystem":"Omnilert AI Gun Detection System (video analytics on school security cameras)","aiProduct":"Omnilert gun detection","aiCompany":"Omnilert","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["loss_of_liberty","psychological_distress"],"harmOutcomeSummary":"A student was searched by police after the AI alert and reported being handcuffed at gunpoint and fearing for their life (student account relayed by CNN and the Guardian). The school letter confirms a search and offers counseling.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"One student who was searched. Other students who witnessed the event are mentioned in the school letter but are not counted without a reported harm to each.","victimAgeRange":"minor","platformType":"other","primarySourceUrl":"https://www.cbsnews.com/baltimore/news/false-alarm-gun-detection-kenwood-maryland-artificial-intelligence-review/","primarySourceLabel":"CBS Baltimore (WJZ): A.I. gun detection false alarm at school has Baltimore County leaders calling for review, 23 October 2025","firstPublishedAt":"2026-09-29T12:42:19.255568+00:00","updatedAt":"2026-09-30T01:16:56.487109+00:00","scopeVersion":"facts-v3","tags":["historical-2025"]},{"id":"2025-keene-v-google-ai-overview-defamation","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"Opinion page 2 lists Overviews 1–4 separately: 1, 2 and 4 concern life without parole; 2 mentions murders of three women; 3 says he was convicted of drug trafficking. The analysis of Overview 3 and conclusion explain its substantial-truth dismissal.","relation":"supports","source_id":"s1"},{"locator":"Complaint excerpt: statements that he 'is serving a life sentence without parole for multiple convictions' and 'for the murders of 3 women'.","relation":"context","source_id":"s4"}],"assertion":"The court’s opinion recounts four challenged Google AI Overviews between approximately 24 May and 27 June 2025. The complaint alleges that Overviews 1, 2 and 4 falsely said Keene was serving life without parole, with Overview 2 adding murders of three women. Overview 3 instead said he had been convicted of drug trafficking; the court considered that statement substantially true.","causal_attribution":"Allegations of the complaint as recited by the court; accepted as true only for the motion to dismiss."},{"id":"c2","status":"documented","evidence":[{"locator":"Page 2: 'Keene complained to Google about the false statements on three occasions ... Google allegedly apologized ... and deemed the statements errors made by its Artificial Intelligence.' and 'AI Overviews 1 and 2 were seen by various family members, friends, and acquaintances.'","relation":"supports","source_id":"s1"},{"locator":"Complaint excerpt: 27 May 2025 complaint; Google 'privately apologized', attributing the statements to 'an unknown error made by their Artificial Intelligence Platform'.","relation":"context","source_id":"s4"}],"assertion":"The complaint alleges he notified Google on 27 May, 31 May and after 27 June 2025, that Google apologised each time and attributed the statements to errors by its AI, and that Overviews 1 and 2 were seen by family members, friends and acquaintances.","causal_attribution":"Allegations as recited by the court."},{"id":"c3","status":"documented","evidence":[{"locator":"Pages 1 and 12: 'that motion is granted in part and denied in part' ... 'the Court denies Google's motion to dismiss AI Overviews 1 and 2, and grants Google's motion to dismiss AI Overviews 3 and 4 without prejudice. Keene may file an amended complaint by October 13, 2026.'","relation":"supports","source_id":"s1"},{"locator":"Docket entry 29, 14 September 2026: 'Memorandum Opinion and Order AND Order on Motion to Dismiss'.","relation":"context","source_id":"s2"},{"locator":"Post quoting the opinion's actual-malice and disclaimer holdings.","relation":"supports","source_id":"s3"}],"assertion":"On 14 September 2026 Judge Thomas M. Durkin denied Google's motion to dismiss the defamation per se claim as to Overviews 1 and 2, holding that the plaintiff, a public figure, had plausibly pleaded actual malice through his three notifications, and dismissed the claims on Overviews 3 (substantially true) and 4 (publication not alleged) without prejudice, with leave to amend by 13 October 2026.","causal_attribution":"Court ruling on the pleadings; no finding of liability."},{"id":"c4","status":"documented","evidence":[{"locator":"Page 2: 'Keene filed his complaint ... on July 30, 2025, in the Circuit Court of Cook County. Google removed the suit to federal court on September 22, 2025.'","relation":"supports","source_id":"s1"},{"locator":"Docket header: filed 22 September 2025, No. 1:25-cv-11431.","relation":"supports","source_id":"s2"}],"assertion":"The suit was filed in the Circuit Court of Cook County on 30 July 2025 and removed by Google to federal court on 22 September 2025.","causal_attribution":"Procedural history from the court record."}],"effects":[{"label":"reputational_harm_from_false_ai_statements","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://storage.courtlistener.com/recap/gov.uscourts.ilnd.486629/gov.uscourts.ilnd.486629.29.0.pdf","kind":"court_opinion","access":"read","language":"en","translation_note":"Memorandum Opinion and Order, ECF No. 29, filed 14 September 2026; PDF read in full via CourtListener RECAP on 2026-09-15.","independence_group":"court-record"},{"id":"s2","url":"https://www.courtlistener.com/docket/71417738/keene-v-google-llc/","kind":"court_docket","access":"read","language":"en","translation_note":"Public docket page read on 2026-09-15.","independence_group":"court-record"},{"id":"s3","url":"https://reason.com/volokh/2026/09/14/federal-court-allows-libel-by-ai-claim-brought-by-protagonist-of-apple-tvs-black-bird-series-to-go-forward/","kind":"legal_commentary","access":"read","language":"en","translation_note":"Read on 2026-09-15; quotes the opinion.","independence_group":"court-record"},{"id":"s4","url":"https://reason.com/volokh/2025/09/23/from-prison-to-helping-the-fbi-to-an-apple-tv-miniseries-to-google-hallucinated-libel/","kind":"legal_commentary","access":"read","language":"en","translation_note":"Read on 2026-09-15; quotes the complaint at removal.","independence_group":"court-record"}],"version":1,"ai_roles":["institutional_use"],"contexts":["everyday_life","privacy","justice"],"unknowns":["The plaintiff's residence and the locations where the Overviews were generated or viewed are not stated in the inspected records.","No damages figure appears in the inspected records.","The complaint exhibits (screenshots of the Overviews) were not inspected.","The case continues; an amended complaint was due by 13 October 2026."],"geography":{"basis":"The AI Overviews were generated online in response to searches; where they were generated or viewed is not stated. The plaintiff's residence is not stated in the inspected records, and the charter does not infer a country from the court. Court: United States District Court for the Northern District of Illinois, after removal from the Circuit Court of Cook County.","court_countries":["US"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published on the strength of the court's own opinion and docket, read in full, with legal commentary as context. The plaintiff is a public figure who sued under his own name; allegations are attributed to the complaint and the ruling is limited to the pleadings.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"The statements at issue appeared in Google's AI Overviews, and the court's opinion recites the allegation that Google attributed them to errors by its artificial intelligence. The screenshots are exhibits to the complaint and were not inspected here; the court accepted the allegations as true for the motion to dismiss only.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Keene v. Google: defamation claim over AI Overviews calling an author a convicted murderer survives dismissal","summary":"An author and television producer, the subject of the Apple TV series 'Black Bird', sued Google, alleging that AI Overviews shown for searches about him in May and June 2025 falsely said he was serving a life sentence without parole, in one version for the murders of three women. He says he notified Google three times and received apologies attributing the statements to its AI, yet similar statements kept appearing. On 14 September 2026 the Northern District of Illinois denied Google's motion to dismiss as to two of the four challenged Overviews and dismissed the other two without prejudice. This was a ruling on the pleadings, not a finding that the allegations were proven.","incidentDate":"2025-05-24","incidentEndDate":"2025-06-27","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"unknown","reportedDate":"2025-09-23","aiSystem":"Google AI Overviews","aiProduct":"Google AI Overviews","aiCompany":"Google LLC","severity":"medium","verificationStatus":"verified","harmCategories":[],"harmOutcomes":["reputational_harm"],"harmOutcomeSummary":"The plaintiff alleges that false AI-generated statements that he was a convicted murderer serving life without parole were shown to searchers, including family, friends and acquaintances, and continued after he notified Google.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person is the subject of the alleged defamatory statements and the plaintiff (court opinion). Family and acquaintances who saw the statements are not counted as harmed.","victimAgeRange":"adult","outcomeType":"lawsuit_ongoing","outcomeStatus":"ongoing","primarySourceUrl":"https://storage.courtlistener.com/recap/gov.uscourts.ilnd.486629/gov.uscourts.ilnd.486629.29.0.pdf","primarySourceLabel":"Memorandum Opinion and Order, Keene v. Google LLC, No. 25 C 11431 (N.D. Ill. 14 September 2026), ECF No. 29, via CourtListener RECAP","firstPublishedAt":"2026-09-15T03:23:44.732123+00:00","updatedAt":"2026-09-30T01:17:07.683768+00:00","scopeVersion":"facts-v3","tags":["defamation","ai-overviews","google","hallucination","lawsuit","reputational-harm"]}]}