{"meta":{"exportedAt":"2026-10-24T06:37:55.035Z","formatVersion":2,"selection":{"q":"computer-vision","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":2,"languages":1,"unknownLocation":0,"locationPending":0,"unknownLanguage":0,"unknownDate":1,"lawsuits":0,"regulatory":0,"minors":1,"coreRelations":0,"contextualRelations":2,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2026-australian-supermarket-cashier-given-final-written-warning-after-ai-checkout-camera-flags-union-says","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"A supermarket employee with more than 30 years' service recently received a final written warning for scanning inaccuracy, generated by an AI checkout monitoring system","relation":"supports","source_id":"s1"},{"locator":"a cashier at one big supermarket received a final written warning because the AI monitoring system had flagged her making too many errors.","relation":"supports","source_id":"s2"},{"locator":"The union’s submission tells of a supermarket worker with more than 30 years’ service who received a final written warning for scanning errors. An AI checkout system, using overhead cameras to match items against scans, generated it.","relation":"supports","source_id":"s3"}],"assertion":"The SDA says a supermarket employee with more than 30 years' service recently received a final written warning for scanning inaccuracy generated by an AI checkout monitoring system.","causal_attribution":"The union's account in its parliamentary submission; the Guardian and the Sydney Morning Herald relay the same submission. The supermarket is not named and its response is not reported."},{"id":"c2","status":"reported","evidence":[{"locator":"system that uses overhead cameras to compare items moved through the checkout against items scanned, flagging alerts wherever it detects a possible mismatch. Those alerts are automated and do not appear to account for transaction complexity, customer interaction, or ordinary human error","relation":"supports","source_id":"s1"}],"assertion":"According to the SDA, the system uses overhead cameras to compare items moved through the checkout with items scanned and flags an alert wherever it detects a possible mismatch; the alerts are automated.","causal_attribution":"The SDA's description of the system; no vendor or technical documentation is cited."},{"id":"c3","status":"reported","evidence":[{"locator":"in practice they trigger an escalation cycle where the system flags a possible issue, head office visibility is triggered, store management is expected to respond, and disciplinary action becomes the easiest defensible outcome for a manager under scrutiny from above.","relation":"supports","source_id":"s1"}],"assertion":"The SDA says the alerts set off an escalation in which head office is alerted, store management is expected to respond and disciplinary action becomes the easiest defensible outcome.","causal_attribution":"The union's characterisation of how the alerts are used; the employer's process is not independently described."},{"id":"c4","status":"reported","evidence":[{"locator":"Her error rate was approximately 0.18 per cent (roughly one error per 533 items scanned), consistent with ordinary human variation; At no point was she told what error rate the system considered acceptable, what tolerance applied, what benchmark the system used","relation":"supports","source_id":"s1"},{"locator":"The error rate was reported to be 0.18%, or roughly one error per 533 items scanned.","relation":"supports","source_id":"s2"}],"assertion":"The SDA says the employee's error rate was about 0.18 per cent, roughly one error per 533 items scanned, and that she was never told what error rate or tolerance the system treated as acceptable.","causal_attribution":"Figures and the account of non-disclosure come from the SDA; the Guardian relays them."},{"id":"c5","status":"reported","evidence":[{"locator":"The union has challenged the warning.","relation":"supports","source_id":"s3"}],"assertion":"The Sydney Morning Herald reports that the union has challenged the warning.","causal_attribution":"The Herald's statement; no detail or result of the challenge is given."}],"effects":[{"label":"final written warning for scanning inaccuracy generated by AI checkout monitoring (union account)","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.aph.gov.au/DocumentStore.ashx?id=48979385-479f-45cb-abdb-7b1293a401c3&subId=802196","kind":"union_submission","access":"read","language":"en","translation_note":"English PDF (Submission 17, published on aph.gov.au) read in full on 2026-10-24 by the research agent (an AI); no translation required. The submission is undated; it cites reports from July 2026.","independence_group":"sda-submission-17-ai-committee"},{"id":"s2","url":"https://www.theguardian.com/technology/2026/oct/20/workplace-privacy-concerns-employers-use-ai-to-monitor-staff","kind":"news_report","access":"read","language":"en","translation_note":"English article read in full on 2026-10-24 by the research agent (an AI) (HTTP 200); no translation required. It relays the SDA submission, so it shares its independence group.","independence_group":"sda-submission-17-ai-committee"},{"id":"s3","url":"https://www.smh.com.au/technology/i-never-gave-consent-the-australians-being-replaced-with-copies-of-themselves-20261010-p613x1.html","kind":"news_report","access":"read","language":"en","translation_note":"English article of 10 October 2026 read in full on 2026-10-24 by the research agent (an AI) (HTTP 200); no translation required. It relays the SDA submission, so it shares its independence group, and adds that the union has challenged the warning.","independence_group":"sda-submission-17-ai-committee"}],"version":1,"ai_roles":["institutional_use"],"contexts":["work"],"unknowns":["When the warning was issued; the submission says only that it was received recently.","Which supermarket chain and which monitoring product were involved.","Whether the system's individual alerts were correct, and whether a manager reviewed them before the warning.","The form and result of the union's challenge to the warning; the supermarket has not responded in any inspected source."],"geography":{"basis":"The SDA describes itself as one of Australia's largest trade unions and wrote the case study for the Australian parliament's committee about its members' workplaces; the Guardian reports it as an Australian case. The state and store are not stated.","court_countries":[],"event_countries":["AU"],"affected_person_countries":[]},"publication":{"basis":"Published as a single workplace event: the SDA's parliamentary submission says an AI checkout camera system's automated alerts generated a final written warning to a long-serving cashier, and describes how the alerts reached management. The account is attributed to the union, relayed by the Sydney Morning Herald and the Guardian, and the employer has not been heard.","reviewed_on":"2026-10-24"},"ai_involvement":{"basis":"The SDA's submission says the system's overhead cameras compare items moved through the checkout with items scanned and automatically flag possible mismatches attributed to the cashier, and that the final written warning was generated by this system through an escalation from its alerts to head office and store management. The AI's own flags are the reported basis of the warning; the description is the union's and the supermarket has not been heard.","status":"reported"},"person_relations":["made_claim_about","informed_decision_about"]},"name":"Australian supermarket cashier got final written warning after AI checkout camera system flagged scanning errors, union submission says","summary":"The Shop, Distributive and Allied Employees' Association (SDA), an Australian union representing retail, warehouse and fast-food workers, told the federal parliament's Joint Select Committee on Artificial Intelligence in its written submission that a supermarket employee with more than 30 years' service had recently received a final written warning for scanning inaccuracy generated by an AI checkout monitoring system. According to the union, the system uses overhead cameras to compare items moved through the checkout with items scanned and automatically flags possible mismatches, which set off escalation to head office and pressure on store managers to act. The SDA says her error rate was about 0.18 per cent, roughly one error in 533 items scanned, and that she was never told what standard the system applied. The Sydney Morning Herald (10 October 2026) and Guardian Australia (20 October 2026) reported the case; the Herald says the union has challenged the warning. The account is the union's; the supermarket is not named, and its response and the result of the challenge are not reported.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"repeated_interactions","reportedDate":"2026-10-10","aiSystem":"AI checkout monitoring system at an unnamed Australian supermarket that, according to the SDA, uses overhead cameras to compare items moved through the checkout with items scanned and automatically flags possible mismatches","aiProduct":"Unidentified AI checkout camera monitoring system","severity":"low","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["professional_harm"],"harmOutcomeSummary":"A long-serving supermarket cashier received a final written warning for scanning inaccuracy that her union says was generated by an AI checkout camera system's automated alerts, against a standard never disclosed to her (SDA submission).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"The SDA submission describes one employee who received the final written warning. She was monitored by the system, not its user.","victimAgeRange":"adult","jurisdiction":"AU","platformType":"other","outcomeStatus":"pending","primarySourceUrl":"https://www.aph.gov.au/DocumentStore.ashx?id=48979385-479f-45cb-abdb-7b1293a401c3&subId=802196","primarySourceLabel":"SDA, Submission 17 to the Joint Select Committee on Artificial Intelligence (2026)","firstPublishedAt":"2026-10-24T03:05:55.387375+00:00","updatedAt":"2026-10-24T03:15:07.072689+00:00","scopeVersion":"facts-v3","tags":["workplace-ai","ai-monitoring","employment","retail","computer-vision"]},{"id":"2025-florida-middle-school-ai-gun-detection-flagged-students-clarinet-lockdown-police-response","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'On Dec. 9, police rushed to'; 'after an AI weapons detection system spotted a student with what looked like a gun. When officers reviewed the security cameras, they noticed the suspected weapon was a band instrument.'; 'A student was walking in the hallway, holding a musical instrument as if it were a weapon, which triggered the Code Red to activate.'","relation":"supports","source_id":"s2"},{"locator":"'An AI – based weapon detection system mistakenly triggered a campus lockdown at a Florida middle school after identifying a clarinet as a firearm'","relation":"supports","source_id":"s3"},{"locator":"'A Florida middle school was locked down last week after an AI security system called ZeroEyes mistook a clarinet for a gun'","relation":"supports","source_id":"s1"}],"assertion":"On 9 December 2025 the ZeroEyes AI weapons detection system flagged a student carrying a clarinet in a Florida middle school as a possible gun, and the school went into a Code Red lockdown while police responded.","causal_attribution":"The AI flag as reported by the outlets and the principal's letter; the flag passed ZeroEyes' human review before police were sent."},{"id":"c2","status":"reported","evidence":[{"locator":"'When its AI model believes it has detected a weapon, footage is transmitted to human analysts at ZeroEyes' monitoring center, who confirm the alert before notifying law enforcement or schools.'","relation":"supports","source_id":"s3"},{"locator":"'Human review of the AI-generated false flag did not stop police from rushing to'; 'Monitoring these systems continually, humans review AI flags, then text any concerning images detected to school superintendents. Police are alerted when human review determines images may constitute actual threats.'","relation":"supports","source_id":"s1"}],"assertion":"ZeroEyes' system sends possible weapon detections to human analysts at its monitoring centre, who confirm them before notifying schools or police; this review did not stop the police response.","causal_attribution":"Description of the vendor's process; how the reviewers assessed this alert is not reported."},{"id":"c3","status":"reported","evidence":[{"locator":"'Cops expected to find “a man in the building, dressed in camouflage with a ‘suspected weapon pointed down the hallway, being held in the position of a shouldered rifle,’” a Washington Post review of the police report said.'; 'Instead, after finding no evidence of a shooter, cops double-checked with dispatchers who confirmed that a closer look at the images indicated that “the suspected rifle might have been a band instrument.” Among panicked students hiding in the band room, police eventually found the suspect, a student “dressed as a military character from the Christmas movie Red One for the school’s Christmas-themed dress-up day,” the Post reported.'","relation":"supports","source_id":"s1"},{"locator":"'The boy seen on school security cameras holding the clarinet “in the position of a shouldered rifle” was also dressed in camo and wearing a tactical vest.'; 'the suspected weapon was likely an instrument.'","relation":"supports","source_id":"s2"}],"assertion":"According to the police report, officers expected an armed person in camouflage with a suspected weapon held as a shouldered rifle; after finding no shooter they were told the suspected rifle might have been a band instrument, and they found the student, dressed as a military film character for a dress-up day, among panicked students hiding in the band room.","causal_attribution":"The police report as described by The Washington Post (via Ars Technica) and by WKMG; one document."},{"id":"c4","status":"reported","evidence":[{"locator":"'Cops left after the confused student confirmed he was “unaware” that the way he was holding his clarinet could have triggered that alert, the Post reported.'; 'the children were never in any danger,” police confirmed'","relation":"supports","source_id":"s1"}],"assertion":"Police left after the student said he was unaware that the way he held the clarinet could trigger the alert; police said the children were never in any danger.","causal_attribution":"The student's account and the police statement as reported by the Post via Ars Technica."},{"id":"c5","status":"reported","evidence":[{"locator":"'“We did not make an error, and the school was pleased with the detection and their response,” ZeroEyes’ spokesperson said.'; 'But ZeroEyes’ spokesperson claimed he was “intentionally holding the instrument in the position of a shouldered rifle.”'","relation":"supports","source_id":"s1"},{"locator":"'which states the safety system worked as intended.'","relation":"supports","source_id":"s2"},{"locator":"'While there was no threat to campus, I'd like to ask you to speak with your student about the dangers of pretending to have a weapon on a school campus.'","relation":"supports","source_id":"s3"}],"assertion":"ZeroEyes said it had not made an error and that the student was intentionally holding the instrument like a rifle; the district said the system worked as intended, and the principal asked parents to talk to their children about the dangers of pretending to have a weapon.","causal_attribution":"The vendor's and district's positions, which dispute that the alert was an error; recorded as counterevidence to the outlets' 'mistook' framing."},{"id":"c6","status":"reported","evidence":[{"locator":"'When officers questioned the band student'; 'No weapons were located in the student’s backpack or instrument case.'; 'the company treated it as a true positive until the investigation on the ground realized there was no assault rifle, then classified the case as a false positive.'; 'ZeroEyes provides information; the company does not trigger lockdowns or code reds in schools.'","relation":"supports","source_id":"s4"}],"assertion":"Officers questioned the student and found no weapons in his backpack or instrument case; ZeroEyes treated the alert as a true positive until the investigation on the ground found no rifle and then classified it as a false positive, and says it provides information but does not itself trigger lockdowns.","causal_attribution":"Oviedo Community News, February 2026, from the police account and ZeroEyes staff interviews."}],"effects":[{"label":"a student's clarinet was flagged as a possible gun, the school locked down and police searched for an armed person","claim_id":"c1","direction":"negative"},{"label":"police located the student as the suspect among panicked students hiding in the band room","claim_id":"c3","direction":"negative"},{"label":"officers questioned the student and searched his backpack and instrument case","claim_id":"c6","direction":"negative"}],"sources":[{"id":"s1","url":"https://arstechnica.com/tech-policy/2025/12/florida-schools-plan-to-vastly-expand-use-of-ai-that-mistook-clarinet-for-gun/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23; HTTP 200, full text read. Relays The Washington Post's review of the police report and adds ZeroEyes' and the district's statements to Ars.","independence_group":"seminole-county-police-report-dec-2025"},{"id":"s2","url":"https://www.clickorlando.com/news/local/2025/12/18/why-ai-and-a-student-with-a-clarinet-put-a-seminole-county-school-on-lockdown/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23; HTTP 200, full text read. WKMG obtained the same police report and prints the principal's letter to families; same group because both rest on that report.","independence_group":"seminole-county-police-report-dec-2025"},{"id":"s3","url":"https://www.techspot.com/news/110591-florida-school-went-lockdown-after-ai-flagged-clarinet.html","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23; HTTP 200, full text read. Early report (13 Dec 2025) with the principal's letter and the district's ZeroEyes contract.","independence_group":"techspot-dec-2025"},{"id":"s4","url":"https://oviedocommunitynews.org/2026/02/11/oviedo-school-weapon-incident-highlights-human-element-in-ai-security-systems/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23 from an Internet Archive capture (the direct fetch returned 429); full text read. Local news report of 11 Feb 2026 with interviews of ZeroEyes staff and police-report details.","independence_group":"oviedo-community-news-feb-2026"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","justice"],"unknowns":["How ZeroEyes' human analysts assessed the images before the alert went out.","How long the lockdown lasted and whether the student faced any school discipline.","Whether any student or parent reported lasting distress."],"geography":{"basis":"The school is in Seminole County, Florida, United States (WKMG; TechSpot). Where the students live is not stated. No court is involved.","court_countries":[],"event_countries":["US"],"affected_person_countries":[]},"publication":{"basis":"Published because an AI weapons detection system's recognition of a clarinet as a possible gun led to a school lockdown and a police search that located a student as the suspect, as described from the police report by The Washington Post (via Ars Technica) and WKMG. The vendor's and district's view that this was not an error, and ZeroEyes' later classification of the case as a false positive, are both recorded.","reviewed_on":"2026-10-23"},"ai_involvement":{"basis":"The ZeroEyes computer-vision system recognised the clarinet a student was holding as a possible gun (WKMG; TechSpot; Ars Technica). That output, passed by ZeroEyes' human analysts, triggered the Code Red lockdown and the police response that located the student as the suspect, according to the principal's letter and the police report as relayed. ZeroEyes and the district say the detection was correct given how the student held the instrument, while ZeroEyes later classified the case as a false positive (Oviedo Community News); the record keeps both.","status":"reported"},"person_relations":["made_claim_about","informed_decision_about"]},"name":"Florida middle school locked down and police sent after ZeroEyes AI gun detection flagged a student's clarinet as a possible gun, reports say","summary":"On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.","incidentDate":"2025-12-09","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-12-13","aiSystem":"ZeroEyes AI gun detection, a computer-vision system that scans a school's security camera feeds for weapons and sends possible detections to ZeroEyes' human analysts, who confirm alerts before notifying schools or police; used by Seminole County Public Schools","aiProduct":"ZeroEyes gun detection","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"A ZeroEyes AI alert on a student's clarinet put a Florida middle school into lockdown and sent police looking for an armed person; police found the student among panicked students hiding in the band room, according to the police report as relayed by Ars Technica.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"partial","affectedCountEvidence":"One counted person: the student whose clarinet was flagged and whom police located as the suspect (police report as relayed by Ars Technica and WKMG). The panicked students hiding in the band room are described without a number and are not counted. Staff, parents and the school's enrolment are not counted.","victimAgeRange":"minor","jurisdiction":"US-FL","platformType":"other","outcomeType":"media_coverage","outcomeStatus":"resolved","primarySourceUrl":"https://arstechnica.com/tech-policy/2025/12/florida-schools-plan-to-vastly-expand-use-of-ai-that-mistook-clarinet-for-gun/","primarySourceLabel":"Ars Technica: School security AI flagged clarinet as a gun. Exec says it wasn't an error. (18 Dec 2025)","firstPublishedAt":"2026-10-23T03:09:47.987937+00:00","updatedAt":"2026-10-23T03:09:47.987937+00:00","scopeVersion":"facts-v3","tags":["zeroeyes","weapon-detection","school-lockdown","false-alarm","police-response","florida"]}]}