{"meta":{"exportedAt":"2026-10-23T09:23:09.597Z","formatVersion":2,"selection":{"q":"children","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"","response":"minors","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":5,"coverage":{"cases":5,"countries":3,"languages":2,"unknownLocation":0,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":1,"regulatory":0,"minors":5,"coreRelations":1,"contextualRelations":5,"mixedRelations":1,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-florida-middle-school-ai-gun-detection-flagged-students-clarinet-lockdown-police-response","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'On Dec. 9, police rushed to'; 'after an AI weapons detection system spotted a student with what looked like a gun. When officers reviewed the security cameras, they noticed the suspected weapon was a band instrument.'; 'A student was walking in the hallway, holding a musical instrument as if it were a weapon, which triggered the Code Red to activate.'","relation":"supports","source_id":"s2"},{"locator":"'An AI – based weapon detection system mistakenly triggered a campus lockdown at a Florida middle school after identifying a clarinet as a firearm'","relation":"supports","source_id":"s3"},{"locator":"'A Florida middle school was locked down last week after an AI security system called ZeroEyes mistook a clarinet for a gun'","relation":"supports","source_id":"s1"}],"assertion":"On 9 December 2025 the ZeroEyes AI weapons detection system flagged a student carrying a clarinet in a Florida middle school as a possible gun, and the school went into a Code Red lockdown while police responded.","causal_attribution":"The AI flag as reported by the outlets and the principal's letter; the flag passed ZeroEyes' human review before police were sent."},{"id":"c2","status":"reported","evidence":[{"locator":"'When its AI model believes it has detected a weapon, footage is transmitted to human analysts at ZeroEyes' monitoring center, who confirm the alert before notifying law enforcement or schools.'","relation":"supports","source_id":"s3"},{"locator":"'Human review of the AI-generated false flag did not stop police from rushing to'; 'Monitoring these systems continually, humans review AI flags, then text any concerning images detected to school superintendents. Police are alerted when human review determines images may constitute actual threats.'","relation":"supports","source_id":"s1"}],"assertion":"ZeroEyes' system sends possible weapon detections to human analysts at its monitoring centre, who confirm them before notifying schools or police; this review did not stop the police response.","causal_attribution":"Description of the vendor's process; how the reviewers assessed this alert is not reported."},{"id":"c3","status":"reported","evidence":[{"locator":"'Cops expected to find “a man in the building, dressed in camouflage with a ‘suspected weapon pointed down the hallway, being held in the position of a shouldered rifle,’” a Washington Post review of the police report said.'; 'Instead, after finding no evidence of a shooter, cops double-checked with dispatchers who confirmed that a closer look at the images indicated that “the suspected rifle might have been a band instrument.” Among panicked students hiding in the band room, police eventually found the suspect, a student “dressed as a military character from the Christmas movie Red One for the school’s Christmas-themed dress-up day,” the Post reported.'","relation":"supports","source_id":"s1"},{"locator":"'The boy seen on school security cameras holding the clarinet “in the position of a shouldered rifle” was also dressed in camo and wearing a tactical vest.'; 'the suspected weapon was likely an instrument.'","relation":"supports","source_id":"s2"}],"assertion":"According to the police report, officers expected an armed person in camouflage with a suspected weapon held as a shouldered rifle; after finding no shooter they were told the suspected rifle might have been a band instrument, and they found the student, dressed as a military film character for a dress-up day, among panicked students hiding in the band room.","causal_attribution":"The police report as described by The Washington Post (via Ars Technica) and by WKMG; one document."},{"id":"c4","status":"reported","evidence":[{"locator":"'Cops left after the confused student confirmed he was “unaware” that the way he was holding his clarinet could have triggered that alert, the Post reported.'; 'the children were never in any danger,” police confirmed'","relation":"supports","source_id":"s1"}],"assertion":"Police left after the student said he was unaware that the way he held the clarinet could trigger the alert; police said the children were never in any danger.","causal_attribution":"The student's account and the police statement as reported by the Post via Ars Technica."},{"id":"c5","status":"reported","evidence":[{"locator":"'“We did not make an error, and the school was pleased with the detection and their response,” ZeroEyes’ spokesperson said.'; 'But ZeroEyes’ spokesperson claimed he was “intentionally holding the instrument in the position of a shouldered rifle.”'","relation":"supports","source_id":"s1"},{"locator":"'which states the safety system worked as intended.'","relation":"supports","source_id":"s2"},{"locator":"'While there was no threat to campus, I'd like to ask you to speak with your student about the dangers of pretending to have a weapon on a school campus.'","relation":"supports","source_id":"s3"}],"assertion":"ZeroEyes said it had not made an error and that the student was intentionally holding the instrument like a rifle; the district said the system worked as intended, and the principal asked parents to talk to their children about the dangers of pretending to have a weapon.","causal_attribution":"The vendor's and district's positions, which dispute that the alert was an error; recorded as counterevidence to the outlets' 'mistook' framing."},{"id":"c6","status":"reported","evidence":[{"locator":"'When officers questioned the band student'; 'No weapons were located in the student’s backpack or instrument case.'; 'the company treated it as a true positive until the investigation on the ground realized there was no assault rifle, then classified the case as a false positive.'; 'ZeroEyes provides information; the company does not trigger lockdowns or code reds in schools.'","relation":"supports","source_id":"s4"}],"assertion":"Officers questioned the student and found no weapons in his backpack or instrument case; ZeroEyes treated the alert as a true positive until the investigation on the ground found no rifle and then classified it as a false positive, and says it provides information but does not itself trigger lockdowns.","causal_attribution":"Oviedo Community News, February 2026, from the police account and ZeroEyes staff interviews."}],"effects":[{"label":"a student's clarinet was flagged as a possible gun, the school locked down and police searched for an armed person","claim_id":"c1","direction":"negative"},{"label":"police located the student as the suspect among panicked students hiding in the band room","claim_id":"c3","direction":"negative"},{"label":"officers questioned the student and searched his backpack and instrument case","claim_id":"c6","direction":"negative"}],"sources":[{"id":"s1","url":"https://arstechnica.com/tech-policy/2025/12/florida-schools-plan-to-vastly-expand-use-of-ai-that-mistook-clarinet-for-gun/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23; HTTP 200, full text read. Relays The Washington Post's review of the police report and adds ZeroEyes' and the district's statements to Ars.","independence_group":"seminole-county-police-report-dec-2025"},{"id":"s2","url":"https://www.clickorlando.com/news/local/2025/12/18/why-ai-and-a-student-with-a-clarinet-put-a-seminole-county-school-on-lockdown/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23; HTTP 200, full text read. WKMG obtained the same police report and prints the principal's letter to families; same group because both rest on that report.","independence_group":"seminole-county-police-report-dec-2025"},{"id":"s3","url":"https://www.techspot.com/news/110591-florida-school-went-lockdown-after-ai-flagged-clarinet.html","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23; HTTP 200, full text read. Early report (13 Dec 2025) with the principal's letter and the district's ZeroEyes contract.","independence_group":"techspot-dec-2025"},{"id":"s4","url":"https://oviedocommunitynews.org/2026/02/11/oviedo-school-weapon-incident-highlights-human-element-in-ai-security-systems/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English by the research agent (an AI) on 2026-10-23 from an Internet Archive capture (the direct fetch returned 429); full text read. Local news report of 11 Feb 2026 with interviews of ZeroEyes staff and police-report details.","independence_group":"oviedo-community-news-feb-2026"}],"version":1,"ai_roles":["institutional_use"],"contexts":["education","justice"],"unknowns":["How ZeroEyes' human analysts assessed the images before the alert went out.","How long the lockdown lasted and whether the student faced any school discipline.","Whether any student or parent reported lasting distress."],"geography":{"basis":"The school is in Seminole County, Florida, United States (WKMG; TechSpot). Where the students live is not stated. No court is involved.","court_countries":[],"event_countries":["US"],"affected_person_countries":[]},"publication":{"basis":"Published because an AI weapons detection system's recognition of a clarinet as a possible gun led to a school lockdown and a police search that located a student as the suspect, as described from the police report by The Washington Post (via Ars Technica) and WKMG. The vendor's and district's view that this was not an error, and ZeroEyes' later classification of the case as a false positive, are both recorded.","reviewed_on":"2026-10-23"},"ai_involvement":{"basis":"The ZeroEyes computer-vision system recognised the clarinet a student was holding as a possible gun (WKMG; TechSpot; Ars Technica). That output, passed by ZeroEyes' human analysts, triggered the Code Red lockdown and the police response that located the student as the suspect, according to the principal's letter and the police report as relayed. ZeroEyes and the district say the detection was correct given how the student held the instrument, while ZeroEyes later classified the case as a false positive (Oviedo Community News); the record keeps both.","status":"reported"},"person_relations":["made_claim_about","informed_decision_about"]},"name":"Florida middle school locked down and police sent after ZeroEyes AI gun detection flagged a student's clarinet as a possible gun, reports say","summary":"On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.","incidentDate":"2025-12-09","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-12-13","aiSystem":"ZeroEyes AI gun detection, a computer-vision system that scans a school's security camera feeds for weapons and sends possible detections to ZeroEyes' human analysts, who confirm alerts before notifying schools or police; used by Seminole County Public Schools","aiProduct":"ZeroEyes gun detection","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"A ZeroEyes AI alert on a student's clarinet put a Florida middle school into lockdown and sent police looking for an armed person; police found the student among panicked students hiding in the band room, according to the police report as relayed by Ars Technica.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"partial","affectedCountEvidence":"One counted person: the student whose clarinet was flagged and whom police located as the suspect (police report as relayed by Ars Technica and WKMG). The panicked students hiding in the band room are described without a number and are not counted. Staff, parents and the school's enrolment are not counted.","victimAgeRange":"minor","jurisdiction":"US-FL","platformType":"other","outcomeType":"media_coverage","outcomeStatus":"resolved","primarySourceUrl":"https://arstechnica.com/tech-policy/2025/12/florida-schools-plan-to-vastly-expand-use-of-ai-that-mistook-clarinet-for-gun/","primarySourceLabel":"Ars Technica: School security AI flagged clarinet as a gun. Exec says it wasn't an error. (18 Dec 2025)","firstPublishedAt":"2026-10-23T03:09:47.987937+00:00","updatedAt":"2026-10-23T03:09:47.987937+00:00","scopeVersion":"facts-v3","tags":["zeroeyes","weapon-detection","school-lockdown","false-alarm","police-response","florida"]},{"id":"2026-zhejiang-toddler-ai-asthma-diagnosis-mother-declined-chest-xray-pneumonia-hospitalised","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'今年8月，浙江一名3岁男童阳阳（化名）的案例令人警醒。阳阳有哮喘病史，妈妈在AI上输入“过敏、哮喘、咳嗽、夜间咳喘”等关键词，AI快速给出“支气管哮喘急性发作”的诊断'","relation":"supports","source_id":"s1"}],"assertion":"In August 2026 the mother of a three-year-old boy with a history of asthma in Zhejiang entered the keywords allergy, asthma, cough and night-time wheezing into an AI tool, which quickly returned a diagnosis of an acute bronchial asthma attack (newspaper account).","causal_attribution":"Guangming Daily's account; the tool is not identified."},{"id":"c2","status":"reported","evidence":[{"locator":"'阳阳妈妈据此拒绝医生建议的胸部X线平片检查，坚持只开雾化药回家'","relation":"supports","source_id":"s1"}],"assertion":"On the basis of that AI diagnosis the mother declined the chest X-ray examination the doctor recommended and insisted on taking home only nebuliser medication.","causal_attribution":"The feature attributes the refusal to the AI diagnosis (据此); this is the newspaper's account."},{"id":"c3","status":"reported","evidence":[{"locator":"'两天后孩子病情加重、呼吸急促，连夜返院检查发现双肺大面积炎症病灶，确诊为偏肺病毒肺炎叠加细菌感染，紧急住院'","relation":"supports","source_id":"s1"}],"assertion":"Two days later the child's condition worsened with rapid breathing; on an overnight return to the hospital, examination found extensive inflammatory lesions in both lungs, and he was diagnosed with human metapneumovirus pneumonia with a superimposed bacterial infection and admitted as an emergency.","causal_attribution":"Clinical course as described in the newspaper feature; it does not say whether pneumonia was present at the first visit."},{"id":"c4","status":"reported","evidence":[{"locator":"'“他们要是早点听我的，病情也不至于这么严重。”浙江省中医院儿科主任李岚无奈地说'","relation":"supports","source_id":"s1"}],"assertion":"The head of paediatrics at Zhejiang Provincial Hospital of Traditional Chinese Medicine is quoted saying the illness would not have become so severe had the family listened earlier.","causal_attribution":"The clinician's assessment that earlier compliance would have limited the severity; the newspaper reports it without an independent review of the records."}],"effects":[{"label":"Three-year-old admitted as an emergency with pneumonia two days after his mother, relying on an AI tool's acute-asthma diagnosis, declined a recommended chest X-ray (newspaper account)","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://finance.sina.cn/2026-10-08/detail-iniumumr7827547.d.html","kind":"news_article","access":"read","language":"zh","translation_note":"Chinese body read in full on 2026-10-09 and translated by the research agent (an AI). The Sina Finance page republishes a Bingtuan Daily item (兵团日报, dated 10.08 01:37) credited at the end to Guangming Daily (据《光明日报》); the case passage is told in the newspaper's voice and closes with a quotation from the hospital's head of paediatrics; the feature does not say where its account came from. Re-read on 2026-10-11.","independence_group":"guangming-daily-feature"}],"version":1,"ai_roles":["others_use"],"contexts":["health","everyday_life"],"unknowns":["Which AI tool the mother used.","Whether the tool's acute-asthma diagnosis was wrong in itself or only incomplete; the feature describes the later pneumonia diagnosis, not the asthma assessment.","Whether pneumonia was present or detectable at the first visit, when the chest X-ray was declined.","The exact dates in August 2026 of the first visit and the readmission.","The child's course after the emergency admission.","The family's own account, and where the newspaper obtained its account of the case; only the feature's account, closed with the paediatrics head's quotation, is available."],"geography":{"basis":"The feature places the case in Zhejiang (浙江一名3岁男童) and the treating clinician at Zhejiang Provincial Hospital of Traditional Chinese Medicine, so the event and the affected child are in China. No court is involved.","court_countries":[],"event_countries":["CN"],"affected_person_countries":["CN"]},"publication":{"basis":"Published as a concrete account in a national newspaper feature of a parent relying on an AI tool's symptom diagnosis for a young child, declining a recommended chest X-ray, and the child being admitted as an emergency two days later with pneumonia. Every assertion is attributed to the newspaper's account, and the view that the illness would have been less severe had the family listened earlier is attributed to the paediatrics head. The tool is unnamed. The child's pseudonym from the article appears only inside the verbatim Chinese passages of claims c1 and c2 and is not used in the narrative. The worsening and emergency admission after the declined X-ray, rather than the AI's asthma assessment, is recorded as the harm.","reviewed_on":"2026-10-11"},"ai_involvement":{"basis":"The feature states what the AI tool produced: after the mother entered the keywords allergy, asthma, cough and night-time wheezing, it quickly returned the diagnosis acute bronchial asthma attack. It connects that output to the harm in the next sentences: on that basis the mother declined the chest X-ray the doctor recommended and took home only nebuliser medication, and two days later the child was found to have extensive bilateral lung inflammation and was admitted as an emergency with metapneumovirus pneumonia and a bacterial infection. The account is Guangming Daily's, closed with a quotation from the hospital's head of paediatrics; the tool is unnamed and the family's own version is not reported, so the involvement is recorded as reported rather than supported.","status":"reported"},"person_relations":["made_claim_about","informed_decision_about"]},"name":"Zhejiang toddler hospitalised with pneumonia after his mother relied on an AI tool's asthma diagnosis and declined a chest X-ray (newspaper account)","summary":"A Guangming Daily feature on AI symptom-checking, republished by Bingtuan Daily on Sina Finance on 8 October 2026, recounts a case from August 2026 in Zhejiang and closes it with a quotation from the head of paediatrics at a provincial hospital, who says the family did not heed the doctor's advice. A three-year-old boy with a history of asthma was brought in; his mother had entered keywords such as allergy, asthma, cough and night-time wheezing into an AI tool, which quickly returned a diagnosis of an acute bronchial asthma attack. On that basis, the account says, she declined the chest X-ray the doctor recommended and insisted on taking home only nebuliser medication. Two days later the child's condition worsened with rapid breathing; on an overnight return to the hospital, examination found extensive inflammatory lesions in both lungs, and he was diagnosed with human metapneumovirus pneumonia with a superimposed bacterial infection and admitted as an emergency. The paediatrics head is quoted saying the illness would not have become so severe had the family listened earlier. The AI tool is not named. The case is told in the newspaper's voice, and the feature does not say where its account came from beyond the paediatrics head's quotation; no statement from the family is reported.","incidentDate":"2026-08-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"single_interaction","reportedDate":"2026-10-08","aiSystem":"An unnamed AI tool into which, by the account in the Guangming Daily feature, the mother entered symptom keywords and which returned a diagnosis of an acute bronchial asthma attack","aiProduct":"Unidentified symptom-analysis tool","severity":"medium","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["medical_deterioration","hospitalization","treatment_disruption"],"harmOutcomeSummary":"By the newspaper's account, after his mother, relying on an AI tool's acute-asthma diagnosis, declined the chest X-ray a doctor advised, a three-year-old's condition worsened over two days and he was admitted as an emergency with metapneumovirus pneumonia and a bacterial infection; the paediatrics head is quoted saying the illness would not have become so severe had the family listened earlier.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One child is reported harmed. The mother used the AI tool; the harm fell on the child, so he is counted as another person harmed and no direct user is counted as harmed.","victimAgeRange":"minor","jurisdiction":"CN","platformType":"other","outcomeStatus":"unknown","primarySourceUrl":"https://finance.sina.cn/2026-10-08/detail-iniumumr7827547.d.html","primarySourceLabel":"Sina Finance (Bingtuan Daily, credited to Guangming Daily), AI热潮下医患问诊之变与辨, 8 October 2026","firstPublishedAt":"2026-10-09T03:36:33.441089+00:00","updatedAt":"2026-10-11T07:43:54.606673+00:00","scopeVersion":"facts-v3","tags":["health","symptom_checker","children","declined_examination","china"]},{"id":"2020-aurora-colorado-license-plate-reader-alert-woman-four-children-gunpoint-stop-settlement","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'stopped the car, which they believed to be stolen, and ordered the four children'; 'Video shows the children screaming in fear as police handcuffed'; 'handcuffed two of the children'","relation":"supports","source_id":"s1"},{"locator":"'wrongfully forced out of their car on Aug. 2, 2020, in Aurora, Colo.'; 'everyone was ordered out and put on the ground'; 'Officers kept their guns drawn for about three-and-a-half minutes'","relation":"supports","source_id":"s2"}],"assertion":"On 2 August 2020 Aurora police officers stopped a car they believed to be stolen and ordered the woman driving it and four children to the ground at gunpoint. Two of the children were handcuffed.","causal_attribution":"The Denver Post from the prosecutors' letter and video; Sentinel Colorado from body camera video and the prosecutors' investigation. Kept as reported because both accounts draw on the prosecutors' investigation."},{"id":"c2","status":"reported","evidence":[{"locator":"'A license plate reader installed at an Aurora intersection had alerted police to the car, a blue SUV, because it had the same license plate numbers as a stolen motorcycle from Montana.'; 'Police failed to double-check a reading from a license plate scanner before making the stop.'; 'Officers failed to check whether the SUV matched the physical description of the stolen vehicle.'","relation":"supports","source_id":"s1"},{"locator":"'with Colorado license plates was stolen'; 'the vehicle that was actually stolen was a motorcycle with the same license plate number in Montana'","relation":"context","source_id":"s2"}],"assertion":"A license plate reader at an Aurora intersection alerted police to the car because its plate number matched that of a stolen motorcycle registered in Montana, and officers did not check the reading or the vehicle description before the stop.","causal_attribution":"The Denver Post's account in its report on the prosecutors' decision; the article does not attribute the reader sentences to the letter. Sentinel Colorado confirms the same-number mix-up and attributes the notification to the department's system without mentioning a reader."},{"id":"c3","status":"reported","evidence":[{"locator":"'The two girls remained handcuffed for four minutes, even after dispatchers confirmed that'","relation":"supports","source_id":"s1"},{"locator":"'removed the girls’ handcuffs after about eight-and-a-half minutes'","relation":"context","source_id":"s2"}],"assertion":"Two of the children remained handcuffed for four minutes after dispatchers confirmed the car was not stolen.","causal_attribution":"The prosecutors' letter as reported by The Denver Post. Sentinel Colorado gives the total time in handcuffs as about eight and a half minutes."},{"id":"c4","status":"reported","evidence":[{"locator":"'will not face criminal charges, prosecutors announced Friday'; 'What happened to the innocent occupants is unacceptable and preventable'; 'All department officers are re-doing training regarding license plate scanners'","relation":"supports","source_id":"s1"}],"assertion":"Prosecutors declined to charge the officers in January 2021, calling what happened unacceptable and preventable, and the department said all officers were repeating training on license plate scanners.","causal_attribution":"Prosecutors' decision and the department spokesperson as reported by The Denver Post."},{"id":"c5","status":"reported","evidence":[{"locator":"'the City of Aurora has agreed to a $1.9 million settlement'; 'announced Monday, Feb. 5, 2024, that the family has reached a $1.9 million legal settlement with the city of Aurora'; 'In a written statement, the city confirmed a deal had been reached.'; 'The money will be evenly divided among'; 'was suspended for 160 hours'","relation":"supports","source_id":"s2"}],"assertion":"The City of Aurora agreed to a $1.9 million settlement with the woman and the four children, announced by their lawyer on 5 February 2024 and confirmed by the city, to be divided evenly among the five. One of the two officers was suspended for 160 hours.","causal_attribution":"Settlement as announced by the lawyer for the woman and the children and confirmed by the city, reported by Sentinel Colorado. The agreement was not read."},{"id":"c6","status":"reported","evidence":[{"locator":"'Mentally, it destroyed me because I felt like not only am I not safe'; 'began acting out and became withdrawn'","relation":"supports","source_id":"s2"}],"assertion":"The woman said the stop destroyed her mentally, and that one of the children began acting out and became withdrawn afterwards.","causal_attribution":"The woman's own account in an interview reported by Sentinel Colorado."}],"effects":[{"label":"a woman and four children ordered out of a car and onto the ground at gunpoint, two of the children handcuffed, after a license plate reader alert that officers did not verify","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.denverpost.com/2021/01/08/aurora-police-traffic-stop-no-charges/","kind":"news_report","access":"read","language":"en","translation_note":"Read live in English on 2026-10-05 and re-read live on 2026-10-06 (The Denver Post, 8 January 2021). Rests on the 18th Judicial District prosecutors' decision letter, bystander video and the family's attorney.","independence_group":"denverpost-da-decision-letter"},{"id":"s2","url":"https://sentinelcolorado.com/metro/family-of-black-girls-handcuffed-by-aurora-police-held-at-gunpoint-reach-1-9-million-settlement/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-10-05 and 2026-10-06 from an Internet Archive capture. The live page returned HTTP 429 both days. Sentinel Colorado, February 2024, Associated Press copy (AP byline and photo credits on the page). Rests on the family lawyer's announcement, a written statement from the city, body camera video, the prosecutors' investigation and an interview with the driver. It says the department's system notified officers and does not mention a license plate reader.","independence_group":"ap-aurora-settlement-2024"}],"version":1,"ai_roles":["institutional_use"],"contexts":["justice"],"unknowns":["The vendor and technology of the license plate reader.","Whether the reader's alert displayed the issuing state or vehicle type.","Whether the department changed its license plate reader procedures beyond the retraining it described."],"geography":{"basis":"The stop was made by Aurora police in a parking lot in Aurora, Colorado, and the lawsuit was settled by the City of Aurora (The Denver Post, Sentinel Colorado).","court_countries":["US"],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"The Denver Post, in its report on the prosecutors' decision, says a license plate reader alerted police to the SUV on a plate-number match with a stolen Montana motorcycle, and that officers did not verify the alert before ordering a woman and four children to the ground at gunpoint. Sentinel Colorado reports the department's system flagged the Colorado-plated SUV and reports the $1.9 million settlement with the city. The woman and the children are not named, and the reader's vendor is unidentified.","reviewed_on":"2026-10-06"},"ai_involvement":{"basis":"The Denver Post, in its report on the prosecutors' decision, says a license plate reader installed at an Aurora intersection alerted police to the SUV because it had the same plate number as a stolen motorcycle from Montana. Sentinel Colorado says the department's system flagged the SUV, which carried Colorado plates, as stolen. The reader's match on the plate number alone, ignoring the issuing state and the vehicle type, produced the stolen-vehicle alert on which officers made the gunpoint stop. Officers also did not double-check the reading or the vehicle description. No source names the reader's vendor or describes its technology.","status":"reported"},"person_relations":["made_claim_about"]},"name":"Aurora, Colorado: police held a woman and four children at gunpoint in 2020 after a plate reader matched her SUV to a stolen motorcycle, The Denver Post reports","summary":"On 2 August 2020 Aurora police officers stopped an SUV they believed to be stolen, ordered the woman driving it and four children to lie on the ground at gunpoint, and handcuffed two of the children. The Denver Post reported that a license plate reader at an Aurora intersection had alerted police because the SUV had the same plate number as a stolen motorcycle from Montana, and that officers did not check the reading or the vehicle description. Prosecutors declined to charge the officers in January 2021 and called what happened unacceptable and preventable. The department said all officers were repeating training on license plate scanners. Sentinel Colorado reported that the department's system had flagged the SUV, which carried Colorado plates, and that the City of Aurora agreed in February 2024 to a $1.9 million settlement with the woman and the children to resolve a lawsuit over the officers' actions. One officer was suspended for 160 hours. The woman said the stop destroyed her mentally and that one of the children became withdrawn.","incidentDate":"2020-08-02","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2021-01-08","aiSystem":"A fixed license plate reader installed at an Aurora intersection that alerted police to the car on a plate-number match with a stolen Montana motorcycle (The Denver Post); vendor not named","aiProduct":"Unidentified license plate reader","aiCompany":"Unknown","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["loss_of_liberty","psychological_distress"],"harmOutcomeSummary":"A woman and four children were held on the ground at gunpoint and two of the children were handcuffed (The Denver Post from the prosecutors' letter). The woman told an interviewer that the stop destroyed her mentally and that one of the children became withdrawn (Sentinel Colorado).","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":5,"affectedCountStatus":"exact","affectedCountEvidence":"Five people in the car, the woman driving and four children, all ordered to the ground (The Denver Post; Sentinel Colorado). Exact 5.","victimAgeRange":"minor","jurisdiction":"US-CO","platformType":"other","outcomeType":"lawsuit_settled","outcomeStatus":"resolved","primarySourceUrl":"https://www.denverpost.com/2021/01/08/aurora-police-traffic-stop-no-charges/","primarySourceLabel":"The Denver Post, 8 January 2021: No charges for Aurora police officers who held children at gunpoint after erroneous traffic stop","firstPublishedAt":"2026-10-05T03:12:34.885576+00:00","updatedAt":"2026-10-06T03:04:56.590358+00:00","scopeVersion":"facts-v3","tags":["alpr","license-plate-reader","hotlist-match","wrongful-stop","gunpoint","minors","colorado","aurora","justice","made-claim-about","settlement"]},{"id":"2026-utah-meta-ai-suggested-prompts-children-profile","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'Meta AI posed a series of invasive prompts under the video, such as \"Who's the child passenger?\" and \"Where does Kalie Robins live?\"'; 'pulled information from her past posts ... including her location'; 'drew on other profiles, such as her mother's account'.","relation":"supports","source_id":"s1"},{"locator":"'Who's the child passenger?'; 'their names, birth information, pictures and videos of them'; 'It pieced together my information to show people where I live'.","relation":"supports","source_id":"s3"},{"locator":"'suggested questions aimed at uncovering information about her children — including their names, birthdates, videos, newborn photos, even photos that had been deleted — and, ultimately, her live location'.","relation":"supports","source_id":"s2"}],"assertion":"Meta AI suggested prompts under Robins's 1 September car video including 'Who's the child passenger?' and 'Where does Kalie Robins live?', and clicking them produced her daughters' names, birth details, photos and videos from her own and relatives' posts, and assembled her likely location.","causal_attribution":"Robins's account given in separate interviews to CNET, NewsNation and Futurism; Meta does not dispute that the prompts were generated."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'A Meta spokesperson told CNET in an email that it \"fixed\" the issue and that Meta AI will no longer suggest inappropriate, personal questions on users' posts'.","relation":"supports","source_id":"s1"},{"locator":"'\"While the content was available to this user, these prompts should never have been generated,\" Meta spokesperson Dina El-Kassaby said, according to The Verge'.","relation":"supports","source_id":"s4"},{"locator":"'its AI search feature \"missed the mark\"'; '\"fixed that issue\"'.","relation":"supports","source_id":"s3"}],"assertion":"Meta said the prompts 'missed the mark' and 'should never have been generated', that responses draw only on information the user can already access, and that it fixed the issue so Meta AI no longer suggests personal questions about people in posts.","causal_attribution":"Meta statements to three outlets."},{"id":"c3","status":"disputed","evidence":[{"locator":"'Meta also denied Robins' claim that its AI accessed a photo deleted years ago. Instead, Meta told CNET that the photo of Robins' kids was deleted right before the video was made and that a temporary bug briefly kept it visible. Robins disputed this'.","relation":"supports","source_id":"s1"}],"assertion":"Robins says one surfaced photo had been deleted years earlier; Meta says the photo was deleted shortly before the video and remained briefly visible because of a temporary bug.","causal_attribution":"Competing accounts from Robins and Meta reported by CNET."}],"effects":[{"label":"Meta AI prompts compiled a mother's young daughters' names, birth details and photos and her likely location; the mother reported distress and lost trust; Meta changed the feature","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.cnet.com/tech/services-and-software/meta-ai-viral-video-personal-prompts-about-kids/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 (CNET, 12 Sep 2026). Direct interview with Robins plus Meta's emailed statement to CNET and its dispute of the deleted-photo detail.","independence_group":"cnet"},{"id":"s2","url":"https://www.newsnationnow.com/business/tech/ai/mom-meta-ai-analyzing-posts-about-kids/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 via the MSN content API copy (NewsNation, 17 Sep 2026; the newsnationnow.com host returns 403 to this box). Interview with Robins including the distress quotation.","independence_group":"newsnation"},{"id":"s3","url":"https://torontosun.com/news/world/utah-mom-sounds-alarm-after-meta-ai-digs-up-details-about-her-children-im-done","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 via the MSN content API copy (Toronto Sun, 15 Sep 2026). Relays Futurism's interview and Meta's statement to Futurism; treated as the Futurism chain.","independence_group":"futurism"},{"id":"s4","url":"https://www.dexerto.com/entertainment/meta-changes-ai-prompts-after-chatbot-asked-mother-to-identify-her-child-3408508/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-18 (Dexerto, 12 Sep 2026). Relays The Verge's report of Meta spokesperson Dina El-Kassaby's statement; treated as The Verge chain.","independence_group":"verge"}],"version":1,"ai_roles":["own_use","institutional_use"],"contexts":["privacy","everyday_life","relationships"],"unknowns":["What Meta changed and how many other users saw similar prompts about children is not disclosed.","Whether the compiled information was shown to anyone other than Robins is not established.","No regulator has announced an inquiry in the inspected sources."],"geography":{"basis":"Robins is described as a Utah mother (Toronto Sun/Futurism; TRT Haber); the posts and prompts occurred on her US Instagram/Facebook accounts. No court.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as a privacy and made-claim-about case: an AI feature compiled identifying details about two young children and a named adult's location, the adult reported distress and loss of control, and the company acknowledged the prompts should not have been generated. Four sources across four reporting chains read; the children's details are not reproduced. Low severity.","reviewed_on":"2026-09-18"},"ai_involvement":{"basis":"Meta acknowledged to CNET and The Verge that its AI generated the suggested prompts and that they 'should never have been generated', and said it fixed the issue. The AI made claims about identified people (the children's identities and the mother's location) rather than conversing with them; the mother's clicks on the prompts are recorded as own_use, and the platform's default feature as institutional_use.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Utah: Meta AI's suggested prompts under a mother's Instagram video compiled her young daughters' names, birth details and old photos and her likely home location; Meta said the prompts 'missed the mark' and changed the feature","summary":"On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.","incidentDate":"2026-09-02","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2026-09-10","aiSystem":"Meta AI (suggested-question prompts under Instagram and Facebook posts, drawing on the user's and related accounts' content)","aiProduct":"Meta AI","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"A mother experienced distress and a loss of control over her children's privacy after Meta AI's suggested prompts compiled her two young daughters' identifying details and her likely location from scattered family posts; Meta acknowledged the prompts should not have been generated and changed the feature.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":2,"affectedCountStatus":"exact","affectedCountEvidence":"Kalie Robins (who used the prompts and reported distress) and her two daughters, whose identifying details were compiled. Exact count of three; her mother and other relatives whose posts were drawn on are not counted as harmed.","victimAgeRange":"minor","jurisdiction":"US","platformType":"assistant","outcomeType":"internal_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.cnet.com/tech/services-and-software/meta-ai-viral-video-personal-prompts-about-kids/","primarySourceLabel":"CNET, 12 Sep 2026: Mother calls for 'accountability' after Meta AI mines family posts for info on minors (interview with Kalie Robins; Meta statement)","firstPublishedAt":"2026-09-18T03:25:15.671921+00:00","updatedAt":"2026-09-30T01:17:58.137201+00:00","scopeVersion":"facts-v3","tags":["meta-ai","instagram","facebook","privacy","children","profiling","suggested-prompts","united-states","utah","made-claim-about"]},{"id":"2017-simsimi-ireland-cyberbullying","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'Several schools have sent letters or text messages to parents in recent days asking them to discuss use of the SimSimi app with their children.'; 'SimSimi is the most downloaded app in Ireland on Apple's iTunes charts and the second most-downloaded app on the Google Play store.'; 'One Dublin secondary school told parents this weekend that the app allowed individuals to be targeted easily.'","relation":"supports","source_id":"s2"},{"locator":"'Where schools were aware of this use by some pupils, they alerted parents of potential dangers. General alerts were also issued by many teachers and schools through social media.'","relation":"supports","source_id":"s4"},{"locator":"'said it was being downloaded \"in huge numbers\" across Ireland last week.'; 'we began to put out warnings through the media to parents and to schools'","relation":"supports","source_id":"s5"}],"assertion":"In late March 2017 schools in the Republic of Ireland sent letters or text messages asking parents to discuss the SimSimi app with their children, while the app topped Apple's download chart in Ireland.","causal_attribution":"School messages quoted by The Irish Times, a teachers' union statement to TheJournal.ie and a DCU anti-bullying centre director's BBC interview."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'allows users to view anonymous, and often insulting, messages left about them by typing in their name.'; 'When a user sends a message on their phone, the app responds by scanning for related conversations in its database and responds by spitting out a relevant response.'","relation":"supports","source_id":"s1"},{"locator":"'In practice, a small group could make a range of comments about a person and, without that person able to stop it, their name could be associated with negative and abusive content.'","relation":"supports","source_id":"s4"},{"locator":"'IBTimes UK downloaded and tested the application. The exchange quickly turned weird.'; 'Time for another name. Typing Suzanne was met with: \"is gay\" and the name Emily brought up: \"Slut, who needs to improve her grades big time!!\"'","relation":"supports","source_id":"s7"},{"locator":"'It appears to be a computer generated chat room where you talk to a very abusive computer!'; 'The app is rated as 17+ but I am twice that age and was really shocked at some of the stuff that came back!'","relation":"supports","source_id":"s5"}],"assertion":"The app answers typed text, including a person's name, with replies other users have taught it, so that a name can return insulting messages; journalists and police who tested it received abusive replies.","causal_attribution":"The Irish Times's description of the mechanism, IBTimes UK's own test and the PSNI Down Facebook post quoted by the BBC."},{"id":"c3","status":"reported","evidence":[{"locator":"'One parent who said that she had seen \"vile comments\" about her daughter on the app told TheJournal.ie that the company had said it would take 15 days to deal with her request but offered three alternative methods whereby words could be deleted from the system if they had become associated with vile language.'","relation":"supports","source_id":"s3"},{"locator":"'We did some searches for our kids names and there were some vile, vile comments on the names for each of our respective children'; 'went into her phone to see if she’d ever downloaded the app on the app store and luckily she hadn’t. It was a really stressful situation.'; 'The mother was told she’d have to wait 15 days for action to be taken when she complained about this to SimSimi.'","relation":"supports","source_id":"s4"}],"assertion":"A parent told TheJournal.ie that she and other parents searched their children's names on the app and found vile comments on each, that her daughter did not know of the comments; she said her daughter had not downloaded the app, that the company said it would take 15 days to deal with her request while offering ways to delete words, and that it was a really stressful situation.","causal_attribution":"The parent's own account to TheJournal.ie, carried in two articles; the company's reply is as she described it."},{"id":"c4","status":"reported","evidence":[{"locator":"'In primary school, students were getting messages when they put in their name and they couldn’t understand where that had come from'; 'students were being insulted about being too fat or too ugly and very personal things, things they might only know about each other.'; 'For one friend, at the beginning it was all fine and inside jokes, but within a couple of days every time he looked up his name, something mean was being said. It hurt him a lot and he became very down.'","relation":"supports","source_id":"s5"}],"assertion":"A Dublin secondary teacher told the BBC that primary pupils typing in their names received messages insulting them about being too fat or too ugly and about personal things, and her 15-year-old son said that for one friend, within a couple of days, every time he looked up his name something mean was being said, which hurt him a lot and left him very down.","causal_attribution":"The teacher's and her son's accounts to the BBC; the son describes a friend's experience."},{"id":"c5","status":"reported","evidence":[{"locator":"'When you say my name on SimSimi, ‘autism’ comes up . . . people are so unfunny and cruel when hiding behind a phone screen'","relation":"supports","source_id":"s2"}],"assertion":"A student wrote on social media that \"autism\" comes up when their name is said on SimSimi.","causal_attribution":"A student's social media post quoted by The Irish Times."},{"id":"c6","status":"corroborated","evidence":[{"locator":"'any message sent to it is now responded to with the message: “I do not talk in Ireland for a while”.'","relation":"supports","source_id":"s3"},{"locator":"'No matter what you asked it from Wednesday onwards, however, you got the same response: “I do not talk in Ireland for a while”.'","relation":"supports","source_id":"s4"},{"locator":"'This afternoon, users were greeted with a message stating: \"I do not talk in Ireland for a while.\"'","relation":"supports","source_id":"s1"},{"locator":"'has been suspended in the Republic of Ireland, but children in Northern Ireland can still download it.'","relation":"supports","source_id":"s5"},{"locator":"'was restricted in the Republic of Ireland (RoI) last week (Wednesday 29 March)'","relation":"supports","source_id":"s7"}],"assertion":"From Wednesday 29 March 2017 the app answered users in Ireland with \"I do not talk in Ireland for a while\", while it remained available in Northern Ireland.","causal_attribution":"TheJournal.ie's and The Irish Times's own observations of the app's reply, the BBC's report of the suspension, and IBTimes UK's report of the date; the date rests on TheJournal.ie's 'from Wednesday onwards' (29 March 2017), a Webwise tweet of 29 March embedded by TheJournal.ie and IBTimes UK's 'Wednesday 29 March'."},{"id":"c7","status":"reported","evidence":[{"locator":"'On its Facebook page, PSNI Down said it was unusual for police to highlight apps, but the SimSimi app gave them \"cause for concern\".'; 'We have reported it to the App Store and will include it in our Internet Safety talks'; 'It has asked parents to remove the app from their children'","relation":"supports","source_id":"s5"},{"locator":"'On the PSNI Down Facebook page, a warning said the app was a \"cause for concern\".'","relation":"supports","source_id":"s7"}],"assertion":"The PSNI's County Down Facebook page posted that the app gave it cause for concern, describing abusive and explicit replies, and said it had reported the app to the App Store; a school in Northern Ireland asked parents to remove the app from their children's phones and another urged pupils to remove it.","causal_attribution":"A police Facebook post quoted by the BBC and IBTimes UK; no formal police action is reported."},{"id":"c8","status":"reported","evidence":[{"locator":"'\"I think they have a duty of care of suspend the service for all young people,\" says Liam Hackett of anti-bullying campaign Ditch the Label.'; 'We got 5,000 signatures on a petition'; 'ISMaker, the South Korean company behind the app, have not responded to requests for comment.'","relation":"supports","source_id":"s6"},{"locator":"'The South Korean company that developed SimSimi did not respond to requests for comment on Sunday.'","relation":"supports","source_id":"s1"}],"assertion":"Anti-bullying campaigners called for the service to be suspended for young people; a campaigner in Ireland said a petition had gathered 5,000 signatures; the developer, named as ISMaker, did not respond to requests for comment.","causal_attribution":"Campaigners' statements to BBC Newsbeat; the non-response is each outlet's own report."}],"effects":[{"label":"children's names returned insulting replies that other users had taught the app, and primary pupils received personal insults when they typed in their names","claim_id":"c4","direction":"negative"},{"label":"a pupil was hurt and became very down after finding something mean every time he looked up his name","claim_id":"c4","direction":"negative"},{"label":"a parent found vile comments attached to her daughter's name and was told her complaint would take 15 days to handle","claim_id":"c3","direction":"negative"},{"label":"a student found that an insult came up when their name was said on the app","claim_id":"c5","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.irishtimes.com/news/education/simsimi-app-linked-to-bullying-suspends-access-to-irish-users-1.3029753","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated Thu 30 March 2017, by the paper's education editor.","independence_group":"irish-times"},{"id":"s2","url":"https://www.irishtimes.com/news/education/schools-warn-of-bullying-linked-to-simsimi-app-1.3025437","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated Sun 26 March 2017; quotes school messages to parents and students' social media posts.","independence_group":"irish-times"},{"id":"s3","url":"https://www.thejournal.ie/simsimi-offline-ireland-3314458-Mar2017/","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated 30 March 2017; includes a parent's account to TheJournal.ie and a CyberSafe Ireland interview given to Newstalk Breakfast.","independence_group":"thejournal"},{"id":"s4","url":"https://www.thejournal.ie/simsimi-explainer-3315369-Apr2017/","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated 2 April 2017; expands the same parent's account and quotes a teachers' union spokesperson.","independence_group":"thejournal"},{"id":"s5","url":"https://www.bbc.com/news/uk-northern-ireland-39453542","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated 31 March 2017; BBC News Northern Ireland, with interviews of a Dublin teacher and her son, a DCU centre director and a Northern Ireland principal, and the PSNI Down Facebook post.","independence_group":"bbc"},{"id":"s6","url":"https://www.bbc.com/news/newsbeat-39453778","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated 31 March 2017; BBC Newsbeat, with campaigners' statements.","independence_group":"bbc"},{"id":"s7","url":"https://www.ibtimes.co.uk/what-simsimi-look-chatbot-application-accused-enabling-cyberbullying-1615112","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-10-07 from the live page (HTTP 200), dated 3 April 2017; the reporter's own test of the app plus relays of the BBC and TheJournal.ie.","independence_group":"ibtimes"}],"version":1,"ai_roles":["others_use","own_use"],"contexts":["education","relationships","everyday_life"],"unknowns":["Whether or when SimSimi restored access for users in Ireland, and whether it changed its moderation; the stored claim that the app was later restored with content moderation was not supported by any inspected source and has been removed.","Who taught the app the insults, and how many children were targeted; CyberSafe Ireland and the teachers' union describe use for bullying without a count.","Whether the student quoted by The Irish Times is the same person as either counted child.","Whether the pupil described to the BBC attended school in the Republic of Ireland or Northern Ireland; the teacher interviewed teaches in Dublin.","Whether any formal police action followed the PSNI Down Facebook warning; the stored wording 'formal warnings' is not supported."],"geography":{"basis":"The Irish Times places the school warnings in the Republic of Ireland and quotes a Dublin school; the BBC's teacher interviewee teaches in Dublin and the parent spoke to an Irish outlet about Irish schools. The BBC also reports warnings by schools and police in Northern Ireland (GB), but no harmed person is described there, so GB is not recorded as an event or affected country. No court is involved.","court_countries":[],"event_countries":["IE"],"affected_person_countries":["IE"]},"publication":{"basis":"Published as a core case (communicated_with and made_claim_about). The Irish Times, TheJournal.ie, the BBC and IBTimes UK describe the SimSimi app returning insulting, user-taught replies when children's names were typed in, in Irish schools in March 2017; a parent's account and a teacher's account describe two children harmed, and the developer suspended Irish access on 29 March 2017. The insults themselves were taught by other users, which the record states. No child, parent, teacher or campaigner is named here.","reviewed_on":"2026-10-07"},"ai_involvement":{"basis":"The app's own output is the abuse. The Irish Times (26 and 30 March 2017) describes SimSimi as responding to a typed message by scanning related conversations in its database and returning a response, and as returning anonymous, often insulting, messages when a user types in a name. IBTimes UK's reporter typed ordinary first names and received abusive replies, and the PSNI's County Down page described the replies it received as abusive and explicit (BBC). A Dublin teacher told the BBC that primary pupils were getting insulting messages when they put in their names and that a pupil found something mean every time he looked up his name, which hurt him and left him very down; a parent told TheJournal.ie the app returned vile comments for her daughter's name. The insults were authored by other users who taught the app, and no source says the app composed novel abuse; the app's matching of a child's name to that taught content and its delivery to whoever typed the name is the described AI action connected to the harm.","status":"reported"},"person_relations":["communicated_with","made_claim_about"]},"name":"Ireland, March 2017: SimSimi chatbot returned user-taught insults for schoolchildren's names; schools warned parents and the app suspended Irish access","summary":"In late March 2017 the SimSimi chatbot app, which answers typed text with replies other users have taught it, topped Irish download charts while schools in the Republic of Ireland sent letters and text messages warning parents that pupils' names were being linked to insulting replies (The Irish Times, 26 March 2017). A parent told TheJournal.ie that she and other parents had searched their children's names and found vile comments on each, and that the company said her request would take 15 days to handle. A Dublin secondary teacher told the BBC that primary pupils who typed in their names received personal insults, and that a friend of her 15-year-old son found something mean every time he looked up his name, which hurt him a lot and left him very down. Police in County Down posted a warning on Facebook. From 29 March 2017 the app answered users in Ireland with \"I do not talk in Ireland for a while\", while remaining available in Northern Ireland. The South Korean developer did not respond to the outlets' requests for comment, and no inspected source says whether access was later restored.","incidentDate":"2017-03-01","incidentKind":"bounded_series","incidentDatePrecision":"month","exposurePattern":"repeated_interactions","reportedDate":"2017-03-26","aiSystem":"SimSimi, an anonymous chatbot app developed in South Korea that answers typed text, including people's names, with replies other users have taught it","aiProduct":"SimSimi","aiCompany":"ISMaker","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress","exploitation_or_abuse"],"harmOutcomeSummary":"Children whose names were typed into the app received insulting replies that other users had taught it. A parent told TheJournal.ie she found vile comments attached to her daughter's name, and a Dublin teacher told the BBC that a friend of her 15-year-old son was hurt and became very down after finding something mean every time he looked up his name. No clinical or physical outcome is reported.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":1,"affectedCountStatus":"partial","affectedCountEvidence":"Participant user 1: a friend of a Dublin teacher's 15-year-old son, who looked up his own name on the app and found something mean each time, which the son said hurt him a lot and left him very down (BBC News, 31 March 2017). Other person 1: a parent's teenage daughter whose name returned vile comments; the parent said the daughter had not downloaded the app and did not know of the comments, so she is counted for the abuse attached to her name, not for distress (TheJournal.ie, 30 March and 2 April 2017). The two are distinct (a boy and a girl). A student who wrote that \"autism\" comes up when their name is said on the app (The Irish Times, 26 March 2017) may overlap with either and is not counted separately. Primary pupils who received insults (BBC) and the children the teachers' union and CyberSafe Ireland described are not counted. Partial: counted people plus further targeted children without a count.","victimAgeRange":"minor","jurisdiction":"IE","platformType":"chatbot","outcomeType":"internal_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.irishtimes.com/news/education/simsimi-app-linked-to-bullying-suspends-access-to-irish-users-1.3029753","primarySourceLabel":"The Irish Times, 30 March 2017: SimSimi app linked to bullying suspends access to Irish users","firstPublishedAt":"2026-01-12T00:34:12.606519+00:00","updatedAt":"2026-10-07T03:29:54.147244+00:00","scopeVersion":"facts-v3","tags":["simsimi","cyberbullying","minor","ireland","schools","harassment","trainable-ai","historical","communicated-with"]}]}