{"meta":{"exportedAt":"2026-10-02T17:26:00.710Z","formatVersion":2,"selection":{"q":"dismissed","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"2025","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":7,"coverage":{"cases":7,"countries":3,"languages":2,"unknownLocation":2,"locationPending":0,"unknownLanguage":2,"unknownDate":0,"lawsuits":3,"regulatory":1,"minors":0,"coreRelations":1,"contextualRelations":3,"mixedRelations":0,"unknownRelations":3,"relationPending":2,"relationUnknown":1},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-new-york-union-square-facial-recognition-false-arrest-two-days-jail","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"After his mug shot was generated as a possible match to the offender in an indecent exposure case, he was arrested and spent two days in jail in April before the charges against him were dropped in July.","relation":"supports","source_id":"s2"},{"locator":"was falsely arrested and jailed for two days despite not matching the physical description given by the victim of a sex crime.","relation":"supports","source_id":"s1"},{"locator":"Prosecutors dismissed the case last month after ... public defenders, the Legal Aid Society, were able to prove he was falsely identified.","relation":"supports","source_id":"s1"}],"assertion":"An indecent exposure suspect search produced a possible facial recognition match to the affected man, who was arrested in April 2025, jailed for two days and charged. Prosecutors dismissed the case in July 2025.","causal_attribution":"The reporting attributes the arrest to the facial recognition possible match followed by police decisions (a photo lineup and the arrest). The inspected sources do not establish what other evidence the police relied on."},{"id":"c2","status":"reported","evidence":[{"locator":"\"The man they were looking for, he was eight inches shorter than me and 70 pounds lighter.\"","relation":"supports","source_id":"s1"},{"locator":"Location data from his cell phone showed that ... was miles away from the crime, the New York Times first reported.","relation":"supports","source_id":"s1"}],"assertion":"The man reports that the suspect was eight inches shorter and 70 pounds lighter than him, and reports say location data from his phone placed him miles from the crime.","causal_attribution":"Physical and location discrepancies are the man's account and a relayed New York Times report. The New York Times article was not readable and the phone data was not inspected."},{"id":"c3","status":"reported","evidence":[{"locator":"for NYPD investigators to make the decision to place him in a photo lineup, which was then shown to the victim, who misidentified him.","relation":"supports","source_id":"s2"}],"assertion":"A victim was shown a photo lineup that included the man and misidentified him.","causal_attribution":"Hell Gate summarises the New York Times account. Its chain traces to the same original reporting as the New York Times article that was not readable here."},{"id":"c4","status":"reported","evidence":[{"locator":"\"I was in the process of becoming a correctional officer at Rikers Island,\" he told Eyewitness News.","relation":"supports","source_id":"s1"},{"locator":"But after his arrest, he says \"they kind of froze the hiring process.\"","relation":"supports","source_id":"s1"}],"assertion":"The man says he was in the process of becoming a correctional officer and that after his arrest they \"kind of froze the hiring process.\"","causal_attribution":"Single first-person account relayed by one outlet. No employer statement was inspected and the current hiring status is unknown."},{"id":"c5","status":"reported","evidence":[{"locator":"\"even if there is a possible match, the NYPD cannot and will never make an arrest solely using facial recognition technology.\"","relation":"supports","source_id":"s1"}],"assertion":"The NYPD stated that even with a possible facial recognition match it cannot and will never make an arrest solely using facial recognition technology.","causal_attribution":"Police statement relayed by ABC7. It bears on how the match was used and does not address this arrest specifically."},{"id":"c6","status":"reported","evidence":[{"locator":"On Monday, the Legal Aid Society sent a letter to the City's Department of Investigation urging the agency to open a probe into the NYPD's use of facial recognition technology","relation":"supports","source_id":"s2"},{"locator":"who was wrongfully arrested  based on a false facial recognition match","relation":"context","source_id":"s3"}],"assertion":"The Legal Aid Society wrote to the city Department of Investigation asking it to investigate NYPD facial recognition use after this and other false arrests.","causal_attribution":"Advocacy response. Legal Aid statements are the organisation's allegations."}],"effects":[{"label":"Arrest and two days in jail after a facial recognition possible match, case later dismissed","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://abc7ny.com/post/man-falsely-jailed-nypds-facial-recognition-surveillance-tech-failed/17664671/","kind":"news","access":"read","language":"en","translation_note":"","independence_group":"abc7-interview"},{"id":"s2","url":"https://hellgatenyc.com/legal-aid-investigation-nypd-facial-recognition/","kind":"news","access":"read","language":"en","translation_note":"","independence_group":"nyt-original-account"},{"id":"s3","url":"https://legalaidnyc.org/news/demands-ban-nypd-facial-recognition-technology/","kind":"advocacy_statement","access":"read","language":"en","translation_note":"","independence_group":"legal-aid"},{"id":"s4","url":"https://www.nytimes.com/2025/08/26/nyregion/nypd-facial-recognition-dismissed-case.html","kind":"news","access":"unavailable","language":"en","translation_note":"","independence_group":"nyt-original-account"}],"version":1,"ai_roles":["institutional_use"],"contexts":["justice","work"],"unknowns":["The New York Times article could not be read, so details attributed to it are relayed second-hand.","The facial recognition product, the source of the comparison photo and the match score are unknown.","The Hell Gate article is behind a subscriber paywall after its opening paragraphs; only the visible text was inspected.","The date of the facial recognition search and match (between the 10 February offense and the April arrest) is not stated in the inspected sources; the incident date is the reported arrest month.","The exact arrest day, the court and the dismissal date are not stated in the inspected sources.","Whether the correctional officer hiring process resumed is unknown.","Which evidence besides the possible match supported the arrest and lineup is unknown."],"geography":{"basis":"ABC7 places the offense in Manhattan's Union Square and the arrest by the NYPD. The man's residence and the court are not stated in the inspected sources.","court_countries":[],"event_countries":["US"],"affected_person_countries":[]},"publication":{"basis":"ABC7 New York and a Legal Aid Society release were read in full. Hell Gate was read only as far as its subscriber paywall allows. The New York Times original was blocked (HTTP 403 and reader relays) and is cited unread. Claims are attributed and left at reported status. The affected person is not named.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"Hell Gate and ABC7 report the arrest followed a facial recognition possible match. The system, the search image and the match output were not produced, and the New York Times original was not readable.","status":"reported"},"person_relations":["made_claim_about"]},"name":"New York: man misidentified through facial recognition in an indecent exposure case arrested and jailed two days","summary":"Reporting from August 2025 says an NYPD facial recognition search of images from a February 2025 indecent exposure in Manhattan's Union Square produced a possible match to a man who did not fit the described suspect. The man was placed in a photo lineup, arrested in April 2025 and jailed for two days. Prosecutors dismissed the case in July 2025 after his public defenders showed he was misidentified. The man says the process of becoming a correctional officer 'kind of' froze after the arrest. The NYPD says it never arrests solely on a facial recognition match.","incidentDate":"2025-04-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"unknown","reportedDate":"2025-08-26","aiSystem":"NYPD facial recognition system (product and vendor not identified in the inspected sources)","aiProduct":"Unidentified facial recognition system","severity":"medium","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["loss_of_liberty","professional_harm"],"harmOutcomeSummary":"ABC7 and Hell Gate report the man was arrested and jailed for two days before prosecutors dismissed the case, and the man says a correctional officer hiring process 'kind of' froze after the arrest.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One man reported arrested and jailed. The offense victim and other people are not counted as harmed by the AI.","victimAgeRange":"adult","platformType":"other","primarySourceUrl":"https://abc7ny.com/post/man-falsely-jailed-nypds-facial-recognition-surveillance-tech-failed/17664671/","primarySourceLabel":"ABC7 New York (27 Aug 2025)","firstPublishedAt":"2026-09-29T12:42:09.552414+00:00","updatedAt":"2026-09-30T01:17:11.583854+00:00","scopeVersion":"facts-v3","tags":["historical-2025"]},{"id":"2025-stephens-county-oklahoma-judge-chatgpt-fake-citations-paternity-order","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'Wheeler denied a request from one of the parents' attorneys to have the other parent undergo a psychological test—and in his order denying the request, he pointed to multiple previous Oklahoma cases he said backed him up.'","relation":"supports","source_id":"s2"},{"locator":"'The 2025 order in a child paternity case'; 'He came under scrutiny after he reprimanded attorney [the attorney] last November in an order in the paternity case for asking for a psychological evaluation of the child’s father.'","relation":"supports","source_id":"s1"},{"locator":"'The issue came to light after a request for a mental evaluation was denied and a subsequent court order was filed.'","relation":"supports","source_id":"s3"}],"assertion":"In November 2025, in a child paternity and custody case, Judge Wheeler issued an order denying a request by one parent's attorney for a psychological evaluation of the other parent, citing Oklahoma cases he said supported the decision.","causal_attribution":"Court history as reported by The Oklahoman and KFOR and described by the mother; the order itself was not read."},{"id":"c2","status":"reported","evidence":[{"locator":"'The judge told the OSBI he only used ChatGPT for research and created the order himself, DA Jason Hicks wrote. The judge, however, also “indicated that at least two of the case citations included in his order and produced by ChatGPT do not exist.”'","relation":"supports","source_id":"s1"},{"locator":"'Stephens County District Attorney Jason Hicks says Wheeler admitted to OSBI agents he cited \"at least two\" cases ChatGPT fed him that \"do not exist.\"'","relation":"supports","source_id":"s2"},{"locator":"'Hicks wrote that Wheeler acknowledged using case citations generated by ChatGPT and that at least two citations included in the order did not exist.'","relation":"supports","source_id":"s3"},{"locator":"'Associate District Judge Lawrence Wheeler used OpenAI's ChatGPT for research while drafting the order, which cited two cases that do not exist, according to state records.'","relation":"supports","source_id":"s4"}],"assertion":"According to the district attorney's 17 August 2026 letter, the judge told the OSBI that he used ChatGPT for research and wrote the order himself, and indicated that at least two case citations in the order, produced by ChatGPT, do not exist.","causal_attribution":"The judge's own statement to investigators as relayed in the district attorney's letter; all four reports rely on that letter, which was not read. The judge's attorney declined to comment."},{"id":"c3","status":"reported","evidence":[{"locator":"'The judge issued the reprimand “for stooping to such frivolous trial tactics” and cautioned that future similar filings may be subject to further sanctions.'; '[The attorney] challenged the order at the Oklahoma Supreme Court in February. He told justices that Wheeler based his order on two cases, Cummings v. Cimarron Elevator Co. and Hawkins v. Linhart, that do not exist.'; '[The attorney] dismissed his challenge in March after Wheeler vacated the order. Wheeler is no longer involved in the paternity case.'","relation":"supports","source_id":"s1"},{"locator":"'She said her attorney at the time challenged the ruling and began reviewing the legal authorities cited in the order.'","relation":"supports","source_id":"s3"}],"assertion":"The order reprimanded the attorney who had asked for a psychological evaluation of the child's father 'for stooping to such frivolous trial tactics' and warned of further sanctions; that attorney challenged it at the Oklahoma Supreme Court in February 2026, saying it relied on two nonexistent cases, and dismissed the challenge in March after Wheeler vacated the order. The mother told News 9 that her attorney at the time challenged the ruling.","causal_attribution":"The Oklahoman's account of the court filings and the mother's account to News 9; the Supreme Court filings were not read."},{"id":"c4","status":"reported","evidence":[{"locator":"'[The mother] said learning the citations were allegedly fabricated was alarming because the order involved the custody of a child.'; '“Then it became very concerning to me that somebody would do something like that over a child custody case,” she said.'; '“He then turned around and decided to recuse himself from my case,” she said. “He called my attorney that I had at the time and apologized to him.”'","relation":"supports","source_id":"s3"}],"assertion":"The mother told News 9 that learning the citations were allegedly fabricated was alarming because the order involved the custody of a child, and that the judge later recused himself from her case and apologised to her attorney.","causal_attribution":"The mother's first-person account in a broadcast interview."},{"id":"c5","status":"reported","evidence":[{"locator":"'The OSBI investigated the judge at the request of the Oklahoma Council on Judicial Complaints.'; 'The OSBI also looked into allegations “that Judge Wheeler offered to amend the order in exchange for a dismissal of a writ seeking relief from the Oklahoma Supreme Court” and that he “eavesdropped on jury deliberations,” the DA disclosed in the letter.'; 'Prosecutors in the AG’s office “thoroughly reviewed the results of the investigation and determined the evidence does not support a criminal prosecution,” the AG’s press secretary, Leslie Berger, said on Sept. 2.'","relation":"supports","source_id":"s1"},{"locator":"'The Criminal Justice Division of the Attorney General’s Office thoroughly reviewed the results of the investigation and determined the evidence does not support a criminal prosecution. The Oklahoma Supreme Court and the Court on the Judiciary possess ultimate jurisdiction over disciplinary actions for allegations of inappropriate behavior by judges regardless of whether the behavior constitutes a violation of a criminal statute.'","relation":"supports","source_id":"s3"}],"assertion":"The OSBI investigated the judge at the request of the Council on Judicial Complaints, including allegations that he offered to amend the order in exchange for dismissal of the writ and that he eavesdropped on jury deliberations; the attorney general's office said the evidence did not support criminal prosecution and that judicial discipline rests with the Oklahoma Supreme Court and the Court on the Judiciary.","causal_attribution":"District attorney's letter and attorney general's statement as reported; no disciplinary finding has been made."}],"effects":[{"label":"an order in the mother's custody case that denied a request for a psychological evaluation cited nonexistent cases that the judge says ChatGPT produced","claim_id":"c1","direction":"negative"},{"label":"the attorney who requested the evaluation was reprimanded in the order and sought relief from the Oklahoma Supreme Court before the order was vacated","claim_id":"c3","direction":"negative"},{"label":"the mother describes learning of the fabricated citations in her child custody case as alarming","claim_id":"c4","direction":"negative"}],"sources":[{"id":"s1","url":"https://minnlawyer.com/2026/09/09/oklahoma-judge-ai-fabricated-case-citations/","kind":"news_report","access":"read","language":"en","translation_note":"The Oklahoman's report (USA TODAY Network via Reuters Connect) as republished by Minnesota Lawyer; read in full from the Wayback capture of 10 September 2026 because the live page returned 403. Its ChatGPT-admission passages relay the district attorney's letter; its account of the reprimand, the Supreme Court challenge and the vacatur draws on court filings and the attorney.","independence_group":"oklahoman"},{"id":"s2","url":"https://www.aol.com/articles/oklahoma-judge-admitted-citing-fake-030000000.html","kind":"news_report","access":"read","language":"en","translation_note":"KFOR (Oklahoma City) report syndicated on AOL, read in full on 2026-09-29. Its account of the ChatGPT admission relays the same district attorney letter.","independence_group":"kfor"},{"id":"s3","url":"https://www.news9.com/oklahoma-city-news/stephens-county-mother-speaks-out-after-judge-accused-of-using-chatgpt-in-custody-case","kind":"news_report","access":"read","language":"en","translation_note":"News 9 (Griffin Media) interview with the mother, read in full on 2026-09-29. Its description of the ChatGPT admission also relays the district attorney's letter; the mother's own account is independent of it.","independence_group":"news9-mother"},{"id":"s4","url":"https://hoodline.com/2026/09/stephens-county-judge-faces-discipline-over-chatgpt-written-court-order/","kind":"news_report","access":"read","language":"en","translation_note":"Hoodline rewrite of the Reuters report, read in full on 2026-09-29. Reuters relays the same district attorney letter.","independence_group":"reuters"}],"version":1,"ai_roles":["institutional_use"],"contexts":["justice","relationships"],"unknowns":["The text of the order and whether the nonexistent citations were decisive for denying the evaluation and for the reprimand.","Whether any disciplinary proceeding follows from the Council on Judicial Complaints referral.","The current state of the custody case after the vacatur and the judge's departure from it.","The exact day in November 2025 on which the order was issued."],"geography":{"basis":"The order was issued in Stephens County District Court, Oklahoma, and challenged at the Oklahoma Supreme Court (The Oklahoman; KFOR). News 9 reports from Stephens County and describes the mother's case as handled there; her residence is not stated beyond that.","court_countries":["US"],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published as a concrete case in which a judge's use of ChatGPT for research put nonexistent case citations into an order that denied a parent's request and reprimanded the requesting attorney in a child custody case. The ChatGPT admission rests on the district attorney's letter as relayed by several outlets, which was not read; the order and the Supreme Court filings were not read. The mother and the attorney are not named.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"According to the district attorney's 17 August 2026 letter, as reported by The Oklahoman, KFOR and News 9, the judge told the OSBI that he used ChatGPT for research and that at least two citations in his order, produced by ChatGPT, do not exist. ChatGPT communicated only with the judge; the mother and the reprimanded attorney were affected through the order he issued. The letter itself was not read.","status":"supported"},"person_relations":["communicated_with"]},"name":"Stephens County, Oklahoma: according to the district attorney, Judge Lawrence Wheeler told state investigators that a November 2025 order in a paternity and custody case, which denied a parent's request for a psychological evaluation and reprimanded that parent's attorney, cited at least two nonexistent cases produced by ChatGPT; the order was vacated after the attorney challenged it","summary":"In November 2025 Stephens County Associate District Judge Lawrence Wheeler issued an order in a child paternity and custody case that denied one parent's request for a psychological evaluation of the other parent and reprimanded the requesting parent's attorney 'for stooping to such frivolous trial tactics'. The attorney challenged the order at the Oklahoma Supreme Court in February 2026, telling the justices that it relied on two cases that do not exist; the challenge was dismissed in March after Wheeler vacated the order, and he is no longer on the case. According to a 17 August 2026 letter from the Stephens County district attorney, Wheeler told the Oklahoma State Bureau of Investigation that he used ChatGPT for research and wrote the order himself, and that at least two citations in it produced by ChatGPT do not exist. The mother in the case told News 9 that learning the order's citations were allegedly fabricated was alarming because it concerned the custody of a child. The attorney general's office declined criminal prosecution; judicial discipline remains possible.","incidentDate":"2025-11-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"unknown","reportedDate":"2026-09-09","aiSystem":"ChatGPT (OpenAI), used by the judge for legal research while preparing the order","aiProduct":"ChatGPT","aiCompany":"OpenAI","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["legal_harm","professional_harm"],"harmOutcomeSummary":"A court order in a child custody case, which the judge has acknowledged to investigators contained at least two nonexistent ChatGPT-produced citations, denied a request for a psychological evaluation of the child's father and formally reprimanded the requesting attorney; the attorney had to seek relief from the Oklahoma Supreme Court before the order was vacated (per the district attorney's letter and The Oklahoman; the judge's attorney declined to comment).","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":2,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"Two people affected through the judge's use of ChatGPT: the mother, whose request for a psychological evaluation was denied by the order and who describes the discovery as alarming (News 9), and the attorney who requested the evaluation and was reprimanded in the order and challenged it at the Oklahoma Supreme Court (The Oklahoman). The child and the other parent are not counted because no harm to them is reported. The judge, the AI user, is not counted: he faces a possible disciplinary process but no sanction has been reported and the complaint bundled other allegations.","victimAgeRange":"adult","jurisdiction":"US-OK","platformType":"assistant","outcomeType":"investigation_opened","outcomeStatus":"ongoing","primarySourceUrl":"https://minnlawyer.com/2026/09/09/oklahoma-judge-ai-fabricated-case-citations/","primarySourceLabel":"The Oklahoman (USA TODAY Network via Reuters Connect), republished by Minnesota Lawyer, 9 September 2026: Oklahoma judge used AI on order that cited cases that don't exist","firstPublishedAt":"2026-09-29T09:10:18.787549+00:00","updatedAt":"2026-09-30T01:17:16.712062+00:00","scopeVersion":"facts-v3","tags":["justice","family-court","judge","fabricated-citations","chatgpt","institutional-use","oklahoma"]},{"id":"2026-surat-customs-penalty-ai-hallucinated-citations-supreme-court","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'The present appeal arose out of an Order-in-Original dated 8 October 2025 passed by the Additional Commissioner of Customs, Surat, imposing a penalty of ₹425,27,99,100 on the appellant under Section 114, Customs Act, 1962, for misdeclaring a consignment of natural diamonds as lab-grown diamonds to pay a lower tariff. The challenge to the said penalty before the Gujarat High Court failed, as the appeal was dismissed vide order dated 20 January 2026.'","relation":"supports","source_id":"s2"},{"locator":"'The penalty was imposed for allegedly misdeclaring a consignment of natural diamonds as lab-grown diamonds to attract a lower tariff.'; 'the High Court dismissed his challenge on January 20, 2026, prompting him to approach the Supreme Court.'","relation":"supports","source_id":"s1"}],"assertion":"On 8 October 2025 the Additional Commissioner of Customs, Surat, imposed a penalty of ₹425,27,99,100 on a diamond trader under Section 114 of the Customs Act, 1962, for allegedly misdeclaring natural diamonds as lab-grown diamonds, and the Gujarat High Court dismissed his challenge on 20 January 2026.","causal_attribution":"Facts of the proceedings as recited in the Supreme Court judgment, reported by legal outlets; the judgment itself was not read."},{"id":"c2","status":"reported","evidence":[{"locator":"'Upon verifying such judgments and articles, it does appear that the second respondent has relied upon case laws that are either non-existent or have fake citations. A further investigation has also revealed that some of the case laws relied upon by the second respondent, which do exist, do not lay down the ratio deduced therefrom and it appears to be a hallucination of AI,' the Court observed.","relation":"supports","source_id":"s1"},{"locator":"'Upon verification, the court found that the second respondent had \"relied upon case laws that are either non-existent or have fake citations.\" It further found that some case laws which did exist did not lay down the legal propositions attributed to them, and that this \"appears to be a hallucination of AI\".'","relation":"supports","source_id":"s3"}],"assertion":"The Supreme Court found that the penalty order relied on case law that was non-existent or carried fake citations, and on existing cases that did not lay down the ratio attributed to them, which it said appears to be a hallucination of AI.","causal_attribution":"Finding of the Supreme Court after its own verification of the cited material, as quoted by the reports. The court attributes the defects to AI in qualified terms ('appears to be'); the tool is not named."},{"id":"c3","status":"reported","evidence":[{"locator":"'The use of AI in this case, resulting in reliance placed by the second respondent on material which is dubious, proves fatal to the sustainability of the order imposing penalty on the appellant. Such circumstances compel us to interfere and remand the case,' the Court said.","relation":"supports","source_id":"s1"},{"locator":"'The proceedings were revived for fresh adjudication by an officer of the same rank other than the officer who had passed the original order.'; 'The Court left it to the wisdom of the appointing authority to initiate such action against the author of the Order-in-Original dated 8 October 2025 as may be warranted in the circumstances, in accordance with law.'","relation":"supports","source_id":"s2"},{"locator":"'The Supreme Court on Wednesday, September 2, 2026, set aside a customs penalty of over ₹425 crore'; 'A bench of Justice Dipankar Dutta and Justice Sheel Nagu did not examine the merits of the customs case at all.'","relation":"supports","source_id":"s3"},{"locator":"'Верховний суд Індії 2 вересня 2026 року розглянув справу щодо використання штучного інтелекту працівником митниці, який послався на неіснуючі судові справи та фальшиві цитати, накладаючи штраф у розмірі близько $45 млн' (the Supreme Court of India on 2 September 2026 considered a case of a customs officer's use of AI, who cited non-existent cases and fake quotations while imposing a fine of about $45 million)","relation":"context","source_id":"s4"}],"assertion":"On 2 September 2026 the Supreme Court held that the use of AI and the resulting reliance on dubious material was fatal to the penalty order, set aside the order and the High Court's order without deciding the merits, revived the proceedings for fresh adjudication by a different officer of the same rank, and left action against the order's author to the appointing authority.","causal_attribution":"Holding of the Supreme Court as reported."}],"effects":[{"label":"a ₹425 crore customs penalty order resting on non-existent and misattributed case law that the Supreme Court found appeared to be AI hallucination stood against the trader for about eleven months and was upheld by the Gujarat High Court","claim_id":"c1","direction":"negative"},{"label":"the trader had to take the case to the Supreme Court, which voided the order but revived the proceedings for fresh adjudication","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.barandbench.com/news/litigation/supreme-court-scraps-425-crore-penalty-over-fake-citations-ai-hallucinations-in-customs-order","kind":"news_report","access":"read","language":"en","translation_note":"Full body (including JSON-LD article body) read by curl on 2026-09-29. Reports and quotes the Supreme Court judgment of 2 September 2026.","independence_group":"sc-judgment-gadiya"},{"id":"s2","url":"https://www.scconline.com/blog/post/2026/09/03/supreme-court-sets-aside-%E2%82%B9425-crore-customs-penalty-over-ai-generated-fake-citations/","kind":"news_report","access":"read","language":"en","translation_note":"SCC Times case note, read by curl on 2026-09-29; summarises the same judgment (2026 SCC OnLine SC 1741).","independence_group":"sc-judgment-gadiya"},{"id":"s3","url":"https://upstox.com/news/personal-finance/tax/how-a-diamond-trader-got-relief-from-a-425-crore-penalty-after-customs-used-ai-generated-citations/article-199828/","kind":"news_report","access":"read","language":"en","translation_note":"Upstox (4 September 2026), read by curl on 2026-09-29; based on the same judgment.","independence_group":"sc-judgment-gadiya"},{"id":"s4","url":"https://sud.ua/uk/news/abroad/371427-mytnyk-poviryv-shi-i-vypysav-shtraf-na-45-mln-verkhovnyi-sud-use-skasuvav","kind":"news_report","access":"read","language":"uk","translation_note":"Ukrainian-language report (6 September 2026) read through the r.jina.ai relay on 2026-09-29 (direct fetch 403); translated by the reviewer. Cited only for context; it converts the penalty to about US$45 million.","independence_group":"sc-judgment-gadiya"}],"version":1,"ai_roles":["institutional_use"],"contexts":["justice","public_services","finance"],"unknowns":["Which AI tool the customs officer used and how it was used in drafting the order.","Whether the trader paid any part of the penalty or incurred other financial consequences while the order stood, and the trader's litigation costs.","The outcome of the revived adjudication and whether any action was taken against the officer.","The trader's country and place of residence."],"geography":{"basis":"The order was passed by the Additional Commissioner of Customs, Surat, challenged in the Gujarat High Court and decided by the Supreme Court of India. The trader's country of residence is not stated in the read reports, so affected_person_countries is left empty.","court_countries":["IN"],"event_countries":["IN"],"affected_person_countries":[]},"publication":{"basis":"Published as a concrete case of institutional AI use in an adverse administrative decision about a person: a penalty order that India's Supreme Court voided after finding apparently AI-hallucinated authorities in it. The account rests on legal reporting of the judgment; the judgment text was not read. The underlying misdeclaration allegation was not decided and the proceedings were revived. The trader is not named.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"The Supreme Court, after individually verifying the cited material, found non-existent cases, fake citations and misattributed ratios in the penalty order and said this 'appears to be a hallucination of AI'; it held that 'the use of AI in this case' was fatal to the order. The tool, and how the officer used it, are not stated in the read reports. The penalty decision was the officer's; whether the AI drafted or merely supplied authorities is unknown, so the AI-to-person relation is recorded as unknown.","status":"supported"},"person_relations":["unknown"]},"name":"Surat, India: a customs officer's ₹425 crore penalty order against a diamond trader relied on non-existent and misattributed case law that India's Supreme Court found 'appears to be a hallucination of AI'; the court set the order aside after the trader had lost in the Gujarat High Court","summary":"On 8 October 2025 the Additional Commissioner of Customs in Surat imposed a penalty of ₹425,27,99,100 (about ₹425 crore) on a diamond trader under Section 114 of the Customs Act, 1962, for allegedly misdeclaring a consignment of natural diamonds as lab-grown diamonds to pay a lower tariff. The trader's challenge was dismissed by the Gujarat High Court on 20 January 2026. Before the Supreme Court the trader argued that judgments and articles cited in the penalty order had been generated using artificial intelligence. On 2 September 2026 a bench of Justices Dipankar Datta and Sheel Nagu, after checking the material, found that the order relied on case law that was non-existent or carried fake citations, and on real cases that did not lay down the propositions attributed to them, which the court said 'appears to be a hallucination of AI'. Holding that the use of AI and reliance on this dubious material was fatal to the order, the court set aside both the penalty order and the High Court's order without deciding the merits, sent the matter for fresh adjudication by a different officer of the same rank, and left any action against the order's author to the appointing authority. The AI tool used is not named in the read reports.","incidentDate":"2025-10-08","incidentEndDate":"2026-09-02","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"unknown","reportedDate":"2026-09-02","aiSystem":"Unnamed generative AI tool whose output the Supreme Court of India found in a customs penalty order (non-existent and misattributed case law); the tool is not identified in the read reports","aiProduct":"Unidentified AI tool","aiCompany":"Unknown","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["legal_harm"],"harmOutcomeSummary":"A diamond trader was subjected for about eleven months to a ₹425 crore customs penalty order, and lost a High Court challenge to it, before India's Supreme Court voided the order because it relied on non-existent and misattributed case law that the court found appeared to be AI hallucination (Supreme Court judgment as reported by Bar & Bench, SCC Online and Upstox). The underlying proceedings were revived.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One trader, the appellant, on whom the penalty was imposed. The trader did not use the AI; the customs officer did. No other person is reported harmed.","victimAgeRange":"adult","jurisdiction":"IN","platformType":"other","outcomeType":"internal_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.barandbench.com/news/litigation/supreme-court-scraps-425-crore-penalty-over-fake-citations-ai-hallucinations-in-customs-order","primarySourceLabel":"Bar & Bench, 2 September 2026: Supreme Court scraps ₹425 crore penalty over fake citations, AI hallucinations in customs order","firstPublishedAt":"2026-09-29T09:08:50.773251+00:00","updatedAt":"2026-09-30T01:17:55.666396+00:00","scopeVersion":"facts-v3","tags":["india","surat","customs","supreme-court","hallucinated-citations","institutional-use","administrative-decision","penalty"]},{"id":"2025-lipps-facial-recognition-wrongful-jailing","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"Surveillance 'showed woman using a fake US army military ID to withdraw tens of thousands'; the 8-count charge list.","relation":"supports","source_id":"s1"},{"locator":"Zibolski 'acknowledged that investigators made incorrect assumptions based on the West Fargo Police Department's Clearview AI facial recognition technology'.","relation":"supports","source_id":"s4"},{"locator":"Warrant signed 2025-07-01 with nationwide extradition; the chief: the case 'was not solely based on just that one piece'; 'an AI function through the North Dakota State Intelligence Center'.","relation":"supports","source_id":"s2"}],"assertion":"The case began with bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars; an AI facial-recognition identification tied Lipps to that surveillance — recorded by Snopes as the West Fargo Police Department's Clearview AI technology, and by Fargo's chief as 'an AI function through the North Dakota State Intelligence Center... not anything that we own'; a nationwide-extradition warrant was signed on 1 July 2025.","causal_attribution":"The vendor attribution differs between the chains (Clearview per Snopes' reading of the WFPD investigation; the state intelligence center's function per the chief) and is recorded with the discrepancy."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'US marshals arrested Lipps at her Tennessee home while she was babysitting four children... taken away at gunpoint'; 'nearly four months without bail'; bank records 'more than 1,200 miles away in Tennessee'.","relation":"supports","source_id":"s1"},{"locator":"PD timeline: TN waiver 10-20; booked Cass Co. 10-30; bank records presented 12-12; dismissal agreed 12-23; released 12-24.","relation":"supports","source_id":"s2"},{"locator":"Dismissal 'without prejudice... Angela remains a person they are investigating'.","relation":"supports","source_id":"s3"}],"assertion":"U.S. Marshals arrested her at gunpoint at her Tennessee home on 14 July 2025 while she babysat four children; she fought extradition for about three months in a Tennessee jail, was booked into Cass County on 30 October, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice.","causal_attribution":"The custody timeline is consistent across the Guardian, KVLY's police timeline and Snopes; the dismissal's without-prejudice character comes from KVLY's attorney piece."},{"id":"c3","status":"documented","evidence":[{"locator":"KVLY-obtained email 'showed six Fargo detectives were notified of Lipps' arrest in July — nearly five months before Fargo Police say they knew she was in custody'.","relation":"supports","source_id":"s3"}],"assertion":"An email obtained by KVLY shows six Fargo detectives were notified of her arrest in July 2025 — nearly five months before the department says it learned she was in custody (5 December).","causal_attribution":"KVLY's own document reporting; the department's stated knowledge date comes from its police timeline."},{"id":"c4","status":"corroborated","evidence":[{"locator":"The 'incorrect assumptions' concession (Snopes' reading of the 24 March presser).","relation":"supports","source_id":"s4"},{"locator":"The chief's 'not solely based on just that one piece' and the state-center tool description.","relation":"supports","source_id":"s2"},{"locator":"Stefonowicz's April statement on an apology.","relation":"supports","source_id":"s3"}],"assertion":"Fargo Police Chief Dave Zibolski acknowledged 'incorrect assumptions' linked to the AI identification while insisting the case 'was not solely based on just that one piece'; incoming Chief Stefonowicz said in April that if Ms. Lipps deserves an apology, 'I will absolutely be the first person to reach out'.","causal_attribution":"The concession's exact wording beyond Snopes' paraphrase is unverified; both chiefs' positions are recorded as stated."},{"id":"c5","status":"corroborated","evidence":[{"locator":"'lost her home, her car and her dog.'","relation":"supports","source_id":"s1"},{"locator":"Rice: 'pursuing potential civil rights claims, though no lawsuit has been filed'.","relation":"supports","source_id":"s3"}],"assertion":"She lost her home, her car and her dog; her attorney Eric Rice said he was pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026.","causal_attribution":"The losses are from the Guardian's account of her situation; the claim status is the attorney's statement as of 31 March 2026."},{"id":"c6","status":"reported","evidence":[{"locator":"'Angela Lipps, of Elizabethton, Tennessee, filed the federal lawsuit Tuesday in U.S. District Court in North Dakota against the City of Fargo and Fargo Police Department Detective Lucas Heck'; 'The complaint says Heck failed to disclose that the facial recognition result was actually based on a photo from the suspect's fake ID, not the surveillance footage'; 'The lawsuit brings five claims... Lipps is seeking $10 million in damages'; 'These are allegations contained in a civil complaint. No response has been filed as of this writing.'","relation":"supports","source_id":"s5"}],"assertion":"On 15 September 2026 Lipps filed a federal civil-rights lawsuit in the District of North Dakota against the City of Fargo and Detective Lucas Heck seeking $10 million, alleging that he relied on a flawed facial-recognition match based on the suspect's fake-ID photo, ignored exculpatory evidence and failed to disclose that such results are only investigative leads; the suit brings five claims and says the department had no facial-recognition policy or training at the time.","causal_attribution":"The filing and its contents are reported by the same station chain (KVLY) that broke the case; the complaint itself was not inspected, so the claim is recorded as reported rather than documented. The InForum report of the same filing answered HTTP 403."}],"effects":[{"label":"five months wrongfully jailed on an AI facial-recognition identification, with lasting losses","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.theguardian.com/us-news/2026/mar/12/tennessee-grandmother-ai-fraud","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (12 Mar 2026, Marina Dunbar).","independence_group":"guardian"},{"id":"s2","url":"https://www.valleynewslive.com/2026/03/17/chief-zibolski-ai-was-lead-not-only-evidence-wrongful-jail-allegation/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (17 Mar 2026, Alix Larsen).","independence_group":"kvly"},{"id":"s3","url":"https://www.valleynewslive.com/2026/04/01/attorney-discusses-potential-lawsuit-after-tennessee-grandmother-jailed-by-facial-recognition-error/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (31 Mar 2026, Ethan Kramer).","independence_group":"kvly"},{"id":"s4","url":"https://www.snopes.com/fact-check/ai-tennessee-woman-jail/","kind":"fact_check","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (19 Jul 2026, updated 22 Jul; rating True). Aggregates the InForum/WDAY originals (blocked, 403); its Clearview attribution reflects that chain.","independence_group":"snopes"},{"id":"s5","url":"https://www.valleynewslive.com/2026/09/15/tennessee-woman-sues-fargo-ex-detective-over-wrongful-arrest-tied-facial-recognition-error/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-16 (datePublished 2026-09-15T17:39Z; Valley News Live, which first reported the case in March 2026).","independence_group":"kvly"}],"version":1,"ai_roles":["institutional_use"],"contexts":["justice"],"unknowns":["The InForum original investigation (the first reporting chain) is blocked (403) and was not read; Snopes' and the Guardian's accounts of it are used instead.","The exact wording of the 'incorrect assumptions' concession beyond Snopes' paraphrase is unverified.","The vendor question — Clearview AI (per Snopes) versus the North Dakota State Intelligence Center's AI function (per the chief) — is unresolved.","The woman in the bank-fraud surveillance (the actual suspect) is not reported as identified; the dismissal without prejudice leaves the investigation open.","Her arrest's bail conditions and the custody conditions are not detailed in the inspected sources.","The federal complaint (filed 15 September 2026) was not inspected and its case number is not given in the inspected report; the InForum account of the filing was blocked (403)."],"geography":{"basis":"Event: arrest at her Tennessee home; jailing in Tennessee and Cass County, North Dakota; the underlying bank fraud in the Fargo/West Fargo area. Affected person: Lipps, Tennessee. Court: the Cass County charges (dismissed), North Dakota.","court_countries":["US"],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as an institutional automated-decision case (made_decision_about / made_claim_about): an AI facial-recognition identification set five months of wrongful custody in motion, documented by the Guardian, an independent local chain with its own document reporting (KVLY), and a fact-check carrying the blocked original chain. She is named in national coverage; the police chiefs' accounts are preserved as contrary context. Updated 16 September 2026 with the $10 million federal suit filed on 15 September, recorded from the Valley News Live report as a reported claim.","reviewed_on":"2026-09-16"},"ai_involvement":{"basis":"Snopes records the misidentification as based on the West Fargo PD's Clearview AI technology; Fargo's police chief separately describes 'an AI function through the North Dakota State Intelligence Center' and concedes 'incorrect assumptions' while insisting the case was not solely based on that one piece. The vendor attribution (Clearview vs the state center's function) is recorded with the discrepancy.","status":"supported"},"person_relations":["made_decision_about","made_claim_about"]},"name":"Tennessee grandmother Angela Lipps jailed five months on an AI facial-recognition misidentification; charges dismissed after bank records placed her 1,200 miles away","summary":"On 14 July 2025, U.S. Marshals arrested Angela Lipps, a 50-year-old Tennessee grandmother, at gunpoint at her home while she was babysitting four children, on a nationwide-extradition North Dakota warrant: West Fargo police's AI facial-recognition technology had tied her to bank-fraud surveillance of a woman using a fake U.S. Army military ID to withdraw tens of thousands of dollars. She fought extradition for about three months in a Tennessee jail, was booked into Cass County, North Dakota on 30 October 2025 on four counts of unauthorized use of personal identifying information and four counts of theft, and was released on 24 December after her bank records showed her more than 1,200 miles away in Tennessee; charges were dismissed without prejudice. Fargo's police chief acknowledged 'incorrect assumptions' linked to the AI identification; an email obtained by KVLY shows six Fargo detectives were notified of her arrest in July, nearly five months before the department says it knew she was in custody. She lost her home, her car and her dog; her attorneys are pursuing potential civil-rights claims, with no lawsuit filed as of 31 March 2026. On 15 September 2026 she filed a $10 million federal civil-rights suit in the District of North Dakota against the City of Fargo and the detective, alleging he relied on a flawed facial-recognition match and ignored exculpatory evidence.","incidentDate":"2025-07-14","incidentEndDate":"2025-12-24","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"single_interaction","reportedDate":"2026-03-12","aiSystem":"Clearview AI facial recognition (per Snopes' account of the West Fargo PD investigation); described by Fargo's chief as 'an AI function through the North Dakota State Intelligence Center'","aiProduct":"Clearview AI facial recognition (reported)","aiCompany":"Clearview AI (vendor per Snopes); North Dakota State Intelligence Center (per Fargo police chief)","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["legal_harm","loss_of_autonomy","reputational_harm","property_loss","psychological_distress"],"harmOutcomeSummary":"Five months jailed on an AI-driven misidentification — arrested at gunpoint while babysitting, held states away from home — ending only when her bank records proved she was 1,200 miles away; she lost her home, car and dog, and the dismissal without prejudice leaves her 'a person they are investigating'.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One documented harmed person: Lipps, the misidentified defendant (three chains; her attorneys' account). The children she was babysitting are recorded in the narrative but not counted as harmed persons (no harm to them is reported).","victimAgeRange":"adult","jurisdiction":"US","platformType":"other","outcomeType":"lawsuit_filed","outcomeStatus":"ongoing","primarySourceUrl":"https://www.theguardian.com/us-news/2026/mar/12/tennessee-grandmother-ai-fraud","primarySourceLabel":"The Guardian (12 Mar 2026, Marina Dunbar) — the arrest, the custody ordeal, the losses","firstPublishedAt":"2026-09-15T10:28:13.154947+00:00","updatedAt":"2026-09-30T01:17:08.693119+00:00","scopeVersion":"facts-v3","tags":["civil-rights","clearview","facial-recognition","justice","lawsuit","made-claim-about","made-decision-about","north-dakota","tennessee","wrongful-arrest"]},{"id":"2025-keene-v-google-ai-overview-defamation","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"Opinion page 2 lists Overviews 1–4 separately: 1, 2 and 4 concern life without parole; 2 mentions murders of three women; 3 says he was convicted of drug trafficking. The analysis of Overview 3 and conclusion explain its substantial-truth dismissal.","relation":"supports","source_id":"s1"},{"locator":"Complaint excerpt: statements that he 'is serving a life sentence without parole for multiple convictions' and 'for the murders of 3 women'.","relation":"context","source_id":"s4"}],"assertion":"The court’s opinion recounts four challenged Google AI Overviews between approximately 24 May and 27 June 2025. The complaint alleges that Overviews 1, 2 and 4 falsely said Keene was serving life without parole, with Overview 2 adding murders of three women. Overview 3 instead said he had been convicted of drug trafficking; the court considered that statement substantially true.","causal_attribution":"Allegations of the complaint as recited by the court; accepted as true only for the motion to dismiss."},{"id":"c2","status":"documented","evidence":[{"locator":"Page 2: 'Keene complained to Google about the false statements on three occasions ... Google allegedly apologized ... and deemed the statements errors made by its Artificial Intelligence.' and 'AI Overviews 1 and 2 were seen by various family members, friends, and acquaintances.'","relation":"supports","source_id":"s1"},{"locator":"Complaint excerpt: 27 May 2025 complaint; Google 'privately apologized', attributing the statements to 'an unknown error made by their Artificial Intelligence Platform'.","relation":"context","source_id":"s4"}],"assertion":"The complaint alleges he notified Google on 27 May, 31 May and after 27 June 2025, that Google apologised each time and attributed the statements to errors by its AI, and that Overviews 1 and 2 were seen by family members, friends and acquaintances.","causal_attribution":"Allegations as recited by the court."},{"id":"c3","status":"documented","evidence":[{"locator":"Pages 1 and 12: 'that motion is granted in part and denied in part' ... 'the Court denies Google's motion to dismiss AI Overviews 1 and 2, and grants Google's motion to dismiss AI Overviews 3 and 4 without prejudice. Keene may file an amended complaint by October 13, 2026.'","relation":"supports","source_id":"s1"},{"locator":"Docket entry 29, 14 September 2026: 'Memorandum Opinion and Order AND Order on Motion to Dismiss'.","relation":"context","source_id":"s2"},{"locator":"Post quoting the opinion's actual-malice and disclaimer holdings.","relation":"supports","source_id":"s3"}],"assertion":"On 14 September 2026 Judge Thomas M. Durkin denied Google's motion to dismiss the defamation per se claim as to Overviews 1 and 2, holding that the plaintiff, a public figure, had plausibly pleaded actual malice through his three notifications, and dismissed the claims on Overviews 3 (substantially true) and 4 (publication not alleged) without prejudice, with leave to amend by 13 October 2026.","causal_attribution":"Court ruling on the pleadings; no finding of liability."},{"id":"c4","status":"documented","evidence":[{"locator":"Page 2: 'Keene filed his complaint ... on July 30, 2025, in the Circuit Court of Cook County. Google removed the suit to federal court on September 22, 2025.'","relation":"supports","source_id":"s1"},{"locator":"Docket header: filed 22 September 2025, No. 1:25-cv-11431.","relation":"supports","source_id":"s2"}],"assertion":"The suit was filed in the Circuit Court of Cook County on 30 July 2025 and removed by Google to federal court on 22 September 2025.","causal_attribution":"Procedural history from the court record."}],"effects":[{"label":"reputational_harm_from_false_ai_statements","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://storage.courtlistener.com/recap/gov.uscourts.ilnd.486629/gov.uscourts.ilnd.486629.29.0.pdf","kind":"court_opinion","access":"read","language":"en","translation_note":"Memorandum Opinion and Order, ECF No. 29, filed 14 September 2026; PDF read in full via CourtListener RECAP on 2026-09-15.","independence_group":"court-record"},{"id":"s2","url":"https://www.courtlistener.com/docket/71417738/keene-v-google-llc/","kind":"court_docket","access":"read","language":"en","translation_note":"Public docket page read on 2026-09-15.","independence_group":"court-record"},{"id":"s3","url":"https://reason.com/volokh/2026/09/14/federal-court-allows-libel-by-ai-claim-brought-by-protagonist-of-apple-tvs-black-bird-series-to-go-forward/","kind":"legal_commentary","access":"read","language":"en","translation_note":"Read on 2026-09-15; quotes the opinion.","independence_group":"court-record"},{"id":"s4","url":"https://reason.com/volokh/2025/09/23/from-prison-to-helping-the-fbi-to-an-apple-tv-miniseries-to-google-hallucinated-libel/","kind":"legal_commentary","access":"read","language":"en","translation_note":"Read on 2026-09-15; quotes the complaint at removal.","independence_group":"court-record"}],"version":1,"ai_roles":["institutional_use"],"contexts":["everyday_life","privacy","justice"],"unknowns":["The plaintiff's residence and the locations where the Overviews were generated or viewed are not stated in the inspected records.","No damages figure appears in the inspected records.","The complaint exhibits (screenshots of the Overviews) were not inspected.","The case continues; an amended complaint was due by 13 October 2026."],"geography":{"basis":"The AI Overviews were generated online in response to searches; where they were generated or viewed is not stated. The plaintiff's residence is not stated in the inspected records, and the charter does not infer a country from the court. Court: United States District Court for the Northern District of Illinois, after removal from the Circuit Court of Cook County.","court_countries":["US"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published on the strength of the court's own opinion and docket, read in full, with legal commentary as context. The plaintiff is a public figure who sued under his own name; allegations are attributed to the complaint and the ruling is limited to the pleadings.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"The statements at issue appeared in Google's AI Overviews, and the court's opinion recites the allegation that Google attributed them to errors by its artificial intelligence. The screenshots are exhibits to the complaint and were not inspected here; the court accepted the allegations as true for the motion to dismiss only.","status":"supported"},"person_relations":["made_claim_about"]},"name":"Keene v. Google: defamation claim over AI Overviews calling an author a convicted murderer survives dismissal","summary":"An author and television producer, the subject of the Apple TV series 'Black Bird', sued Google, alleging that AI Overviews shown for searches about him in May and June 2025 falsely said he was serving a life sentence without parole, in one version for the murders of three women. He says he notified Google three times and received apologies attributing the statements to its AI, yet similar statements kept appearing. On 14 September 2026 the Northern District of Illinois denied Google's motion to dismiss as to two of the four challenged Overviews and dismissed the other two without prejudice. This was a ruling on the pleadings, not a finding that the allegations were proven.","incidentDate":"2025-05-24","incidentEndDate":"2025-06-27","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"unknown","reportedDate":"2025-09-23","aiSystem":"Google AI Overviews","aiProduct":"Google AI Overviews","aiCompany":"Google LLC","severity":"medium","verificationStatus":"verified","harmCategories":[],"harmOutcomes":["reputational_harm"],"harmOutcomeSummary":"The plaintiff alleges that false AI-generated statements that he was a convicted murderer serving life without parole were shown to searchers, including family, friends and acquaintances, and continued after he notified Google.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person is the subject of the alleged defamatory statements and the plaintiff (court opinion). Family and acquaintances who saw the statements are not counted as harmed.","victimAgeRange":"adult","outcomeType":"lawsuit_ongoing","outcomeStatus":"ongoing","primarySourceUrl":"https://storage.courtlistener.com/recap/gov.uscourts.ilnd.486629/gov.uscourts.ilnd.486629.29.0.pdf","primarySourceLabel":"Memorandum Opinion and Order, Keene v. Google LLC, No. 25 C 11431 (N.D. Ill. 14 September 2026), ECF No. 29, via CourtListener RECAP","firstPublishedAt":"2026-09-15T03:23:44.732123+00:00","updatedAt":"2026-09-30T01:17:07.683768+00:00","scopeVersion":"facts-v3","tags":["defamation","ai-overviews","google","hallucination","lawsuit","reputational-harm"]},{"id":"2025-winters-v-openai","metadataReview":{"version":1,"geography":{"basis":"Geographic fields reviewed against the cited retained dossier passages. This is a metadata review, not a new source or causal review. Residence, event setting and court are recorded separately. Affected-person countries refer to reported location or residence, not citizenship or a complete residence history.","evidence":[{"kind":"existing_record","locator":"living in Florida","location":"detailed_description","supports":["affected_person_countries"],"countries":["US"]},{"kind":"existing_record","locator":"Superior Court of California, County of San Francisco","location":"outcome_details","supports":["court_countries"],"countries":["US"]}],"court_countries":["US"],"event_countries":[],"affected_person_countries":["US"]},"unresolved":["The event setting was not established in this metadata pass. A person’s home country alone was not used as its location.","Source languages remain unreviewed; no source body was newly inspected for this record during this metadata pass."],"reviewed_on":"2026-09-15","source_reviews":[]},"name":"Winters v. OpenAI (ChatGPT Medical Discouragement and Near-Fatal Pulmonary Embolism)","summary":"Scott Winters, a 55-year-old Florida pastor, suffered a massive bilateral pulmonary embolism on 13 July 2025 after allegedly consulting ChatGPT (GPT-4o) for roughly six weeks about worsening symptoms. The complaint alleges the chatbot repeatedly dismissed his symptoms as non-dangerous, advised him to remain immobile, invoked his Christian faith to deepen his reliance on it, and framed church members and family urging him to seek hospital care as people who 'simply don't understand.' He survived after ICU admission but lost his job, ministry and home. A lawsuit was filed 22 July 2026 in San Francisco County Superior Court.","incidentDate":"2025-07-13","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"repeated_interactions","reportedDate":"2026-07-22","aiSystem":"ChatGPT","aiProduct":"ChatGPT","aiCompany":"OpenAI","severity":"critical","verificationStatus":"verified","harmCategories":["treatment_discouragement","isolation_encouragement","dependency_creation","psychological_manipulation","crisis_response"],"harmOutcomes":["medical_deterioration","hospitalization","treatment_disruption","professional_harm","financial_loss"],"harmOutcomeSummary":"Scott Winters suffered a massive bilateral pulmonary embolism and intensive-care admission after allegedly delaying treatment for six weeks; he later lost his work, ministry and home.","frameworkFacets":["P1a","P1b","P1c","P1d","P2b","P2d","P3c","P5b","P5c"],"pathwayDirection":"inward","causationStatus":"alleged","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"The complaint documents one named participant's medical, professional, and financial harms.","victimAgeRange":"adult","jurisdiction":"US-FL","platformType":"assistant","outcomeType":"lawsuit_filed","outcomeStatus":"ongoing","primarySourceUrl":"https://www.courthousenews.com/wp-content/uploads/2026/07/winters-v-open-ai-complaint.pdf","primarySourceLabel":"Winters v. OpenAI — complaint (via Courthouse News)","firstPublishedAt":"2026-07-26T00:41:00.976587+00:00","updatedAt":"2026-09-30T01:17:21.677441+00:00","scopeVersion":"participant-v2","tags":["lawsuit","adult","chatgpt","openai","medical-advice","sycophancy","treatment-discouragement","us","us-fl"]},{"id":"2025-viktoria-poland-chatgpt","metadataReview":{"version":1,"geography":{"basis":"Geographic fields reviewed against the cited retained dossier passages. This is a metadata review, not a new source or causal review. Residence, event setting and court are recorded separately. Affected-person countries refer to reported location or residence, not citizenship or a complete residence history.","evidence":[{"kind":"existing_record","locator":"Young Ukrainian woman in Poland received suicide encouragement","location":"summary","supports":["event_countries","affected_person_countries"],"countries":["PL"]}],"court_countries":[],"event_countries":["PL"],"affected_person_countries":["PL"]},"unresolved":["No court country established in this review. Regulatory authorities and police locations are not automatically courts.","Source languages remain unreviewed; no source body was newly inspected for this record during this metadata pass."],"reviewed_on":"2026-09-15","source_reviews":[]},"name":"Viktoria Poland - ChatGPT Suicide Encouragement","summary":"Young Ukrainian woman in Poland received suicide encouragement from ChatGPT, which validated self-harm thoughts, suggested suicide methods, dismissed value of relationships, and allegedly drafted suicide note. OpenAI acknowledged 'violation of safety standards.' Non-fatal due to intervention.","incidentDate":"2025-06-01","incidentKind":"single_event","incidentDatePrecision":"range","exposurePattern":"repeated_interactions","reportedDate":"2025-07-15","aiSystem":"ChatGPT","aiProduct":"ChatGPT","aiCompany":"OpenAI","severity":"high","verificationStatus":"verified","harmCategories":["suicide_validation","method_provision","barrier_erosion","crisis_response","treatment_discouragement"],"harmOutcomes":["psychological_distress","impaired_judgment"],"harmOutcomeSummary":"A young Ukrainian participant in Poland received suicide encouragement, method suggestions and isolation messages during a crisis before someone in her support network intervened. OpenAI acknowledged a safety-standard violation.","frameworkFacets":["P1a","P1b","P1c","P1d","P2d","P5d"],"pathwayDirection":"inward","causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"The reporting documents one protected participant's distress and impaired judgment before intervention.","victimAgeRange":"adult","jurisdiction":"PL","platformType":"assistant","outcomeType":"internal_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.psychologytoday.com/us/blog/its-not-just-in-your-head/202601/the-hidden-dangers-of-ai-driven-mental-health-care","primarySourceLabel":"Psychology Today","firstPublishedAt":"2026-01-13T10:04:24.625869+00:00","updatedAt":"2026-09-30T01:17:20.422164+00:00","scopeVersion":"participant-v2","tags":["poland","ukraine","chatgpt","openai","suicide_encouragement","method_provision","openai_acknowledged","non_fatal"]}]}