Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT
In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026
1 Dec 2025CzechiaUnidentified legal research tool
On 1 December 2025 the presiding judge of a chamber of the Czech Constitutional Court fined a Prague lawyer 25,000 crowns (a quarter of the statutory maximum) for grossly obstructing proceedings. The lawyer had filed a constitutional complaint, for a client refused a temporary residence permit, that argued from 12 decisions of the Constitutional Court and the European Court of Human Rights; the court found that a substantial part of them did not exist and part were grossly misinterpreted. The order says the complaint showed signs of generative AI and that the court presumed the lawyer had generated it with an AI model and then failed to verify the citations. The lawyer confirmed to INFO.CZ that an AI tool was used, described it as a paid professional model from a legal information system provider, said the output was not checked enough, and expressed regret. The court invited the client to correct the complaint so that the client would suffer no procedural harm; the complaint was later rejected as manifestly unfounded on 30 January 2026. INFO.CZ reported on 10 December 2025 that the lawyer had apologised and paid the fine and that the Czech Bar Association's supervisory board was examining the case.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution established · 5 sources · Added 26/10/2026
Event date unknownRussiaUnidentified legal research tool
Russia's Court for Intellectual Property Rights fined an individual entrepreneur from Udmurtia 5,000 roubles for contempt of court after finding that part of the 12 references to case law in his cassation appeal, including one said to be a Supreme Court position, pointed to court acts that do not exist or attributed conclusions to them, the court's press service told RIA Novosti on 27 August 2026. Rossiyskaya Gazeta reports that the entrepreneur explained he had prepared the appeal with an AI-based service that selected the case law, and that his side argued he had no legal education and could not check the references; the court rejected the argument that the errors were technical. The date of the ruling and the AI service are not reported.
Core + contextual relations Low reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 2 sources · Added 23/10/2026
Sept 2023AustraliaChatGPT
Victoria's Information Commissioner (OVIC) found in a report published on 24 September 2024 that a child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT in or around September 2023 to draft a Protection Application Report submitted to the Children's Court about a young child. On the balance of probabilities, OVIC found the worker entered personal information, including names, about the child, mother, father and carer, disclosing it to OpenAI; the worker admitted using ChatGPT but denied entering personal information. OVIC found generated content in the report described a doll that the father had reportedly used for sexual purposes as a parental strength ('age-appropriate toys'), downplaying the risk to the child, although the court's and the department's decisions did not change. The report was withdrawn and replaced, and the mother, father and carer described anxiety when told of the disclosure. OVIC found serious breaches of two privacy principles and issued a compliance notice requiring DFFH to ban and block generative AI text tools for child protection staff until November 2026; DFFH accepted the breach findings.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026
21 Oct 2025 to 3 Apr 2026United StatesCoCounsel
In a published opinion of 3 April 2026, the U.S. Court of Appeals for the Sixth Circuit addressed the briefs a lawyer appointed under the Criminal Justice Act had filed for an indigent defendant appealing a sentencing enhancement in a drug-trafficking case. The court noticed that the principal brief's file name was 'CoCounsel Skill Results' and found three quotations that appear in no legal authority and misstatements of two precedents. The lawyer admitted that a staff member had used Westlaw's CoCounsel to create the first draft, that he repeated the process for the reply, and that the false quotations came from artificial intelligence he did not verify. The court denied him compensation for the appeal, referred the opinion for possible disciplinary proceedings and to the Kentucky Bar Association, and by separate order removed him, locked his briefs and ordered replacement counsel to file new ones, which it said further delayed resolution of the defendant's appeal. The court acknowledged his candour and his 40 years without discipline.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 19/10/2026
15 Jul 2026United StatesUnidentified AI drafting tool
In a published opinion of July 2026, the Arizona Court of Appeals found that a self-represented appellant's opening brief in a probate dispute contained eight citations, six of them deficient, including two cases that do not exist. In a written explanation and at a hearing on the false citations he acknowledged relying on generative AI to write the brief and said he did nothing to verify the citations. The court struck the inaccurate and false citations, rejected the appeal because no supportive authority remained, held that citing a hallucinated case is sanctionable whether or not it is intended, and ordered him to pay the share of the other party's attorney's fees traceable to the fake citations. Because he said he did not intend to deceive and is not legally trained, the court chose this narrow sanction over contempt or fines. It described the opinion as the first published Arizona ruling on generative AI hallucinations in filings.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution established · 1 source · Added 18/10/2026
24 Apr 2026United StatesUnidentified AI research tool
On 24 April 2026 the Supreme Court of Alabama dismissed an appeal by two siblings in a family dispute over living trusts because their lawyer, W. Perry Hall, had filed briefs in which most of the legal authorities were misquoted or did not exist. The court said they appeared to be AI hallucinations, and at a show-cause hearing in February 2026 Hall admitted that many authorities did not exist and that he had improperly used AI to obtain them. The court ordered Hall to pay the opposing party's fees and costs of $17,200 and double appeal costs, barred him from filing in the court without a co-signing attorney and referred him to the Alabama State Bar. It said the dismissal was imposed as a sanction because of the particularly egregious facts. One justice, concurring in part and dissenting in part, objected to dismissing the appeal as a sanction for the lawyer's conduct but would have affirmed the judgment against the clients on the merits.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 1 source · Added 14/10/2026
Sept 2026PakistanClaude (reported)
A teenager in Karachi was detained by Pakistan's National Cyber Crime Investigation Agency (NCCIA) and later released after his questions to an AI chatbot about how a character in a crime story could be killed were flagged, according to officials quoted by ARY News (29 September 2026) and the NCCIA as cited by ProPakistani (2 October 2026). ProPakistani reports that, according to the NCCIA, the platform's safety system flagged the queries on 4 September and the information was reportedly shared with the US FBI, which passed it to Pakistani authorities; ARY reports that the NCCIA carried out a raid and detained him. Bloom Pakistan, relaying The News, names the chatbot as Anthropic's Claude and reports that Anthropic reported the activity to the FBI. Officials said he told investigators he was writing a fictional crime story, and he was released after questioning; Bloom, relaying The News, says investigators found no grounds for prosecution but remained concerned.
Core + contextual relations Medium reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 14/10/2026
3 Jun 2026United StatesUnidentified AI tool
On 3 June 2026 the US Court of Appeals for the Ninth Circuit fined immigration attorneys Mike Singh Sethi and William Rounds $2,500 each and suspended both from practice before the court for six months. Briefs filed in an asylum petition for review cited two cases that do not exist and attributed quotations to opinions that do not contain them. In a motion to correct, the attorneys called the errors typographical, and at oral argument Rounds twice said AI was not used. In their response to the court's order to show cause, they conceded that the errors were probably the product of unauthorised AI use by the firm's unlicensed brief writers and a failure to check citations. The court said the suspension was owed to their repeated failure of candour. The Board of Immigration Appeals then suspended Sethi from practice before the Board, the immigration courts and the Department of Homeland Security for six months, effective 13 June 2026, and designated that decision as a precedent on 1 October 2026.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 2 sources · Added 14/10/2026
Oct 2026BrazilUnidentified AI drafting tool (suspected)
Goiânia city councillor Aava Santiago (PSB) told Brazil's National Council of Justice (CNJ) that the final text of a judgment of the Regional Electoral Court of Goiás (TRE-GO), which removed her from office for party infidelity, contained commands, instructions and review records indicating the use of artificial intelligence without the human supervision that CNJ Resolution 615/2025 requires. On 9 October 2026, the day a substitute took her seat, the national inspector of justice, Minister Benedito Gonçalves, found the allegations plausible on a preliminary reading, suspended the judgment and the administrative acts that followed from it, and gave the court 15 days to explain its review procedures, G1 and Jurinews report. The suspension does not review the merits of the removal, and whether AI was used irregularly has yet to be investigated.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement suspected · Causal attribution alleged · 2 sources · Added 13/10/2026
15 Dec 2025 to 1 Oct 2026CanadaUnidentified AI drafting tool
On 1 October 2026 the Quebec Court of Appeal ordered court costs against a self-represented appellant in a family-law contempt appeal as a sanction for appeal filings that, in the court's description, he had written with artificial intelligence and that contained two references to non-existent judgments and one inaccurate reference to a cited paragraph. The court held that AI may be used to draft appeal filings only if the litigant verifies the authorities, found that he had breached the Chief Justice's notice on AI use, and described his conduct as negligence rather than bad faith. It rejected the respondent's request for a separate $10,000 sanction and, for reasons unrelated to AI, reduced the contempt penalty imposed at first instance. The decision does not name the AI tool.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 1 source · Added 12/10/2026
26 Jun 2025 to 17 Nov 2025United KingdomUnidentified AI tool
Judicial review grounds lodged in the Upper Tribunal (Immigration and Asylum Chamber) on 26 June 2025 by a solicitors' firm cited four authorities that the judge could not find or that carried wrong citations and propositions. The firm's compliance officer, a solicitor whose name was on the claim form, said a junior fee-earner had drafted the grounds under his supervision; his written explanation named an outdated precedent, practitioner blogs and personal notes as the sources. After a Hamid hearing on 5 November 2025, the tribunal recorded that he accepted the fee-earner had relied on false citations generated by AI, and in a judgment promulgated on 17 November 2025 it referred him to the Solicitors Regulation Authority for the false citations and his failure to supervise. The tribunal said it does not matter how such errors come about. It also announced that the Upper Tribunal judicial review claim form now requires a statement of truth that cited authorities exist and support the propositions they are cited for.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 1 source · Added 12/10/2026
2 Oct 2026United StatesUnidentified AI drafting tool
On 2 October 2026 the Nebraska Supreme Court struck the appellate brief of a self-represented party appealing a contempt order in his divorce case because the brief contained numerous citations to fictitious cases and misstatements of law, which the court said were the result of his admitted use of generative artificial intelligence. The court held that self-represented litigants are held to the same standard as attorneys and that submitting a brief relying on nonexistent authority is an abuse of the judicial process worthy of sanctions. Citing the novelty of the issue for self-represented parties, it stopped short of dismissing the appeal and reviewed only for plain error, finding none and affirming the district court's contempt finding, its sanction of 90 days' incarceration with purge conditions, a temporary reduction of his parenting time and an attorney-fee award. The court warned that in future cases dismissal of the appeal may follow. The opinion does not name the AI tool.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution established · 1 source · Added 09/10/2026
Dec 2024 to Sept 2026AustraliaUnidentified AI writing tool
In December 2024 the Parole Board of Tasmania added a condition to the parole of Susan Neill-Fraser, released in 2022 after serving 13 years for murder and who maintains her innocence, barring her from communicating with media to claim innocence or wrongful conviction; a broader condition replaced it in May 2025. On 15 September 2026 the Supreme Court of Tasmania declared the conditions invalid. Her counsel told the court that the board's secretary had used artificial intelligence to prepare a rationale document justifying the condition and that it cited case law that did not exist. The Human Rights Law Centre, which represented her, says the State conceded that the board's decision-making was affected by a document containing legal authorities that were likely AI-generated hallucinations, and the ABC reports the court found the board relied on that document. The board had withdrawn the condition in August 2026. Tasmania's Attorney-General announced an independent investigation of the board's professional standards over its use of unverified AI, and the Justice Department announced a review of AI use in past parole decisions.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 6 sources, 4 underlying accounts · Added 06/10/2026
Nov 2025United StatesChatGPT
In November 2025 Stephens County Associate District Judge Lawrence Wheeler issued an order in a child paternity and custody case that denied one parent's request for a psychological evaluation of the other parent and reprimanded the requesting parent's attorney 'for stooping to such frivolous trial tactics'. The attorney challenged the order at the Oklahoma Supreme Court in February 2026, telling the justices that it relied on two cases that do not exist; the challenge was dismissed in March after Wheeler vacated the order, and he is no longer on the case. According to a 17 August 2026 letter from the Stephens County district attorney, Wheeler told the Oklahoma State Bureau of Investigation that he used ChatGPT for research and wrote the order himself, and that at least two citations in it produced by ChatGPT do not exist. The mother in the case told News 9 that learning the order's citations were allegedly fabricated was alarming because it concerned the custody of a child. The attorney general's office declined criminal prosecution; judicial discipline remains possible.
Contextual tracker case Low reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026
24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system
In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026
19 Jun 2026 to 13 Aug 2026BrazilChatGPT
A man in Brazil was held in pre-trial detention for 54 days in 2026 after OpenAI’s safety systems flagged his ChatGPT conversations and the company reported them to the FBI, which alerted Brazilian police. Police say the messages described a threat to a family member; he denies that intent and his lawyer says he only talked nonsense to the chatbot. A court released him on 13 August under precautionary measures; no charges had been filed as of mid-September. OpenAI did not give police ChatGPT’s replies.
Core + contextual relations High reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026