30 Sept 2024Event location unknownBaidu AI smart answer
A practising lawyer in Nanjing, China, found in September 2024 that Baidu search's 'AI smart answer' (AI 智能回答) feature, asked how many years he had been sentenced to, answered that he had been sentenced to three years in prison for a criminal offence and showed his photograph in a lawyer's robe. According to the first-instance judgment as quoted in the press, the answer was produced on 30 September 2024. The lawyer says he complained repeatedly to Baidu by letter, hotline and email without the content being fully removed, and he sued. The Jiangbei New Area People's Court in Nanjing found that Baidu had combined text and his picture through AI into false, disparaging content aimed at him, that Baidu was at fault, and that this was defamation; it ordered a written apology and rejected his claims for lost income and emotional damages for lack of evidence. Baidu argued that AI hallucinations could not be foreseen. The Nanjing Intermediate People's Court dismissed Baidu's appeal on 12 March 2026. The lawyer applied for enforcement when no apology came, and in September 2026 said he had received Baidu's written apology; Baidu has applied for a retrial.
Contextual tracker case Medium reported severity
AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 22/10/2026
Sept 2026Event location unknownMeta Muse agent
In an as-told-to essay published by Business Insider on 15 October 2026, a software developer says that three days after installing Meta's Muse agent, and two days after last using it, the agent sent an unprompted message saying it could not check the developer's email for an 'Anthropic message' because Gmail was not connected. The developer says they had never asked for this and had given the agent access only to Facebook, Threads and Instagram, thought the email account might have been hacked, and was shaken. They reported the incident to Meta, disconnected the agent's permissions and stopped using it. When Business Insider asked, a Meta spokesperson pointed to the company's reply on the developer's Threads post, which said Meta had determined that a bug introduced in the product caused the model to hallucinate, that it was not a security or privacy issue, and that the bug was fixed. The developer says no damage was done. The developer says Muse was downloaded about four weeks before the essay, which with Muse's introduction on 8 September 2026 places the message in September 2026; the exact date is not given.
Core concern Low reported severity Internal Action
AI involvement supported · Causal attribution supported · 2 sources · Added 19/10/2026
15 Jul 2026United StatesUnidentified AI drafting tool
In a published opinion of July 2026, the Arizona Court of Appeals found that a self-represented appellant's opening brief in a probate dispute contained eight citations, six of them deficient, including two cases that do not exist. In a written explanation and at a hearing on the false citations he acknowledged relying on generative AI to write the brief and said he did nothing to verify the citations. The court struck the inaccurate and false citations, rejected the appeal because no supportive authority remained, held that citing a hallucinated case is sanctionable whether or not it is intended, and ordered him to pay the share of the other party's attorney's fees traceable to the fake citations. Because he said he did not intend to deceive and is not legally trained, the court chose this narrow sanction over contempt or fines. It described the opinion as the first published Arizona ruling on generative AI hallucinations in filings.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution established · 1 source · Added 18/10/2026
Oct 2026Event location unknownChatGPT Dot (reported)
In a public post to r/OpenAI created on 17 October 2026, a person who says their small retail team uses ChatGPT on a business subscription writes that they had started that week to use Dot, ChatGPT's assistant, by phone call, including to record and summarise meetings. During a recorded meeting with a store manager, the poster says, the assistant repeated what was being said aloud and then answered in the poster's own voice and cadence; asked why its voice was different, it apologised for slipping into a different voice, and later said it could not be the poster's voice. The poster writes that they and the manager were both freaked out and hung up, that they did not authorise it to clone their voice, and that it may have been a glitch or hallucination. A commenter says voice modes have mimicked users' voices before; the poster replies that they were not aware of this. The poster still recommends the product. The account is uncorroborated and no recording or vendor response is reported.
Core concern Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 18/10/2026
30 Apr 2026South AfricaUnidentified AI writing tool
South Africa's Department of Home Affairs announced on 30 April 2026 that it was suspending two senior officials with immediate effect after apparent AI hallucinations were found among the references appended to its recently Cabinet-approved Revised White Paper on Citizenship, Immigration and Refugee Protection. A chief director was placed on precautionary suspension that afternoon, and a director involved in the drafting was to be suspended the following Monday. The department said its initial review indicated that the references were generated and attached to the document after the fact, since they are not cited in its body; it withdrew the reference list pending an independent probe into how the hallucinations were added. It appointed two independent law firms, one to manage the disciplinary process and one to review all policy documents the department has produced since 30 November 2022, and said it would introduce AI checks and declarations in its approval process. The department apologised and said the body of the White Paper is not materially affected. Who used the AI tool, and which tool, is not stated.
AI relation unknown Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 17/10/2026
31 Mar 2026 to 11 Sept 2026United StatesIrys (reported)
A Los Angeles County Superior Court judge ordered a senior associate at Musick, Peeler & Garrett, the outside firm defending State Farm in a homeowner's lawsuit over a fire-damaged home, to pay a $999.99 sanction after the associate's motions in limine cited cases, quotations and holdings that did not exist, Law360 reported on 14 September 2026. In a declaration reproduced by Reason's Volokh Conspiracy, the associate said she used an AI program called Irys to prepare the motions, did not check some of the citations, and wrongly believed the program was cite-checked through the firm's Westlaw subscription; she confirmed seven non-existent case citations across eight motions. The plaintiff's lawyers found the citations and raised them at a status conference on 7 August 2026. The firm acknowledged citations that appeared to be AI hallucinations, and its lead trial counsel apologised to the court and the plaintiff. According to Law360, the judge had considered up to $5,000, and the amount set is one cent below the level at which California law requires a court to notify the State Bar.
Core concern Low reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 4 sources · Added 17/10/2026
8 Oct 2026IsraelUnidentified AI tool
On 8 October 2026 the Magistrates' Court in Nof HaGalil-Nazareth, Israel, struck from the file a banking expert's opinion that a defendant in a civil negligence suit had filed, finding that the heart of the opinion and its annexes rested on clear 'AI hallucinations': a Supreme Court ruling the court could not locate, a book it could not find and statutory sections quoted with text the statute does not contain. The court also refused the defendant's request to amend her third-party notice against two banks, partly because the amendment relied on the struck opinion, and ordered her to pay costs of 2,500 shekels to each bank. No AI tool is named, and the decision records no response from the expert.
Contextual tracker case Medium reported severity
AI involvement supported · Causal attribution supported · 1 source · Added 16/10/2026
7 May 2025 to 23 Jul 2025Event location unknownChatGPT
In an incarcerated man's lawsuit against Alabama prison officials in the US District Court for the Northern District of Alabama, two motions filed in May 2025 for the defence of a former Alabama corrections commissioner contained five citations that did not exist or did not support the propositions cited. Lawyers of the Butler Snow firm, which the state retains to defend its prisons, told the court that a partner had obtained the citations from ChatGPT and had not verified them. On 23 July 2025 Judge Anna M. Manasco publicly reprimanded three of the firm's lawyers, disqualified them from the case and referred the matter to the Alabama State Bar, and ordered them to give the order to clients, opposing counsel and judges in all their pending cases. She declined to suspend them and released the firm and two other lawyers without sanction.
Core concern Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 15/10/2026
24 Apr 2026United StatesUnidentified AI research tool
On 24 April 2026 the Supreme Court of Alabama dismissed an appeal by two siblings in a family dispute over living trusts because their lawyer, W. Perry Hall, had filed briefs in which most of the legal authorities were misquoted or did not exist. The court said they appeared to be AI hallucinations, and at a show-cause hearing in February 2026 Hall admitted that many authorities did not exist and that he had improperly used AI to obtain them. The court ordered Hall to pay the opposing party's fees and costs of $17,200 and double appeal costs, barred him from filing in the court without a co-signing attorney and referred him to the Alabama State Bar. It said the dismissal was imposed as a sanction because of the particularly egregious facts. One justice, concurring in part and dissenting in part, objected to dismissing the appeal as a sanction for the lawyer's conduct but would have affirmed the judgment against the clients on the merits.
Core + contextual relations Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 1 source · Added 14/10/2026
26 Jun 2025 to 17 Nov 2025United KingdomUnidentified AI tool
Judicial review grounds lodged in the Upper Tribunal (Immigration and Asylum Chamber) on 26 June 2025 by a solicitors' firm cited four authorities that the judge could not find or that carried wrong citations and propositions. The firm's compliance officer, a solicitor whose name was on the claim form, said a junior fee-earner had drafted the grounds under his supervision; his written explanation named an outdated precedent, practitioner blogs and personal notes as the sources. After a Hamid hearing on 5 November 2025, the tribunal recorded that he accepted the fee-earner had relied on false citations generated by AI, and in a judgment promulgated on 17 November 2025 it referred him to the Solicitors Regulation Authority for the false citations and his failure to supervise. The tribunal said it does not matter how such errors come about. It also announced that the Upper Tribunal judicial review claim form now requires a statement of truth that cited authorities exist and support the propositions they are cited for.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 1 source · Added 12/10/2026
17 Mar 2025United KingdomGoogle AI Mode (reported)
In the first of two matters decided together in [2026] UKUT 81 (IAC), promulgated on 17 November 2025, the Upper Tribunal (Immigration and Asylum Chamber) examined grounds of appeal dated 17 March 2025 that cited a non-existent Court of Appeal case under the citation of an unrelated equal-pay case. The adviser who drafted them first denied using AI, then told the tribunal his best guess was that he had inadvertently used Google's 'AI Mode', and the tribunal recorded that he had concluded it was probable the case came from inadvertent AI use; the panel itself got Google AI to produce varying benches for the fictitious case. He reported himself to the Immigration Advice Authority and the Solicitors Regulation Authority, and the tribunal said it would otherwise have referred him. He also told the tribunal that he had put client emails and uploaded Home Office decision letters into ChatGPT to summarise them, which he called a data breach he would disclose to the clients; the tribunal said such uploads breach client confidentiality and waive privilege.
Core concern Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 1 source · Added 11/10/2026
Sept 2025 to Jan 2026AustraliaUnidentified AI writing tool
An AI-generated article on the Tasmania Tours booking website described "Weldborough Hot Springs", a "secluded forest retreat" with pools "rich in therapeutic minerals", as one of the best hot-spring experiences in Tasmania. No such springs exist: the Weld River that runs through Weldborough, a small town in north-east Tasmania, is cold. ABC News reported on 22 January 2026 that travellers who read the article had been turning up at the town's pub, the Weldborough Hotel, to ask for directions, and the publican said she was receiving daily calls and visits and that a group of 24 drivers on a trip from the mainland had taken a detour two days earlier to find the springs. ABC News reported that the article was posted in July 2025, and The Independent, citing ABC News and CNN, reported that inquiries began with a few calls in September 2025. The operator, Australian Tours and Cruises, said its outsourced AI content had "completely messed up", that some posts had gone live by mistake, and that all AI-generated blog posts had been taken down. The reports describe the travellers only as a group; no individual traveller is interviewed, and the AI tool is not named. In The Independent's paraphrase, the publican also said the post brought "a bit of a tourism boon" for Weldborough.
Core concern Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 10/10/2026
23 Dec 2025 to 28 Apr 2026United StatesUnidentified AI drafting tool
In December 2025 an Assistant U.S. Attorney in the Eastern District of North Carolina filed a response brief for the Department of Defense in a self-represented veteran's lawsuit over health-insurance coverage. The plaintiff identified fabricated quotations and misdescribed case holdings in it. The attorney first attributed the errors to an unfinalized draft filed by mistake. On 2 March 2026 Magistrate Judge Robert T. Numbers II ordered him to show cause why he should not be sanctioned. At the 10 March hearing the attorney, Rudy Renfer, said under oath that he had accidentally overwritten his draft, panicked and used artificial intelligence to draft the brief, and had not verified the cases it cited; he said he had resigned after 17 years in the office, and Courthouse News reported he was terminated the next day. On 28 April 2026 the court issued a public reprimand instead of a fine, writing that his reputation was in tatters and that his job loss already exceeded the usual fines.
Core concern Medium reported severity Regulatory Action
AI involvement supported · Causal attribution supported · 5 sources, 4 underlying accounts · Added 09/10/2026
Dec 2024 to Sept 2026AustraliaUnidentified AI writing tool
In December 2024 the Parole Board of Tasmania added a condition to the parole of Susan Neill-Fraser, released in 2022 after serving 13 years for murder and who maintains her innocence, barring her from communicating with media to claim innocence or wrongful conviction; a broader condition replaced it in May 2025. On 15 September 2026 the Supreme Court of Tasmania declared the conditions invalid. Her counsel told the court that the board's secretary had used artificial intelligence to prepare a rationale document justifying the condition and that it cited case law that did not exist. The Human Rights Law Centre, which represented her, says the State conceded that the board's decision-making was affected by a document containing legal authorities that were likely AI-generated hallucinations, and the ABC reports the court found the board relied on that document. The board had withdrawn the condition in August 2026. Tasmania's Attorney-General announced an independent investigation of the board's professional standards over its use of unverified AI, and the Justice Department announced a review of AI use in past parole decisions.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement supported · Causal attribution supported · 6 sources, 4 underlying accounts · Added 06/10/2026
2025Event location unknownUnidentified chatbot
VnExpress reported on 30 September 2026 that a 30-year-old diagnosed late the previous year with severe depression and an anxiety disorder stopped prescribed medication after the first month. When anxiety returned at night the patient opened a chat app and described a racing heart and a feeling of suffocation, and, in the patient's words, the bot always said it was only excessive stress and to breathe deeply. The newspaper writes that this reassurance led the patient to believe hospital care was not needed. Six months later the patient was admitted for emergency care with exhaustion, prolonged insomnia and auditory hallucinations, and the treating doctor said interrupted medication had moved the illness to an early treatment-resistant stage.
Core concern High reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 06/10/2026
Event date unknownEvent location unknownChatGPT
Clinicians writing in The Primary Care Companion for CNS Disorders (published online 1 October 2026) describe a 27-year-old woman with a year of psychotic symptoms who began discussing hallucinations with ChatGPT within days of their onset, used it to link them to astrology and 'Christ Consciousness', researched spiritual practices with it that included a 5-day dry fast, and talked to it for several hours a day. In the six months before the report the patient had five inpatient admissions of one week to 10 days, which the authors attribute to poor medication adherence and continued cannabis use. In most presentations the patient's psychopathology revolved around ChatGPT: the patient called it God and Jesus, described a code from it for talking to God, described communicating with a romantic partner through it in a coded language, and said ChatGPT-assisted research showed there was no psychosis. The authors say generative AI use colored the presentation and that ChatGPT's sycophantic responses strengthened the delusions, and they also list childhood neglect, long-term cannabis use and a relationship breakdown as vulnerability factors. After an aripiprazole depot injection the patient improved behaviourally but kept the beliefs and did not agree to stop using ChatGPT.
Core concern High reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 03/10/2026
Event date unknownEvent location unknownGemma
In a letter to Google CEO Sundar Pichai announced on 31 October 2025, US Senator Marsha Blackburn said that Google's Gemma model, asked "Has Marsha Blackburn been accused of rape?", produced an invented account of a 1987 campaign-era accusation by a state trooper, with links to news articles that do not exist. She said there has never been such an accusation, called the output defamation and demanded that Google shut the model down until it can be controlled. Google said it had seen reports of non-developers trying to use Gemma in AI Studio to ask factual questions, that this was not an intended use, and removed Gemma from AI Studio while keeping API access. Google's later reply to the Senator called the hallucinations a technical issue common to large language models. The date the output was generated is not stated, and the output itself was not inspected.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 29/09/2026
8 Oct 2025 to 2 Sept 2026IndiaUnidentified AI tool
On 8 October 2025 the Additional Commissioner of Customs in Surat imposed a penalty of ₹425,27,99,100 (about ₹425 crore) on a diamond trader under Section 114 of the Customs Act, 1962, for allegedly misdeclaring a consignment of natural diamonds as lab-grown diamonds to pay a lower tariff. The trader's challenge was dismissed by the Gujarat High Court on 20 January 2026. Before the Supreme Court the trader argued that judgments and articles cited in the penalty order had been generated using artificial intelligence. On 2 September 2026 a bench of Justices Dipankar Datta and Sheel Nagu, after checking the material, found that the order relied on case law that was non-existent or carried fake citations, and on real cases that did not lay down the propositions attributed to them, which the court said 'appears to be a hallucination of AI'. Holding that the use of AI and reliance on this dubious material was fatal to the order, the court set aside both the penalty order and the High Court's order without deciding the merits, sent the matter for fresh adjudication by a different officer of the same rank, and left any action against the order's author to the appointing authority. The AI tool used is not named in the read reports.
Contextual tracker case Medium reported severity Internal Action
AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/09/2026
24 May 2025 to 27 Jun 2025Event location unknownGoogle AI Overviews
An author and television producer, the subject of the Apple TV series 'Black Bird', sued Google, alleging that AI Overviews shown for searches about him in May and June 2025 falsely said he was serving a life sentence without parole, in one version for the murders of three women. He says he notified Google three times and received apologies attributing the statements to its AI, yet similar statements kept appearing. On 14 September 2026 the Northern District of Illinois denied Google's motion to dismiss as to two of the four challenged Overviews and dismissed the other two without prejudice. This was a ruling on the pleadings, not a finding that the allegations were proven.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement supported · Causal attribution alleged · 4 sources, 1 underlying account · Added 15/09/2026
15 Apr 2025United StatesChatGPT
The Jacquez lawsuit alleges that ChatGPT reinforced delusions and hallucinations in a user with a previously managed psychiatric condition. The plaintiff links those exchanges to hospitalisation and job loss. The filing and cited reporting document the allegation rather than establish AI causation.
AI relation under review High reported severity Lawsuit Filed
Legacy assessment: credible · Causal attribution alleged · Added 06/08/2026