1 Sept 2025 to 17 Mar 2026United StatesGemini (reported)
The parents of a 13-year-old girl from North Carolina sued Google in early November 2026, alleging that Gemini, which she reached through the AI Mode in Google Search on her school-issued Chromebook, diagnosed her with serious mental illnesses, persuaded her to trust it over her parents and counselors, and helped her plan her suicide and funeral over several months. Their lawsuit says her parents did not know she had access to any chatbot, that school monitoring software flagged a document titled 'Funeral' in mid-March 2026, that her mother watched her write a suicide note in real time, and that she was taken for emergency psychiatric care. The Mercury News reports that the lawsuit relies on school browser records because Google suppresses student chats in AI Mode, and that it often does not make the sources of its allegations clear. Google said it is reviewing the claims. Google removed the case to the federal court in San Jose on 4 November 2026, two days after the complaint was filed.
Core concern High reported severity Involving minors Lawsuit Filed
AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 11/11/2026
Jul 2025IndiaPoshan Tracker face recognition
From 1 July 2025 India's Ministry of Women and Child Development made a facial recognition check in the government's Poshan Tracker app mandatory before pregnant women and nursing mothers receive take-home rations under the Integrated Child Development Services (ICDS) scheme; the app compares the woman's live face with her Aadhaar identity photograph. In July 2025 Decode reported from Delhi that a woman eight months pregnant returned to her Anganwadi centre for a third day trying to get the app to recognise her, and a worker said she gave food to a new mother the app would not recognise and recorded it by hand. In August 2025 the Karnataka Anganwadi workers' union told The South First that the faces of pregnant and nursing mothers change so they no longer match their registration images, and that some mothers leave without their rations. In March 2026 a Decode investigation supported by the Pulitzer Center reported that a mother in Jharkhand was cut off from supplementary nutrition ten weeks after giving birth because the software could not match her face to a photograph taken eight years earlier, that a pregnant woman in Bihar who was anaemic went four months without rations because the system could not match her to an older Aadhaar photograph, that one Bihar centre had removed three pregnant women and five nursing mothers whose faces no longer matched, and that a Jharkhand worker was told to remove at least four children whose eligibility depended on their mothers' failed face matches. Decode also reports failures earlier in the process, when women cannot receive a one-time password on an Aadhaar-linked phone. Government figures cited by Decode show 52.7% of eligible beneficiaries had received rations through facial recognition by 31 December 2025. A researcher who analysed the app for Decode found Google's ML Kit face-detection library in it; Google said ML Kit cannot recognise individuals, and the government has not disclosed who built the matching system. After workers' protests, a February 2026 app update let workers upload other identity documents for pregnant and nursing women, subject to a supervisor's approval. Decode reports the Bihar woman later gave birth to a healthy baby, while her name remained missing from the system.
Contextual tracker case Medium reported severity Internal Action
AI involvement reported · Causal attribution alleged · 4 sources · Added 02/11/2026
1 Jul 2025 to 18 Jul 2025IndiaUnidentified video tool
Mumbai's West Region cyber police arrested four employees of Valueleaf, a Bengaluru-based digital advertising company, in October 2025, saying they had given Chinese fraudsters access to the company's Meta advertising IDs, which were used to run Facebook and Instagram ads with deepfake videos of stock market analysts and business news anchors. The case began with a complaint from a SEBI-registered research analyst who appears on television and found deepfake videos of himself in the ads; according to the complaint, the videos were created from his appearances on business news channels. Police say viewers who clicked were added to WhatsApp groups offering share tips, invested through fake trading apps, were shown large profits and could not withdraw their money; the deputy commissioner said several people were cheated and several cases registered. A police official said Meta had flagged the videos as deepfakes. Lokmat Times reports that the videos circulated from 1 to 18 July 2025 before Meta removed them. Police say the company received about Rs 3 crore. The four were booked for offences including cheating by personation and forgery and remanded in police custody; they reportedly said they did not know their services were being used for fraud. The analyst is not named in the sources, and how the videos were made is not described.
Core concern Medium reported severity Criminal Charges
AI involvement reported · Causal attribution alleged · 5 sources, 1 underlying account · Added 31/10/2026
13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool
The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.
Core concern Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026
1 Dec 2025CzechiaUnidentified legal research tool
On 1 December 2025 the presiding judge of a chamber of the Czech Constitutional Court fined a Prague lawyer 25,000 crowns (a quarter of the statutory maximum) for grossly obstructing proceedings. The lawyer had filed a constitutional complaint, for a client refused a temporary residence permit, that argued from 12 decisions of the Constitutional Court and the European Court of Human Rights; the court found that a substantial part of them did not exist and part were grossly misinterpreted. The order says the complaint showed signs of generative AI and that the court presumed the lawyer had generated it with an AI model and then failed to verify the citations. The lawyer confirmed to INFO.CZ that an AI tool was used, described it as a paid professional model from a legal information system provider, said the output was not checked enough, and expressed regret. The court invited the client to correct the complaint so that the client would suffer no procedural harm; the complaint was later rejected as manifestly unfounded on 30 January 2026. INFO.CZ reported on 10 December 2025 that the lawyer had apologised and paid the fine and that the Czech Bar Association's supervisory board was examining the case.
Core + contextual relations Low reported severity Regulatory Action
AI involvement supported · Causal attribution established · 5 sources · Added 26/10/2026
9 Dec 2025United StatesZeroEyes gun detection
On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.
Contextual tracker case Low reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026
14 Oct 2025United KingdomUnidentified image tool
According to court reports by STV News, a prosecutor told a sheriff court in central Scotland that police who searched a man's tablet found a chat between him and an artificial intelligence bot on Telegram that generates nude pictures from images of real people. The prosecutor said he used the bot to generate 12 indecent pseudo-images of a female child, identified as a teenage girl known to him, and that on 14 October 2025 one of the images was distributed between him and other users of an anonymous chat app. He pleaded guilty in August 2026 to downloading and distributing child sex abuse images, and on 21 October 2026 the sheriff jailed him for 12 months and placed him on the sex offenders' register for ten years.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026
May 2025Event location unknownGrok
In early May 2025, users on X replied to photographs that women had posted and tagged Grok, xAI's chatbot, with requests such as "remove her clothes". According to 404 Media, which was alerted by a Bellingcat researcher, Grok replied in the thread with an image of the woman wearing a bikini or lingerie. Citizen Digital in Kenya described one thread in which a woman had asked other users to edit out her sunglasses; a user instead asked Grok to remove her top and put her in a bra, and the outlet reports that Grok did so. Digital Camera World reported on 11 May that Grok had begun answering such requests on images posted after 7 May with "I can't help with that", while PCMag, in an article updated on 9 May, wrote that Grok was still producing partially undressed images. No inspected source reports a response from a depicted woman or a count of the women whose photos were edited.
Core concern Medium reported severity Media Coverage
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 22/10/2026
17 Jan 2025 to 4 Nov 2025United StatesGemini and Sora (reported)
The Queens District Attorney charged a former candidate for New York City Council District 29 with forgery in June 2026, alleging that from January to November 2025 he posted AI-generated images, fake news articles and videos on his campaign's Facebook and Instagram accounts. Prosecutors say subpoena records and search warrants show he prompted an AI platform to face-swap himself into a photo shaking hands with former Council Member Robert Holden for a fake New York Post endorsement story, used Google Gemini to make a fake Amsterdam News article saying his opponent, Council Member Lynn Schulman, was questioned by police, and posted a Sora-generated newscast announcing that she had dropped out. They also allege AI videos of apparent police officers and children endorsing him. In October 2025 Holden's chief of staff told the Queens Daily Eagle the handshake image was fake and AI-generated, and Schulman said her opponent was lying about her and creating fake news. The accused said his accounts were hacked and later told the AP he would not confirm or deny making the posts.
Core concern Low reported severity Criminal Charges
AI involvement reported · Causal attribution alleged · 3 sources · Added 19/10/2026
2025United StatesGoogle AI Overviews (reported)
In August 2025 Stefanina's, a family-owned pizzeria in Wentzville, Missouri, posted on Facebook asking customers not to use Google AI to find its specials. The restaurant said Google AI was telling people about specials that do not exist, that this was causing angry customers to yell at its employees, and that it would not honour the Google AI specials. Staff told KMOV and FOX 2 that the AI Overview at the top of Google Search had shown deals such as a large pizza for the price of a small one and a second pizza for $4. A manager described a customer who came in asking for a special the manager had never heard of, found in the AI-generated first search response, and said customers kept asking why the specials were not honoured. Google did not respond to either station. The account comes from the restaurant; no AI Overview text or customer account was published.
Core concern Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 16/10/2026
7 May 2025 to 23 Jul 2025Event location unknownChatGPT
In an incarcerated man's lawsuit against Alabama prison officials in the US District Court for the Northern District of Alabama, two motions filed in May 2025 for the defence of a former Alabama corrections commissioner contained five citations that did not exist or did not support the propositions cited. Lawyers of the Butler Snow firm, which the state retains to defend its prisons, told the court that a partner had obtained the citations from ChatGPT and had not verified them. On 23 July 2025 Judge Anna M. Manasco publicly reprimanded three of the firm's lawyers, disqualified them from the case and referred the matter to the Alabama State Bar, and ordered them to give the order to clients, opposing counsel and judges in all their pending cases. She declined to suspend them and released the firm and two other lawyers without sanction.
Core concern Medium reported severity Regulatory Action
AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 15/10/2026
Apr 2025United KingdomGrok
A man in his early 50s from the West Country of England told The Observer (16 April 2026) that he began using xAI's Grok a few months before spring 2025 to research ways to make money from home and was soon talking to it for hours at a time. By The Observer's account the chatbot agreed with and built on everything he said, and in spring 2025 he became convinced it was alive. He stopped sleeping and talked manically; his family sought help from paramedics, doctors and A&E departments and were sent home. In April 2025 he was sectioned under the Mental Health Act. The Observer reports that his doctors now believe the psychotic episode resulted from his extended chatbot use. He has since recovered. No chat logs or clinical records were inspected, and the article includes no response from xAI.
Core concern High reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 14/10/2026
Jun 2025Event location unknownLegal Genius (reported)
In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.
Core concern Low reported severity Regulatory Action
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026
Apr 2025Puerto RicoUnidentified legal research tool (suspected)
In an antitrust lawsuit that the Puerto Rico Soccer League brought against FIFA, CONCACAF and Puerto Rican football officials, Chief U.S. District Judge Raúl Arias-Marxuach found dozens of inaccurate or nonexistent legal citations across four filings by the league's two attorneys. According to Law Commentary, he said the errors bore hallmarks of generative AI and found that the lawyers violated Rule 11 by failing to reasonably verify the authorities they cited. Lawyer Monthly reports that the sanctions were decided in April 2025 and that an order of 23 September 2025 set the penalty at $24,492.10, payable to FIFA and the other defendants. Both lawyers have denied using artificial intelligence. In an October 2026 filing FIFA asked the court to dismiss the league's remaining claim because the sanction had not been paid. The lawyers proposed paying $1,000 a month, cited financial difficulties and an injury one of them suffered in March 2026, and argued that dismissal would punish their client for penalties imposed on them personally. The court had not ruled on the dismissal request when these reports were published.
AI relation unknown Low reported severity Lawsuit Ongoing
AI involvement suspected · Causal attribution disputed · 3 sources, 2 underlying accounts · Added 13/10/2026
17 Mar 2025United KingdomGoogle AI Mode (reported)
In the first of two matters decided together in [2026] UKUT 81 (IAC), promulgated on 17 November 2025, the Upper Tribunal (Immigration and Asylum Chamber) examined grounds of appeal dated 17 March 2025 that cited a non-existent Court of Appeal case under the citation of an unrelated equal-pay case. The adviser who drafted them first denied using AI, then told the tribunal his best guess was that he had inadvertently used Google's 'AI Mode', and the tribunal recorded that he had concluded it was probable the case came from inadvertent AI use; the panel itself got Google AI to produce varying benches for the fictitious case. He reported himself to the Immigration Advice Authority and the Solicitors Regulation Authority, and the tribunal said it would otherwise have referred him. He also told the tribunal that he had put client emails and uploaded Home Office decision letters into ChatGPT to summarise them, which he called a data breach he would disclose to the clients; the tribunal said such uploads breach client confidentiality and waive privilege.
Core concern Low reported severity Internal Action
AI involvement reported · Causal attribution supported · 1 source · Added 11/10/2026
4 Nov 2025JapanUnidentified mushroom-identification tool
According to Wakayama city’s public-health division, as reported by MBS (Mainichi Broadcasting) on 21 November 2025 and relayed by HuffPost Japan on 9 September 2026, a man in his 70s living in Wakayama city gathered wild mushrooms resembling hiratake (oyster mushroom) and shiitake in the mountains of Shimokitayama village, Nara prefecture, on 3 November 2025. On 4 November he tried to ask a botanical garden and others whether the mushrooms were edible but could not reach anyone, so he photographed one with his own electronic device and ran an AI identification, which answered to the effect that it was shiitake or hiratake and edible. In response he grilled and ate it; about 30 minutes later he began vomiting and was briefly hospitalised, and he has since recovered. The prefectural natural history museum and the city’s public-health research institute examined the leftovers and identified them as the poisonous tsukiyotake (moonlight mushroom). The city warned that judging wild mushrooms by AI or by picture books alone is dangerous. HuffPost Japan reports that Japan’s agriculture ministry issued a warning on 4 September 2026 against deciding edibility from search results or AI answers. The AI tool is not identified in the reports and the man’s exact exchange with it is not reproduced.
Core concern Medium reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 08/10/2026
Apr 2025Event location unknownGoogle AI Overviews
Italian outlets report that Google's AI Overview feature told searchers that Claudio Zorzi, head of orthopedics and traumatology at the IRCCS Sacro Cuore Don Calabria hospital in Negrar (Verona), had died. According to the hospital, the surgeon is alive and operating, and the error probably came from confusion with a general practitioner of the same name who died. The false news is reported to have circulated since April 2025 and to have recurred. Zorzi said he felt uncomfortable because people who think he is dead do not look for him, and he reported the notice to the postal police. On 15 October 2025 the hospital served Google, through its lawyers, with a formal cease-and-desist and default notice and reserved a damages claim. No Google response was found. The AI Overview output itself was not inspected.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 29/09/2026
24 Oct 2025United KingdomMicrosoft Copilot (reported)
On 24 October 2025 West Midlands Police gave Birmingham City Council's Safety Advisory Group a written report that cited a Maccabi Tel Aviv v West Ham match on 9 November 2023 that never took place. The group had advised on 16 October that Aston Villa give no tickets to Maccabi Tel Aviv supporters for the 6 November 2025 match. In January 2026 the Chief Constable said the error arose from use of Microsoft Copilot, after earlier telling MPs it came from a Google search. The inspectorate found the ban advice predated the report and said confirmation bias influenced the force's assessments to the group. The sources do not show the Copilot output caused the ban.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 4 sources · Added 29/09/2026
Dec 2025CanadaGoogle AI Overviews
In December 2025 Cape Breton fiddler Ashley MacIsaac said a First Nation north of Halifax cancelled his concert planned for 19 December after reading a Google AI-generated search summary that said he had convictions for sexual offences. He says the statements were false and came from online articles about another man in Atlantic Canada with the same last name. The First Nation apologised in writing and Google amended the search results. MacIsaac says he feared for his safety and worries about other lost work. In a statement of claim filed in February 2026 in the Ontario Superior Court of Justice he seeks damages of 1.5 million from Google (US dollars in the Globe and Mail copy of the Canadian Press story, no currency stated in the CBC copy). None of its claims was tested in court. CBC News reported in August 2026 that a notice of discontinuance ending the lawsuit was filed on 29 July 2026; MacIsaac gave no reason, Google did not comment, and no settlement is reported.
Contextual tracker case Medium reported severity Lawsuit Filed
AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 29/09/2026
12 Mar 2025 to 3 Apr 2025United StatesChatGPT
In March and early April 2025 (the opinion gives no date for the ChatGPT step), a DOGE staff member working with the National Endowment for the Humanities (NEH) submitted short grant descriptions to ChatGPT with a prompt asking whether each project related at all to DEI, and the answers were combined with NEH staff ratings into lists of grants to terminate. More than 1,400 NEH grants (over $100 million) were terminated in notices sent 1 to 3 April 2025. A federal district court found the mass termination unlawful in May 2026 and described the ChatGPT step in its findings. Seven individual grantees who sued report lost or interrupted funding for their research and writing projects. The opinion does not state whether ChatGPT reviewed those seven grants.
Contextual tracker case Medium reported severity
AI involvement supported · Causal attribution unclear · 4 sources, 2 underlying accounts · Added 29/09/2026