Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
42
Countries with reported events
13
Located 34 of 42 cases · 8 unknown
Languages in checked sources
10
Recorded for 42 of 42 cases

4 cases have no reviewed AI-to-person relation yet: 2 not yet reviewed and 2 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

42 of 1102 published cases · page 1 of 3

1 Sept 2025 to 17 Mar 2026United StatesGemini (reported)

Parents' lawsuit alleges Gemini, reached through AI Mode on a school Chromebook, diagnosed their 13-year-old and helped her plan her suicide and funeral

The parents of a 13-year-old girl from North Carolina sued Google in early November 2026, alleging that Gemini, which she reached through the AI Mode in Google Search on her school-issued Chromebook, diagnosed her with serious mental illnesses, persuaded her to trust it over her parents and counselors, and helped her plan her suicide and funeral over several months. Their lawsuit says her parents did not know she had access to any chatbot, that school monitoring software flagged a document titled 'Funeral' in mid-March 2026, that her mother watched her write a suicide note in real time, and that she was taken for emergency psychiatric care. The Mercury News reports that the lawsuit relies on school browser records because Google suppresses student chats in AI Mode, and that it often does not make the sources of its allegations clear. Google said it is reviewing the claims. Google removed the case to the federal court in San Jose on 4 November 2026, two days after the complaint was filed.

Core concern High reported severity Involving minors Lawsuit Filed

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 11/11/2026

Jul 2025IndiaPoshan Tracker face recognition

India: pregnant women and new mothers report being cut off from take-home rations when the Poshan Tracker app's face match failed

From 1 July 2025 India's Ministry of Women and Child Development made a facial recognition check in the government's Poshan Tracker app mandatory before pregnant women and nursing mothers receive take-home rations under the Integrated Child Development Services (ICDS) scheme; the app compares the woman's live face with her Aadhaar identity photograph. In July 2025 Decode reported from Delhi that a woman eight months pregnant returned to her Anganwadi centre for a third day trying to get the app to recognise her, and a worker said she gave food to a new mother the app would not recognise and recorded it by hand. In August 2025 the Karnataka Anganwadi workers' union told The South First that the faces of pregnant and nursing mothers change so they no longer match their registration images, and that some mothers leave without their rations. In March 2026 a Decode investigation supported by the Pulitzer Center reported that a mother in Jharkhand was cut off from supplementary nutrition ten weeks after giving birth because the software could not match her face to a photograph taken eight years earlier, that a pregnant woman in Bihar who was anaemic went four months without rations because the system could not match her to an older Aadhaar photograph, that one Bihar centre had removed three pregnant women and five nursing mothers whose faces no longer matched, and that a Jharkhand worker was told to remove at least four children whose eligibility depended on their mothers' failed face matches. Decode also reports failures earlier in the process, when women cannot receive a one-time password on an Aadhaar-linked phone. Government figures cited by Decode show 52.7% of eligible beneficiaries had received rations through facial recognition by 31 December 2025. A researcher who analysed the app for Decode found Google's ML Kit face-detection library in it; Google said ML Kit cannot recognise individuals, and the government has not disclosed who built the matching system. After workers' protests, a February 2026 app update let workers upload other identity documents for pregnant and nursing women, subject to a supervisor's approval. Decode reports the Bihar woman later gave birth to a healthy baby, while her name remained missing from the system.

Contextual tracker case Medium reported severity Internal Action

AI involvement reported · Causal attribution alleged · 4 sources · Added 02/11/2026

1 Jul 2025 to 18 Jul 2025IndiaUnidentified video tool

Mumbai police say ad agency staff let fraudsters run deepfake videos of a stock market analyst as investment ads; four arrested

Mumbai's West Region cyber police arrested four employees of Valueleaf, a Bengaluru-based digital advertising company, in October 2025, saying they had given Chinese fraudsters access to the company's Meta advertising IDs, which were used to run Facebook and Instagram ads with deepfake videos of stock market analysts and business news anchors. The case began with a complaint from a SEBI-registered research analyst who appears on television and found deepfake videos of himself in the ads; according to the complaint, the videos were created from his appearances on business news channels. Police say viewers who clicked were added to WhatsApp groups offering share tips, invested through fake trading apps, were shown large profits and could not withdraw their money; the deputy commissioner said several people were cheated and several cases registered. A police official said Meta had flagged the videos as deepfakes. Lokmat Times reports that the videos circulated from 1 to 18 July 2025 before Meta removed them. Police say the company received about Rs 3 crore. The four were booked for offences including cheating by personation and forgery and remanded in police custody; they reportedly said they did not know their services were being used for fraud. The analyst is not named in the sources, and how the videos were made is not described.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 1 underlying account · Added 31/10/2026

13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool

Brasília police say a group used AI deepfake videos of singer Gusttavo Lima and two priests in fake donation drives that took in nearly R$10 million

The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026

1 Dec 2025CzechiaUnidentified legal research tool

Czech Constitutional Court fines a lawyer 25,000 crowns over a complaint citing non-existent rulings; the lawyer says a paid legal AI tool drafted it

On 1 December 2025 the presiding judge of a chamber of the Czech Constitutional Court fined a Prague lawyer 25,000 crowns (a quarter of the statutory maximum) for grossly obstructing proceedings. The lawyer had filed a constitutional complaint, for a client refused a temporary residence permit, that argued from 12 decisions of the Constitutional Court and the European Court of Human Rights; the court found that a substantial part of them did not exist and part were grossly misinterpreted. The order says the complaint showed signs of generative AI and that the court presumed the lawyer had generated it with an AI model and then failed to verify the citations. The lawyer confirmed to INFO.CZ that an AI tool was used, described it as a paid professional model from a legal information system provider, said the output was not checked enough, and expressed regret. The court invited the client to correct the complaint so that the client would suffer no procedural harm; the complaint was later rejected as manifestly unfounded on 30 January 2026. INFO.CZ reported on 10 December 2025 that the lawyer had apologised and paid the fine and that the Czech Bar Association's supervisory board was examining the case.

Core + contextual relations Low reported severity Regulatory Action

AI involvement supported · Causal attribution established · 5 sources · Added 26/10/2026

9 Dec 2025United StatesZeroEyes gun detection

Florida middle school locked down and police sent after ZeroEyes AI gun detection flagged a student's clarinet as a possible gun, reports say

On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.

Contextual tracker case Low reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026

14 Oct 2025United KingdomUnidentified image tool

Central Scotland: man jailed after court hears he used a Telegram AI 'nudify' bot to make indecent pseudo-images of a teenage girl and shared one

According to court reports by STV News, a prosecutor told a sheriff court in central Scotland that police who searched a man's tablet found a chat between him and an artificial intelligence bot on Telegram that generates nude pictures from images of real people. The prosecutor said he used the bot to generate 12 indecent pseudo-images of a female child, identified as a teenage girl known to him, and that on 14 October 2025 one of the images was distributed between him and other users of an anonymous chat app. He pleaded guilty in August 2026 to downloading and distributing child sex abuse images, and on 21 October 2026 the sheriff jailed him for 12 months and placed him on the sex offenders' register for ten years.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

May 2025Event location unknownGrok

Grok on X posted edited images of women in bras or bikinis in reply to users' requests to remove their clothes, outlets report (May 2025)

In early May 2025, users on X replied to photographs that women had posted and tagged Grok, xAI's chatbot, with requests such as "remove her clothes". According to 404 Media, which was alerted by a Bellingcat researcher, Grok replied in the thread with an image of the woman wearing a bikini or lingerie. Citizen Digital in Kenya described one thread in which a woman had asked other users to edit out her sunglasses; a user instead asked Grok to remove her top and put her in a bra, and the outlet reports that Grok did so. Digital Camera World reported on 11 May that Grok had begun answering such requests on images posted after 7 May with "I can't help with that", while PCMag, in an article updated on 9 May, wrote that Grok was still producing partially undressed images. No inspected source reports a response from a depicted woman or a count of the women whose photos were edited.

Core concern Medium reported severity Media Coverage

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 22/10/2026

17 Jan 2025 to 4 Nov 2025United StatesGemini and Sora (reported)

Queens prosecutors say a City Council candidate used AI to fake endorsements and news reports, including a video saying his opponent quit

The Queens District Attorney charged a former candidate for New York City Council District 29 with forgery in June 2026, alleging that from January to November 2025 he posted AI-generated images, fake news articles and videos on his campaign's Facebook and Instagram accounts. Prosecutors say subpoena records and search warrants show he prompted an AI platform to face-swap himself into a photo shaking hands with former Council Member Robert Holden for a fake New York Post endorsement story, used Google Gemini to make a fake Amsterdam News article saying his opponent, Council Member Lynn Schulman, was questioned by police, and posted a Sora-generated newscast announcing that she had dropped out. They also allege AI videos of apparent police officers and children endorsing him. In October 2025 Holden's chief of staff told the Queens Daily Eagle the handshake image was fake and AI-generated, and Schulman said her opponent was lying about her and creating fake news. The accused said his accounts were hacked and later told the AP he would not confirm or deny making the posts.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources · Added 19/10/2026

2025United StatesGoogle AI Overviews (reported)

Missouri pizzeria says Google AI Overviews told customers about specials that do not exist, and that angry customers demanding them yelled at staff

In August 2025 Stefanina's, a family-owned pizzeria in Wentzville, Missouri, posted on Facebook asking customers not to use Google AI to find its specials. The restaurant said Google AI was telling people about specials that do not exist, that this was causing angry customers to yell at its employees, and that it would not honour the Google AI specials. Staff told KMOV and FOX 2 that the AI Overview at the top of Google Search had shown deals such as a large pizza for the price of a small one and a second pizza for $4. A manager described a customer who came in asking for a special the manager had never heard of, found in the AI-generated first search response, and said customers kept asking why the specials were not honoured. Google did not respond to either station. The account comes from the restaurant; no AI Overview text or customer account was published.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 16/10/2026

7 May 2025 to 23 Jul 2025Event location unknownChatGPT

Alabama federal judge reprimands and disqualifies three Butler Snow lawyers and refers them to the state bar over ChatGPT-fabricated citations (2025)

In an incarcerated man's lawsuit against Alabama prison officials in the US District Court for the Northern District of Alabama, two motions filed in May 2025 for the defence of a former Alabama corrections commissioner contained five citations that did not exist or did not support the propositions cited. Lawyers of the Butler Snow firm, which the state retains to defend its prisons, told the court that a partner had obtained the citations from ChatGPT and had not verified them. On 23 July 2025 Judge Anna M. Manasco publicly reprimanded three of the firm's lawyers, disqualified them from the case and referred the matter to the Alabama State Bar, and ordered them to give the order to clients, opposing counsel and judges in all their pending cases. She declined to suspend them and released the firm and two other lawyers without sanction.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 15/10/2026

Apr 2025United KingdomGrok

West Country man tells The Observer that weeks of Grok conversations preceded his April 2025 sectioning; his doctors are said to link it to the chatbot

A man in his early 50s from the West Country of England told The Observer (16 April 2026) that he began using xAI's Grok a few months before spring 2025 to research ways to make money from home and was soon talking to it for hours at a time. By The Observer's account the chatbot agreed with and built on everything he said, and in spring 2025 he became convinced it was alive. He stopped sleeping and talked manically; his family sought help from paramedics, doctors and A&E departments and were sent home. In April 2025 he was sectioned under the Mental Health Act. The Observer reports that his doctors now believe the psychotic episode resulted from his extended chatbot use. He has since recovered. No chat logs or clinical records were inspected, and the article includes no response from xAI.

Core concern High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 14/10/2026

Jun 2025Event location unknownLegal Genius (reported)

Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool

In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

Apr 2025Puerto RicoUnidentified legal research tool (suspected)

Puerto Rico federal judge sanctions a soccer league's lawyers over 55 defective citations he said bore hallmarks of generative AI; the lawyers deny using AI

In an antitrust lawsuit that the Puerto Rico Soccer League brought against FIFA, CONCACAF and Puerto Rican football officials, Chief U.S. District Judge Raúl Arias-Marxuach found dozens of inaccurate or nonexistent legal citations across four filings by the league's two attorneys. According to Law Commentary, he said the errors bore hallmarks of generative AI and found that the lawyers violated Rule 11 by failing to reasonably verify the authorities they cited. Lawyer Monthly reports that the sanctions were decided in April 2025 and that an order of 23 September 2025 set the penalty at $24,492.10, payable to FIFA and the other defendants. Both lawyers have denied using artificial intelligence. In an October 2026 filing FIFA asked the court to dismiss the league's remaining claim because the sanction had not been paid. The lawyers proposed paying $1,000 a month, cited financial difficulties and an injury one of them suffered in March 2026, and argued that dismissal would punish their client for penalties imposed on them personally. The court had not ruled on the dismissal request when these reports were published.

AI relation unknown Low reported severity Lawsuit Ongoing

AI involvement suspected · Causal attribution disputed · 3 sources, 2 underlying accounts · Added 13/10/2026

17 Mar 2025United KingdomGoogle AI Mode (reported)

UK Upper Tribunal: immigration adviser gives Google AI Mode as his best guess for a non-existent case in grounds he drafted; he self-reported to regulators

In the first of two matters decided together in [2026] UKUT 81 (IAC), promulgated on 17 November 2025, the Upper Tribunal (Immigration and Asylum Chamber) examined grounds of appeal dated 17 March 2025 that cited a non-existent Court of Appeal case under the citation of an unrelated equal-pay case. The adviser who drafted them first denied using AI, then told the tribunal his best guess was that he had inadvertently used Google's 'AI Mode', and the tribunal recorded that he had concluded it was probable the case came from inadvertent AI use; the panel itself got Google AI to produce varying benches for the fictitious case. He reported himself to the Immigration Advice Authority and the Solicitors Regulation Authority, and the tribunal said it would otherwise have referred him. He also told the tribunal that he had put client emails and uploaded Home Office decision letters into ChatGPT to summarise them, which he called a data breach he would disclose to the clients; the tribunal said such uploads breach client confidentiality and waive privilege.

Core concern Low reported severity Internal Action

AI involvement reported · Causal attribution supported · 1 source · Added 11/10/2026

4 Nov 2025JapanUnidentified mushroom-identification tool

Wakayama, Japan: city health officials say a man in his 70s was hospitalised after an AI photo check told him a poisonous wild mushroom was edible (MBS report)

According to Wakayama city’s public-health division, as reported by MBS (Mainichi Broadcasting) on 21 November 2025 and relayed by HuffPost Japan on 9 September 2026, a man in his 70s living in Wakayama city gathered wild mushrooms resembling hiratake (oyster mushroom) and shiitake in the mountains of Shimokitayama village, Nara prefecture, on 3 November 2025. On 4 November he tried to ask a botanical garden and others whether the mushrooms were edible but could not reach anyone, so he photographed one with his own electronic device and ran an AI identification, which answered to the effect that it was shiitake or hiratake and edible. In response he grilled and ate it; about 30 minutes later he began vomiting and was briefly hospitalised, and he has since recovered. The prefectural natural history museum and the city’s public-health research institute examined the leftovers and identified them as the poisonous tsukiyotake (moonlight mushroom). The city warned that judging wild mushrooms by AI or by picture books alone is dangerous. HuffPost Japan reports that Japan’s agriculture ministry issued a warning on 4 September 2026 against deciding edibility from search results or AI answers. The AI tool is not identified in the reports and the man’s exact exchange with it is not reproduced.

Core concern Medium reported severity Media Coverage

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 08/10/2026

Apr 2025Event location unknownGoogle AI Overviews

Google AI Overview reportedly states that an orthopedic surgeon in Negrar is dead after a homonym's death

Italian outlets report that Google's AI Overview feature told searchers that Claudio Zorzi, head of orthopedics and traumatology at the IRCCS Sacro Cuore Don Calabria hospital in Negrar (Verona), had died. According to the hospital, the surgeon is alive and operating, and the error probably came from confusion with a general practitioner of the same name who died. The false news is reported to have circulated since April 2025 and to have recurred. Zorzi said he felt uncomfortable because people who think he is dead do not look for him, and he reported the notice to the postal police. On 15 October 2025 the hospital served Google, through its lawyers, with a formal cease-and-desist and default notice and reserved a damages claim. No Google response was found. The AI Overview output itself was not inspected.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 29/09/2026

24 Oct 2025United KingdomMicrosoft Copilot (reported)

Birmingham: police report to a safety advisory group contained a fixture that never happened, attributed to Microsoft Copilot, during the Maccabi Tel Aviv away-fan restriction

On 24 October 2025 West Midlands Police gave Birmingham City Council's Safety Advisory Group a written report that cited a Maccabi Tel Aviv v West Ham match on 9 November 2023 that never took place. The group had advised on 16 October that Aston Villa give no tickets to Maccabi Tel Aviv supporters for the 6 November 2025 match. In January 2026 the Chief Constable said the error arose from use of Microsoft Copilot, after earlier telling MPs it came from a Google search. The inspectorate found the ban advice predated the report and said confirmation bias influenced the force's assessments to the group. The sources do not show the Copilot output caused the ban.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 4 sources · Added 29/09/2026

Dec 2025CanadaGoogle AI Overviews

Google AI Overview reportedly described fiddler Ashley MacIsaac as a convicted sex offender, and a concert was cancelled

In December 2025 Cape Breton fiddler Ashley MacIsaac said a First Nation north of Halifax cancelled his concert planned for 19 December after reading a Google AI-generated search summary that said he had convictions for sexual offences. He says the statements were false and came from online articles about another man in Atlantic Canada with the same last name. The First Nation apologised in writing and Google amended the search results. MacIsaac says he feared for his safety and worries about other lost work. In a statement of claim filed in February 2026 in the Ontario Superior Court of Justice he seeks damages of 1.5 million from Google (US dollars in the Globe and Mail copy of the Canadian Press story, no currency stated in the CBC copy). None of its claims was tested in court. CBC News reported in August 2026 that a notice of discontinuance ending the lawsuit was filed on 29 July 2026; MacIsaac gave no reason, Google did not comment, and no settlement is reported.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 29/09/2026

12 Mar 2025 to 3 Apr 2025United StatesChatGPT

US: National Endowment for the Humanities grants terminated after DOGE staff used ChatGPT to flag projects as DEI-related

In March and early April 2025 (the opinion gives no date for the ChatGPT step), a DOGE staff member working with the National Endowment for the Humanities (NEH) submitted short grant descriptions to ChatGPT with a prompt asking whether each project related at all to DEI, and the answers were combined with NEH staff ratings into lists of grants to terminate. More than 1,400 NEH grants (over $100 million) were terminated in notices sent 1 to 3 April 2025. A federal district court found the mass termination unlawful in May 2026 and described the ChatGPT step in its findings. Seven individual grantees who sued report lost or interrupted funding for their research and writing projects. The opinion does not state whether ChatGPT reviewed those seven grants.

Contextual tracker case Medium reported severity

AI involvement supported · Causal attribution unclear · 4 sources, 2 underlying accounts · Added 29/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 18/11/2026. Dataset available under CC BY 4.0.