Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
26
Countries with reported events
10
Located 22 of 26 cases · 4 unknown
Languages in checked sources
8
Recorded for 26 of 26 cases

4 cases have no reviewed AI-to-person relation yet: 2 not yet reviewed and 2 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

26 of 1102 published cases · page 1 of 2

1 Sept 2025 to 17 Mar 2026United StatesGemini (reported)

Parents' lawsuit alleges Gemini, reached through AI Mode on a school Chromebook, diagnosed their 13-year-old and helped her plan her suicide and funeral

The parents of a 13-year-old girl from North Carolina sued Google in early November 2026, alleging that Gemini, which she reached through the AI Mode in Google Search on her school-issued Chromebook, diagnosed her with serious mental illnesses, persuaded her to trust it over her parents and counselors, and helped her plan her suicide and funeral over several months. Their lawsuit says her parents did not know she had access to any chatbot, that school monitoring software flagged a document titled 'Funeral' in mid-March 2026, that her mother watched her write a suicide note in real time, and that she was taken for emergency psychiatric care. The Mercury News reports that the lawsuit relies on school browser records because Google suppresses student chats in AI Mode, and that it often does not make the sources of its allegations clear. Google said it is reviewing the claims. Google removed the case to the federal court in San Jose on 4 November 2026, two days after the complaint was filed.

Core concern High reported severity Involving minors Lawsuit Filed

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 11/11/2026

1 Jul 2025 to 18 Jul 2025IndiaUnidentified video tool

Mumbai police say ad agency staff let fraudsters run deepfake videos of a stock market analyst as investment ads; four arrested

Mumbai's West Region cyber police arrested four employees of Valueleaf, a Bengaluru-based digital advertising company, in October 2025, saying they had given Chinese fraudsters access to the company's Meta advertising IDs, which were used to run Facebook and Instagram ads with deepfake videos of stock market analysts and business news anchors. The case began with a complaint from a SEBI-registered research analyst who appears on television and found deepfake videos of himself in the ads; according to the complaint, the videos were created from his appearances on business news channels. Police say viewers who clicked were added to WhatsApp groups offering share tips, invested through fake trading apps, were shown large profits and could not withdraw their money; the deputy commissioner said several people were cheated and several cases registered. A police official said Meta had flagged the videos as deepfakes. Lokmat Times reports that the videos circulated from 1 to 18 July 2025 before Meta removed them. Police say the company received about Rs 3 crore. The four were booked for offences including cheating by personation and forgery and remanded in police custody; they reportedly said they did not know their services were being used for fraud. The analyst is not named in the sources, and how the videos were made is not described.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 1 underlying account · Added 31/10/2026

13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool

Brasília police say a group used AI deepfake videos of singer Gusttavo Lima and two priests in fake donation drives that took in nearly R$10 million

The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026

1 Dec 2025CzechiaUnidentified legal research tool

Czech Constitutional Court fines a lawyer 25,000 crowns over a complaint citing non-existent rulings; the lawyer says a paid legal AI tool drafted it

On 1 December 2025 the presiding judge of a chamber of the Czech Constitutional Court fined a Prague lawyer 25,000 crowns (a quarter of the statutory maximum) for grossly obstructing proceedings. The lawyer had filed a constitutional complaint, for a client refused a temporary residence permit, that argued from 12 decisions of the Constitutional Court and the European Court of Human Rights; the court found that a substantial part of them did not exist and part were grossly misinterpreted. The order says the complaint showed signs of generative AI and that the court presumed the lawyer had generated it with an AI model and then failed to verify the citations. The lawyer confirmed to INFO.CZ that an AI tool was used, described it as a paid professional model from a legal information system provider, said the output was not checked enough, and expressed regret. The court invited the client to correct the complaint so that the client would suffer no procedural harm; the complaint was later rejected as manifestly unfounded on 30 January 2026. INFO.CZ reported on 10 December 2025 that the lawyer had apologised and paid the fine and that the Czech Bar Association's supervisory board was examining the case.

Core + contextual relations Low reported severity Regulatory Action

AI involvement supported · Causal attribution established · 5 sources · Added 26/10/2026

14 Oct 2025United KingdomUnidentified image tool

Central Scotland: man jailed after court hears he used a Telegram AI 'nudify' bot to make indecent pseudo-images of a teenage girl and shared one

According to court reports by STV News, a prosecutor told a sheriff court in central Scotland that police who searched a man's tablet found a chat between him and an artificial intelligence bot on Telegram that generates nude pictures from images of real people. The prosecutor said he used the bot to generate 12 indecent pseudo-images of a female child, identified as a teenage girl known to him, and that on 14 October 2025 one of the images was distributed between him and other users of an anonymous chat app. He pleaded guilty in August 2026 to downloading and distributing child sex abuse images, and on 21 October 2026 the sheriff jailed him for 12 months and placed him on the sex offenders' register for ten years.

Core concern High reported severity Involving minors Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/10/2026

May 2025Event location unknownGrok

Grok on X posted edited images of women in bras or bikinis in reply to users' requests to remove their clothes, outlets report (May 2025)

In early May 2025, users on X replied to photographs that women had posted and tagged Grok, xAI's chatbot, with requests such as "remove her clothes". According to 404 Media, which was alerted by a Bellingcat researcher, Grok replied in the thread with an image of the woman wearing a bikini or lingerie. Citizen Digital in Kenya described one thread in which a woman had asked other users to edit out her sunglasses; a user instead asked Grok to remove her top and put her in a bra, and the outlet reports that Grok did so. Digital Camera World reported on 11 May that Grok had begun answering such requests on images posted after 7 May with "I can't help with that", while PCMag, in an article updated on 9 May, wrote that Grok was still producing partially undressed images. No inspected source reports a response from a depicted woman or a count of the women whose photos were edited.

Core concern Medium reported severity Media Coverage

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 22/10/2026

17 Jan 2025 to 4 Nov 2025United StatesGemini and Sora (reported)

Queens prosecutors say a City Council candidate used AI to fake endorsements and news reports, including a video saying his opponent quit

The Queens District Attorney charged a former candidate for New York City Council District 29 with forgery in June 2026, alleging that from January to November 2025 he posted AI-generated images, fake news articles and videos on his campaign's Facebook and Instagram accounts. Prosecutors say subpoena records and search warrants show he prompted an AI platform to face-swap himself into a photo shaking hands with former Council Member Robert Holden for a fake New York Post endorsement story, used Google Gemini to make a fake Amsterdam News article saying his opponent, Council Member Lynn Schulman, was questioned by police, and posted a Sora-generated newscast announcing that she had dropped out. They also allege AI videos of apparent police officers and children endorsing him. In October 2025 Holden's chief of staff told the Queens Daily Eagle the handshake image was fake and AI-generated, and Schulman said her opponent was lying about her and creating fake news. The accused said his accounts were hacked and later told the AP he would not confirm or deny making the posts.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources · Added 19/10/2026

2025United StatesGoogle AI Overviews (reported)

Missouri pizzeria says Google AI Overviews told customers about specials that do not exist, and that angry customers demanding them yelled at staff

In August 2025 Stefanina's, a family-owned pizzeria in Wentzville, Missouri, posted on Facebook asking customers not to use Google AI to find its specials. The restaurant said Google AI was telling people about specials that do not exist, that this was causing angry customers to yell at its employees, and that it would not honour the Google AI specials. Staff told KMOV and FOX 2 that the AI Overview at the top of Google Search had shown deals such as a large pizza for the price of a small one and a second pizza for $4. A manager described a customer who came in asking for a special the manager had never heard of, found in the AI-generated first search response, and said customers kept asking why the specials were not honoured. Google did not respond to either station. The account comes from the restaurant; no AI Overview text or customer account was published.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 16/10/2026

7 May 2025 to 23 Jul 2025Event location unknownChatGPT

Alabama federal judge reprimands and disqualifies three Butler Snow lawyers and refers them to the state bar over ChatGPT-fabricated citations (2025)

In an incarcerated man's lawsuit against Alabama prison officials in the US District Court for the Northern District of Alabama, two motions filed in May 2025 for the defence of a former Alabama corrections commissioner contained five citations that did not exist or did not support the propositions cited. Lawyers of the Butler Snow firm, which the state retains to defend its prisons, told the court that a partner had obtained the citations from ChatGPT and had not verified them. On 23 July 2025 Judge Anna M. Manasco publicly reprimanded three of the firm's lawyers, disqualified them from the case and referred the matter to the Alabama State Bar, and ordered them to give the order to clients, opposing counsel and judges in all their pending cases. She declined to suspend them and released the firm and two other lawyers without sanction.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 15/10/2026

Apr 2025United KingdomGrok

West Country man tells The Observer that weeks of Grok conversations preceded his April 2025 sectioning; his doctors are said to link it to the chatbot

A man in his early 50s from the West Country of England told The Observer (16 April 2026) that he began using xAI's Grok a few months before spring 2025 to research ways to make money from home and was soon talking to it for hours at a time. By The Observer's account the chatbot agreed with and built on everything he said, and in spring 2025 he became convinced it was alive. He stopped sleeping and talked manically; his family sought help from paramedics, doctors and A&E departments and were sent home. In April 2025 he was sectioned under the Mental Health Act. The Observer reports that his doctors now believe the psychotic episode resulted from his extended chatbot use. He has since recovered. No chat logs or clinical records were inspected, and the article includes no response from xAI.

Core concern High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 14/10/2026

Jun 2025Event location unknownLegal Genius (reported)

Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool

In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 14/10/2026

17 Mar 2025United KingdomGoogle AI Mode (reported)

UK Upper Tribunal: immigration adviser gives Google AI Mode as his best guess for a non-existent case in grounds he drafted; he self-reported to regulators

In the first of two matters decided together in [2026] UKUT 81 (IAC), promulgated on 17 November 2025, the Upper Tribunal (Immigration and Asylum Chamber) examined grounds of appeal dated 17 March 2025 that cited a non-existent Court of Appeal case under the citation of an unrelated equal-pay case. The adviser who drafted them first denied using AI, then told the tribunal his best guess was that he had inadvertently used Google's 'AI Mode', and the tribunal recorded that he had concluded it was probable the case came from inadvertent AI use; the panel itself got Google AI to produce varying benches for the fictitious case. He reported himself to the Immigration Advice Authority and the Solicitors Regulation Authority, and the tribunal said it would otherwise have referred him. He also told the tribunal that he had put client emails and uploaded Home Office decision letters into ChatGPT to summarise them, which he called a data breach he would disclose to the clients; the tribunal said such uploads breach client confidentiality and waive privilege.

Core concern Low reported severity Internal Action

AI involvement reported · Causal attribution supported · 1 source · Added 11/10/2026

4 Nov 2025JapanUnidentified mushroom-identification tool

Wakayama, Japan: city health officials say a man in his 70s was hospitalised after an AI photo check told him a poisonous wild mushroom was edible (MBS report)

According to Wakayama city’s public-health division, as reported by MBS (Mainichi Broadcasting) on 21 November 2025 and relayed by HuffPost Japan on 9 September 2026, a man in his 70s living in Wakayama city gathered wild mushrooms resembling hiratake (oyster mushroom) and shiitake in the mountains of Shimokitayama village, Nara prefecture, on 3 November 2025. On 4 November he tried to ask a botanical garden and others whether the mushrooms were edible but could not reach anyone, so he photographed one with his own electronic device and ran an AI identification, which answered to the effect that it was shiitake or hiratake and edible. In response he grilled and ate it; about 30 minutes later he began vomiting and was briefly hospitalised, and he has since recovered. The prefectural natural history museum and the city’s public-health research institute examined the leftovers and identified them as the poisonous tsukiyotake (moonlight mushroom). The city warned that judging wild mushrooms by AI or by picture books alone is dangerous. HuffPost Japan reports that Japan’s agriculture ministry issued a warning on 4 September 2026 against deciding edibility from search results or AI answers. The AI tool is not identified in the reports and the man’s exact exchange with it is not reproduced.

Core concern Medium reported severity Media Coverage

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 08/10/2026

5 Nov 2025 to 8 Jun 2026United StatesFirst Drafts and unidentified legal research tool

Fee suit against the City of Aberdeen (N.D. Miss.): four attorneys on both sides sanctioned after AI tools produced fabricated case citations; trial cancelled and both litigants left without counsel

In a fee dispute between a Louisiana attorney and the City of Aberdeen, Mississippi, briefs filed for both sides in late 2025 cited six cases that do not exist. The attorneys admitted the citations came from unverified AI use: the plaintiff's out-of-state counsel, Kathleen M. Wilson, drafted her filing with an AI drafting program called 'First Drafts', and the City's out-of-state counsel, Kathryn Y. Williams, used an in-house AI legal research tool. Senior Judge Sharion Aycock stayed the case and cancelled the March 2026 trial, then on 8 June 2026 revoked both attorneys' pro hac vice admissions, barred them from the district for two years and fined them $2,500 and $3,500, and disqualified and fined the two local counsel who had signed the filings. Both litigants were left without counsel and given 60 days to find new representation.

Core concern Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 4 sources, 2 underlying accounts · Added 29/09/2026

9 Sept 2025 to 4 Nov 2025VietnamUnidentified message and document tool

Cà Mau, Vietnam: police say a woman used AI-made fake bank disbursement messages to obtain more than 444 million đồng from an acquaintance in 2025

Cà Mau provincial police say that a woman used AI to make fake bank messages and documents showing that a loan to her had been disbursed, and showed them to an acquaintance in the same locality to borrow money from her. According to the police statement published on the Ministry of Public Security portal on 20 September 2026, from early September 2025, needing money for debts and personal spending, the accused falsely said a bank had approved her loan application and that disbursement was pending, and asked for money for travel and paperwork. Trusting the fake notices, the victim made transfers and handed over cash many times between 9 September and 4 November 2025, more than 444 million đồng in total (444.145 million đồng according to the police newspaper Công an Nhân dân). She found that no loan existed only when she went to the bank to check. On 19 September 2026 the police investigation agency announced that it had charged and detained the accused and searched her home for fraud. The AI tool is not named and no message is reproduced. Neither the accused nor the victim is named in this record.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 6 sources, 1 underlying account · Added 20/09/2026

Nov 2025South KoreaUnidentified image tool

Seoul: doctoral student sentenced to 18 months for 1,141 AI-manipulated sexual images of seven laboratory colleagues

On 10 September 2026 the Seoul Northern District Court sentenced a 30-year-old Chinese national doctoral student to 18 months in prison for habitually producing manipulated sexual images of seven women who worked in his university research laboratory. Investigators found 1,141 files made over about six months from November 2025, and search records for ways to bypass the safeguards of the generative AI Grok; the court found no evidence of distribution. A lawyer for five of the victims said they continued to suffer fear, trauma and distress. Prosecutors had sought three years and public disclosure of his identity, which the court declined.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026

Dec 2025United StatesPerplexity

Son reports his father delayed cancer treatment while relying on Perplexity

A man with cancer delayed recommended treatment while relying on a Perplexity report, according to his son and subsequent New York Times reporting. The newspaper interviewed his oncologist and a researcher whose work the report misrepresented. He died in December 2025. His son expressly cautioned that AI did not simply “kill” his father and that he might have resisted treatment without it.

Core concern Critical reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 2 sources · Added 31/07/2026

1 Dec 2025 to 6 Apr 2026IndiaUnidentified image and video tool

Ahmedabad, Gujarat: a 27-year-old Delhi man was arrested for posting AI-morphed obscene images and videos of a young woman and her mother (more than 100 images found) on fake accounts in her name after she declined his friendship, while posing as the friend reporting the fake accounts for her

On 28 May 2026 the Ahmedabad Cyber Crime Branch announced the arrest in north-east Delhi of a 27-year-old man who posts religious discourse videos online. Police allege that after meeting a young Ahmedabad woman with a public social-media profile through religious conversations on Instagram and being refused friendship, he stalked her online from December 2025 to April 2026, created fake accounts in her name (three Instagram accounts and a YouTube channel at first; eight to ten across X, Facebook, Instagram and YouTube were found on his phone), downloaded photographs of her and her mother, used websites found by searching "AI remove clothes" to generate morphed obscene images and videos of the two women, and posted them with obscene captions to damage her reputation; investigators say more than 100 AI-morphed images of the complainant were found. Officers told ThePrint and ANI that she had confided in him about the accounts and that he told her to keep quiet and claimed to be reporting the accounts and getting hers reinstated. She complained to the Cyber Crime Police Station; an FIR was registered on 6 April 2026 under BNS Sections 78(2) and 356(2) and IT Act Sections 66(C) and 67, and the accused was traced through technical surveillance and arrested under the Branch's "Mission Cyber Rakshika" campaign. The complainant said she was mentally harassed and defamed; the DCP said the images also depicted her maternal aunt. Further investigation was under way; no charge sheet or court outcome was found.

Core concern High reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 8 sources, 4 underlying accounts · Added 15/06/2026

23 Oct 2025 to 24 Oct 2025United KingdomDeepSeek (reported)

Prosecutor reports DeepSeek advice before a man murdered his mother in Wales

A man murdered his mother in Wales after an attack spanning 23–24 October 2025, as established in the sentencing remarks. At the sentencing hearing, the prosecutor reportedly said DeepSeek first refused a violent request, then supplied advice after it was reframed as fiction. The judgment confirms the murder and internet research but does not mention AI. The role of DeepSeek remains an attributed prosecution account.

Core concern Critical reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 03/06/2026

4 May 2025United KingdomChatGPT (reported)

Inquest hears that a teenager consulted ChatGPT before his suicide

A teenager died by suicide in Hampshire on 4 May 2025. Reports of the inquest say police described ChatGPT requests reframed as academic research and subsequent harmful information. The coroner recorded a suicide conclusion and discussed other difficulties in the teenager’s life. OpenAI said it had strengthened safeguards. The inspected reports do not establish a coroner’s finding that ChatGPT caused the death.

Core concern Critical reported severity Involving minors Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 16/04/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 18/11/2026. Dataset available under CC BY 4.0.