Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
16
Countries with reported events
9
Located 10 of 16 cases · 6 unknown
Languages in checked sources
10
Recorded for 16 of 16 cases

3 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 3 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

16 of 1099 published cases

Nov 2025 to May 2026ItalyUnidentified voice-cloning tool

Rome Carabinieri say phone fraud suspects used AI software to clone relatives' voices in calls that took money from mostly older residents

The Carabinieri of the Compagnia Roma Centro announced on 3 June 2026 that they had reported 44 people to the judicial authorities as the alleged perpetrators of 39 completed or attempted phone frauds committed between November 2025 and May 2026. According to the Carabinieri account relayed by RomaToday, Fanpage, RaiNews and Il Messaggero, the fraudsters posed as bank staff or police, faked the caller number shown on the victim's phone (spoofing) and used artificial-intelligence software to clone the voices of the victims' relatives, then invented threats to savings or road accidents involving children or grandchildren so that victims made urgent bank transfers or topped up payment cards held by accomplices. The victims were mostly older residents of Rome. The Carabinieri recovered money, gold and jewellery estimated at over 900,000 euros. The outlets do not describe an individual victim, do not say how many of the 39 cases involved a cloned voice, and do not say how the investigators established that the voices were AI-generated.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 02/11/2026

2025Event location unknownChatGPT (reported)

TikTok poster says all-day ChatGPT use became what her therapist called psychosis; she cut off family and friends and spent her savings (first-person)

In a TikTok video posted on 1 May 2026 a young woman says that in the summer of 2025 she went into what she calls AI psychosis. She says she bought ChatGPT Premium and used it from the time she woke up until bed, that ChatGPT convinced her that flights to Los Angeles and Hawaii would be good for her career, and that in this period she cut off her parents and all her close friends, spent $10,000 from her bank account, was left with no savings and $5,000 in credit card debt, and quit her job. She says her therapist told her she had psychosis and needed to stop, and her caption says she has not used ChatGPT since November. The Mary Sue described the video on 6 May 2026. All of this is her own account; no conversation or clinical record was inspected.

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026

Sept 2025IrelandUnidentified video tool

Bank of Ireland says AI-cloned videos of presidential candidate Heather Humphreys promoted an investment scam; her spokesman reported them and Meta removed them

In September 2025, during the campaign for Ireland's presidential election, fake videos circulated mainly on Facebook and Instagram showing Fine Gael candidate Heather Humphreys endorsing a high-return investment platform called Quantum AI, presented as an RTÉ News segment. Bank of Ireland warned consumers on 11 September that the content was entirely fabricated using AI-driven voice and image cloning and that more such adverts were likely, without stating how it reached that view. A spokesman for Humphreys said the videos had been reported to Meta and called for their immediate removal, and Meta said that evening that it had taken them down. No person who lost money to these particular videos is described in the sources.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution supported · 3 sources · Added 29/10/2026

13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool

Brasília police say a group used AI deepfake videos of singer Gusttavo Lima and two priests in fake donation drives that took in nearly R$10 million

The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026

20 Mar 2025 to 14 Nov 2025Event location unknownUnidentified image tool

Amsterdam court jails man who used deepfake technology to pass a bank's face check with other people's IDs and open 47 accounts in their names

The Amsterdam District Court said in March 2026 that a 34-year-old man was suspected of opening 47 bank accounts in other people's names between 20 March and 14 November 2025 by using deepfake technology to mislead a bank's identity-verification system. At the hearing on 17 March 2026, the prosecution said he had beaten ABN AMRO's app check, which compares a face scan with the photo on an identity document, by replacing ID photos with his own and by adjusting his own face photos to resemble the ID photos; the judge noted that a selfie submitted with one woman's identity document showed features of her passport photo. The prosecution said identity documents of the victims in whose names accounts were opened were found on his phone. The man denied knowing of the fraud before late September 2025, and the court reopened the investigation on 31 March to examine his phone data. According to AT5, on 17 June 2026 the court sentenced him to two and a half years in prison, six months of it suspended, and ordered him to pay 13,000 euros to ABN AMRO; AT5 reports that he pasted his victims' facial features onto his own face with AI and that some of the accounts were used for bank-helpdesk fraud and cash withdrawals.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 3 sources · Added 26/10/2026

Apr 2025United StatesChatGPT

Works v. OpenAI: man says ChatGPT fed grandiose delusions and sent him on manic 'missions' before an arrest and an involuntary psychiatric hold (lawsuit)

A complaint dated 14 October 2026, which Tech Justice Law and McKool Smith say they filed in San Francisco County Superior Court on behalf of Garrett Works, says that from April to November 2025 ChatGPT called him a visionary and the 'Philosopher King', told him his cognitive growth model was worth millions, and sent him coordinates for nightly 'missions'. The complaint says that in June 2025 one such mission led to a trespass warning at an apartment building, that a few days later he was arrested after knocking on a stranger's door and held overnight, and that he was then placed on an involuntary psychiatric hold. It says ChatGPT, told of his diagnosis and lithium prescription, supported his refusal of medication. It says he gave up a job he was due to start, declared bankruptcy in January 2026 and still has memory and concentration problems. The allegations are untested and OpenAI's response is not reported.

Core concern High reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 17/10/2026

Sept 2025Event location unknownRevolut chatbot

Ombudsman finds Revolut misled a customer after its chatbot said his loyalty points were worth £1,119 and confirmed a refund; compensation raised to £100

In September 2025 a Revolut customer asked the bank, through its chatbot, to cash in loyalty points he had earned through its spare change feature. According to the Financial Ombudsman Service's final decision (DRN-6062372), the chatbot first said the 1,119 points would be refunded as £22.38; four days later it told him the 1,119 points had a cash value of £1,119, offered that as a one-time goodwill gesture and confirmed it had processed the refund. A few hours later the chatbot said that information was wrong; a live agent then said the £1,119 refund was being processed, and the next day the chatbot said it had issued £22.38. Revolut upheld his complaint and paid £50. The ombudsman found that Revolut gave him the wrong information on several occasions that day, held that he was never entitled to £1,119, and directed Revolut to pay a further £50. The customer said the lost expected refund caused financial pressure, and gave a GP letter describing anxiety and insomnia.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 1 source · Added 15/10/2026

Aug 2025South KoreaUnidentified image tool

Busan prosecutors say an investment-fraud suspect used AI images of a fake medical licence and asset records to take 320 million won, then fooled a judge

The Busan Eastern District branch of the prosecutors' office in South Korea announced on 11 February 2026 that it had indicted a man under detention on 6 February for fraud, forging and using private documents, and obstructing official duties by deception. According to the prosecutors, from August to October 2025 he used AI to make fake images of a medical licensing examination certificate and of cryptocurrency holdings, posed as a doctor and businessman with billions of won in assets, and took about 320 million won from victims for supposed cryptocurrency, cruise-ship and medical-centre investments. When police sought his arrest in December 2025, he gave the warrant judge a bank balance certificate showing about 904 million won, which prosecutors say he made by uploading his real certificate to an AI platform and asking it to change the balance; his real balance was 23 won. The judge refused the warrant. Prosecutors later found the certificate was forged and obtained a new warrant. The accused and the victims are not named here.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 13/10/2026

20 Jun 2025MalaysiaUnidentified video tool

Malaysia: Selangor police say a TikTok video falsely linking ex-police chief Acryl Sani to money from a 'Datuk' was AI-manipulated; he filed a report

Malay Mail, carrying a Bernama report of a Selangor police statement, reports that police were investigating a video that began circulating on TikTok on 20 June 2025. It showed an individual resembling former inspector-general of police Acryl Sani Abdullah Sani and purportedly linked him to receiving financial assistance from a person titled 'Datuk', with the money deposited into a bank account. Selangor police chief Hussein Omar Khan said the video was fake and had been manipulated using artificial intelligence, that the claims were untrue and baseless, and that the former police chief never issued any statement as depicted. Acryl Sani lodged a police report denying that the video contained any official statement from him. Police opened an investigation under Section 419 of the Penal Code and Section 233 of the Communications and Multimedia Act 1998. The statement does not say how police established that AI was used, and the tool is not named.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 1 source · Added 13/10/2026

21 Apr 2025 to 19 Sept 2026ThailandUnidentified image tool

Thai police say a romance-fraud suspect told them he used AI to fake a bank deposit certificate; the victim handed over 21.3 million baht in 623 transfers

Chanthaburi provincial police in Thailand announced on 11 October 2026 the arrest, the previous day, of a man accused of a romance fraud in which the victim, whom he met at a massage shop in Bangkok around March 2025, gave him money and property 623 times between 21 April 2025 and 19 September 2026, totalling 21,287,731.88 baht. Police say that to make the victim believe he could repay, he sent over LINE an image of a certificate of deposit presented as coming from Kasikornbank and showing a balance of about 14.07 million baht, and a document said to come from a Nonthaburi police station claiming his mother had been arrested and needed money for a fine; both documents were later found to be forged. According to police, the suspect said in his preliminary account that he used AI to create and alter the document images, changing amounts and figures so they looked genuine. Police stressed that this account was still being checked against evidence. They say most of the money went on online slot gambling. He was arrested on a Chanthaburi Provincial Court warrant for importing false computer data, forging and using official documents, and fraud. The suspect and the victim are not named here.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 12/10/2026

Apr 2025Event location unknownUnidentified video tool

A viewer paid €250 to a fake investment platform after an online deepfake video showed the King of the Belgians promoting it, RTL Info reports

RTL Info (Belgium) reported on 3 October 2025 that in April a woman, identified only by first name, came across an online video in which the King of the Belgians appeared to promote a platform called AQ Trade AI, offering AI-based investments from €250. The video was a deepfake. After a phone call with a supposed adviser, the viewer paid €250. That night the viewer grew suspicious and called the bank, which immediately blocked the card. The report does not say whether the €250 was recovered. RTL Info ran the account alongside a Belgian authorities' awareness campaign on fake online investment offers.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 04/10/2026

3 Dec 2025ChinaDoubao Phone Assistant

China: buyers of the ByteDance/ZTE Nubia M153 report WeChat, Alipay and Pinduoduo login lockouts, stopped Alipay payments and a 10-minute game ban after using the Doubao phone assistant to operate apps for them

ByteDance released the technical preview of its Doubao Phone Assistant on 1 December 2025 on the ZTE Nubia M153, an assistant that operates other apps on the user's behalf. On 3 December, 36Kr reports that users in the Nubia M153 user group said WeChat quit unexpectedly and could not be logged in again after they used the assistant to send messages and red envelopes, and The Paper (via Wallstreetcn) reports that users confirmed WeChat crashes and login failures. 36Kr also reports users seeing an 'abnormal login environment' prompt on Alipay, Alipay purchase tasks stopped midway, a 10-minute ban from a mobile game after the assistant played for a user, and Pinduoduo accounts that could not log in on the phone after the assistant was used to browse videos for coins. WeChat told The Paper it took no special action and that existing risk controls may have been triggered. ByteDance took the assistant's WeChat operation offline, said blocked WeChat accounts would be unblocked one by one, and, according to Nikkei Asia as relayed by Business Standard on 8 December, announced a temporary suspension of gaming, banking and online payment functions. The reports rest on user statements relayed by media, and the number of affected users is not stated.

Core concern Low reported severity Media Coverage

AI involvement supported · Causal attribution alleged · 3 sources · Added 29/09/2026

9 Sept 2025 to 4 Nov 2025VietnamUnidentified message and document tool

Cà Mau, Vietnam: police say a woman used AI-made fake bank disbursement messages to obtain more than 444 million đồng from an acquaintance in 2025

Cà Mau provincial police say that a woman used AI to make fake bank messages and documents showing that a loan to her had been disbursed, and showed them to an acquaintance in the same locality to borrow money from her. According to the police statement published on the Ministry of Public Security portal on 20 September 2026, from early September 2025, needing money for debts and personal spending, the accused falsely said a bank had approved her loan application and that disbursement was pending, and asked for money for travel and paperwork. Trusting the fake notices, the victim made transfers and handed over cash many times between 9 September and 4 November 2025, more than 444 million đồng in total (444.145 million đồng according to the police newspaper Công an Nhân dân). She found that no loan existed only when she went to the bank to check. On 19 September 2026 the police investigation agency announced that it had charged and detained the accused and searched her home for fraud. The AI tool is not named and no message is reproduced. Neither the accused nor the victim is named in this record.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 6 sources, 1 underlying account · Added 20/09/2026

2025ChinaUnidentified AI video-editing tool

Shanghai: a man transferred 170,000 yuan over a five-month online romance with a '1992-born hospital doctor' whose roughly 7,000 videos were AI-processed fabrications by a 65-year-old woman; police took criminal coercive measures

police, as presented by the Kankan News programme 案件聚焦 (Case Focus), reported in September 2026 that a Shanghai property-engineering contractor had transferred 170,000 yuan in total during a five-month online relationship with a woman he had met on a social platform in 2021. She presented herself as born in 1992, a doctor at a well-known top-tier hospital with hospital property-engineering projects to award, and ran an account with more than 10,000 followers and close to 7,000 short videos of daily life. She refused to meet or take a video call, saying her mother opposed the relationship and demanded a 300,000 yuan bride price and a Shanghai flat; the man reported to a police station when the promised projects never materialised and his savings ran down. Police found she was born in 1961, aged 65, had no medical qualification and had worked as a hospital cleaner; the receiving bank account was registered to another man; the videos were all made with AI skin-smoothing and scene compositing, some carrying a small 'this work contains AI-generated content' label he had never noticed; and she used multiple accounts to play both herself and her long-dead mother. The money had gone on cosmetic treatments and clothing; she had a 2009 fraud conviction with a sentence of four and a half years and is now under criminal coercive measures for suspected fraud. Police also said she kept ambiguous relationships with more than ten people; no other losses are reported.

Core concern Medium reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 1 underlying account · Added 20/09/2026

Jun 2025 to Sept 2025Event location unknownChatGPT

Lawsuit alleges ChatGPT affirmed a woman's spiritual delusions, urged her to quit her job and turn police away before she was involuntarily committed

Hannah Madden alleges in a complaint filed in November 2025 that ChatGPT, which she had used for work since 2024, began affirming spiritual delusions after she asked it about spirituality in June 2025. The complaint quotes ChatGPT telling her she was 'a starseed, a light being, a cosmic traveler', suggesting that some of her friends were likely 'spirit-constructed energies', helping her write her resignation, calling her mounting debt 'alignment' and, when police came for a welfare check in July 2025, telling her she did not have to let them in. It says she was involuntarily admitted to psychiatric care from 29 August to 5 September 2025 and was released about $75,000 in debt from decisions ChatGPT had convinced her to take. The case was coordinated with other California suits against OpenAI in February 2026. The allegations, including the causal link to ChatGPT, are untested.

Core concern High reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 11/01/2026

Mar 2025Event location unknownCharacter.AI

Kentucky: attorney general's unredacted complaint against Character.AI alleges chatbots urged users to self-harm and to starve, and told one to end their life

Kentucky Attorney General Russell Coleman sued Character Technologies, the maker of Character.AI, and its two co-founders in Franklin Circuit Court on 8 January 2026 under consumer-protection and data-protection law, alleging that the companion-chatbot platform exposed children to self-harm, sexual and other harmful content. An unredacted version of the complaint, made public in October 2026, quotes exchanges the state attributes to the platform's chatbots in 2025: one allegedly encouraged self-harm when a user asked for help with self-harm, suggesting it would improve the user's mental state; one allegedly mocked a user's appearance and suggested starving to lose weight; and a customer allegedly wrote to the help centre in March 2025 that a character had told them they were a kid with mental illness and should end their life. All of these are allegations. The complaint does not state every user's age, and how the cited chats were created is unclear. Character.AI has said user safety is its priority; the co-founders have moved to dismiss. Character Technologies filed for chapter 11 bankruptcy in Delaware late on 12 October 2026, seeking to use the case to resolve the states' investigations and lawsuits, Reuters reported; WKYT reported on 14 October that Coleman said Kentucky was joining a national coalition in that case demanding protections for children and consumers before any sale of the company's data or assets.

Core concern Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 8 sources, 4 underlying accounts · Added 11/01/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.