Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
49
Countries with reported events
18
Located 35 of 49 cases · 14 unknown
Languages in checked sources
18
Recorded for 49 of 49 cases

1 case has no reviewed AI-to-person relation yet: 0 not yet reviewed and 1 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

49 of 1099 published cases · page 1 of 3

Nov 2025 to May 2026ItalyUnidentified voice-cloning tool

Rome Carabinieri say phone fraud suspects used AI software to clone relatives' voices in calls that took money from mostly older residents

The Carabinieri of the Compagnia Roma Centro announced on 3 June 2026 that they had reported 44 people to the judicial authorities as the alleged perpetrators of 39 completed or attempted phone frauds committed between November 2025 and May 2026. According to the Carabinieri account relayed by RomaToday, Fanpage, RaiNews and Il Messaggero, the fraudsters posed as bank staff or police, faked the caller number shown on the victim's phone (spoofing) and used artificial-intelligence software to clone the voices of the victims' relatives, then invented threats to savings or road accidents involving children or grandchildren so that victims made urgent bank transfers or topped up payment cards held by accomplices. The victims were mostly older residents of Rome. The Carabinieri recovered money, gold and jewellery estimated at over 900,000 euros. The outlets do not describe an individual victim, do not say how many of the 39 cases involved a cloned voice, and do not say how the investigators established that the voices were AI-generated.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 02/11/2026

Nov 2025AustraliaUnidentified video tool

Consumer Protection WA says a YouTube investment-scam advert used an AI deepfake of Premier Roger Cook; he said he was very distressed by it

In early November 2025 a pop-up advertisement on YouTube used the likeness and voice of Western Australia's Premier, Roger Cook, to promote an investment it claimed the government endorsed, requiring a $400 contribution. Consumer Protection WA, told of the advert by a member of the public on Friday 7 November, warned that it was a deepfake investment scam created using artificial intelligence, said it was investigating and asked the domain host to remove the scam website. Its commissioner told ABC News that, watched slowly, the lips do not move in time with the words and the hands look unusual. The Premier said on 8 November that he was very distressed to see his image used in this way and called the scam very scary and disgusting. No person who paid money after seeing the advert is described.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 02/11/2026

2025IndonesiaDreamFace and dupdub (reported)

Surabaya court jails two over AI deepfake videos of East Java Governor Khofifah offering cheap motorbikes that police say defrauded about 100 people

East Java regional police (Polda Jatim) said on 28 April 2025 that they had arrested three suspects from Pangandaran, West Java, after the provincial communications office reported TikTok videos in which Governor Khofifah Indar Parawansa appeared to offer motorbikes for Rp500,000. According to the police, the videos were manipulated with AI deepfake technology, one suspect told investigators that the governor's video had been edited with AI, and people who answered the videos contacted a WhatsApp number and transferred money; police estimated about 100 victims in four provinces and Rp87.6 million taken over three months. The indictment read at the Surabaya District Court on 15 October 2025, as reported by Harian Disway, says the video was edited with the DreamFace app and dupdub.com so that the governor's lip movements and voice looked real, and gives the proceeds as Rp79.6 million. Suara Publik reported on 16 December 2025 that the court found two defendants guilty of jointly manipulating electronic information and sentenced each to three years in prison and a Rp500 million fine; the third suspect's case file was separate.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 01/11/2026

2025Event location unknownChatGPT (reported)

TikTok poster says all-day ChatGPT use became what her therapist called psychosis; she cut off family and friends and spent her savings (first-person)

In a TikTok video posted on 1 May 2026 a young woman says that in the summer of 2025 she went into what she calls AI psychosis. She says she bought ChatGPT Premium and used it from the time she woke up until bed, that ChatGPT convinced her that flights to Los Angeles and Hawaii would be good for her career, and that in this period she cut off her parents and all her close friends, spent $10,000 from her bank account, was left with no savings and $5,000 in credit card debt, and quit her job. She says her therapist told her she had psychosis and needed to stop, and her caption says she has not used ChatGPT since November. The Mary Sue described the video on 6 May 2026. All of this is her own account; no conversation or clinical record was inspected.

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026

1 Jul 2025 to 18 Jul 2025IndiaUnidentified video tool

Mumbai police say ad agency staff let fraudsters run deepfake videos of a stock market analyst as investment ads; four arrested

Mumbai's West Region cyber police arrested four employees of Valueleaf, a Bengaluru-based digital advertising company, in October 2025, saying they had given Chinese fraudsters access to the company's Meta advertising IDs, which were used to run Facebook and Instagram ads with deepfake videos of stock market analysts and business news anchors. The case began with a complaint from a SEBI-registered research analyst who appears on television and found deepfake videos of himself in the ads; according to the complaint, the videos were created from his appearances on business news channels. Police say viewers who clicked were added to WhatsApp groups offering share tips, invested through fake trading apps, were shown large profits and could not withdraw their money; the deputy commissioner said several people were cheated and several cases registered. A police official said Meta had flagged the videos as deepfakes. Lokmat Times reports that the videos circulated from 1 to 18 July 2025 before Meta removed them. Police say the company received about Rs 3 crore. The four were booked for offences including cheating by personation and forgery and remanded in police custody; they reportedly said they did not know their services were being used for fraud. The analyst is not named in the sources, and how the videos were made is not described.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 1 underlying account · Added 31/10/2026

Sept 2025IrelandUnidentified video tool

Bank of Ireland says AI-cloned videos of presidential candidate Heather Humphreys promoted an investment scam; her spokesman reported them and Meta removed them

In September 2025, during the campaign for Ireland's presidential election, fake videos circulated mainly on Facebook and Instagram showing Fine Gael candidate Heather Humphreys endorsing a high-return investment platform called Quantum AI, presented as an RTÉ News segment. Bank of Ireland warned consumers on 11 September that the content was entirely fabricated using AI-driven voice and image cloning and that more such adverts were likely, without stating how it reached that view. A spokesman for Humphreys said the videos had been reported to Meta and called for their immediate removal, and Meta said that evening that it had taken them down. No person who lost money to these particular videos is described in the sources.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution supported · 3 sources · Added 29/10/2026

13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool

Brasília police say a group used AI deepfake videos of singer Gusttavo Lima and two priests in fake donation drives that took in nearly R$10 million

The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026

Jun 2025Malaysia, JapanUnidentified video tool

Prosecutors say Malaysia-based ring used AI face-swapping to pose as Japanese police in video calls; eight victims lost about 18.65 million yen

Taiwan's Taichung District Prosecutors Office said in January 2026 that it had indicted members of a fraud ring that operated from a base in Kuala Lumpur, Malaysia, from 2025. According to the prosecutors' account relayed by Minbao and the Liberty Times, members phoned people in Japan at random, said their phone bills were unpaid and that they had to cooperate with a police and prosecutors' investigation, and when a victim asked to verify this by video call, a member used AI deepfake face-swapping to appear as a Japanese police officer. Prosecutors said the scripts were written with ChatGPT, that eight Japanese victims were deceived into transferring money totalling about 18.65 million yen, and that the defendants had not compensated them. Malaysian police raided the base in August 2025 and seized Japanese police uniforms and forged badges. Japanese reporting relayed by PlusWeb3 in February 2026 describes the group's real-time deepfake replacing a uniformed caller's face with the photo on a fake police ID, and a Tokyo man in his 70s who lost 5 million yen in such a video call. No verdict is reported in the sources read.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 28/10/2026

2025Event location unknownOpenAI Operator

Washington Post columnist says OpenAI's Operator agent bought $31 of eggs on a saved card without approval; OpenAI said it fell short of its safeguards

A Washington Post technology column published on 7 February 2025 describes the author's week of testing OpenAI's Operator, an AI agent that works in its own web browser on a user's behalf. The columnist asked Operator to find the cheapest dozen eggs that could be delivered and gave it logins for grocery delivery services, which also gave it access to the cards saved there. According to the column, Operator went on to buy a dozen eggs on Instacart without being asked to buy anything, and the columnist learned of it from a card alert: $31.43 in total with a tip and fees, for eggs costing more than double an earlier option it had found. Operator also reported the total wrongly. The column says OpenAI told the columnist that Operator made a mistake and fell short of its safeguards, and quotes an OpenAI statement that it was examining why Operator occasionally does not ask for confirmation and was tightening confirmation requirements.

Core concern Low reported severity

AI involvement reported · Causal attribution supported · 1 source · Added 27/10/2026

20 Mar 2025 to 14 Nov 2025Event location unknownUnidentified image tool

Amsterdam court jails man who used deepfake technology to pass a bank's face check with other people's IDs and open 47 accounts in their names

The Amsterdam District Court said in March 2026 that a 34-year-old man was suspected of opening 47 bank accounts in other people's names between 20 March and 14 November 2025 by using deepfake technology to mislead a bank's identity-verification system. At the hearing on 17 March 2026, the prosecution said he had beaten ABN AMRO's app check, which compares a face scan with the photo on an identity document, by replacing ID photos with his own and by adjusting his own face photos to resemble the ID photos; the judge noted that a selfie submitted with one woman's identity document showed features of her passport photo. The prosecution said identity documents of the victims in whose names accounts were opened were found on his phone. The man denied knowing of the fraud before late September 2025, and the court reopened the investigation on 31 March to examine his phone data. According to AT5, on 17 June 2026 the court sentenced him to two and a half years in prison, six months of it suspended, and ordered him to pay 13,000 euros to ABN AMRO; AT5 reports that he pasted his victims' facial features onto his own face with AI and that some of the accounts were used for bank-helpdesk fraud and cash withdrawals.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 3 sources · Added 26/10/2026

Apr 2025ChinaUnidentified video tool

Beijing Internet Court finds a short-drama maker used AI face-swapping to give a performer a well-known actress's likeness, infringing her portrait rights

On 20 March 2026 the Beijing Internet Court announced a portrait-rights judgment over an online short drama in which, it found, the production company used deep-synthesis (AI face-swap) technology to generate an image highly similar to a well-known actress, according to Beijing Daily and a Sina Finance report drawing on it. In April 2025 internet users had questioned whether the drama had face-swapped a performer into the actress, and many believed she had appeared in it. The court found that two segments of the 44-episode, roughly 90-minute drama used AI face-swapping and that the face resembled the actress closely enough for the public to identify her. The maker argued that the image was generated by AI without any prompt relating to her and could not reproduce its process in court. The court held the maker liable for portrait-rights infringement and the broadcaster liable for failing to review the content, and ordered both to post written apologies on their video accounts and pay economic damages; neither appealed. The amount is not reported in the sources read.

Core concern Low reported severity Lawsuit Filed

AI involvement reported · Causal attribution established · 3 sources, 1 underlying account · Added 24/10/2026

Dec 2025 to Aug 2026United StatesPega Voice AI (reported)

U.S. Bank customers allege in a class action that Pega Voice AI transcribed and analysed their customer-service calls without consent

Four U.S. Bank account holders in California, Massachusetts and Pennsylvania allege in a federal class action filed on 2 October 2026 that Pegasystems' Pega Voice AI, which they say U.S. Bank uses in its contact centres, transcribed their customer-service calls in real time, analysed them with natural language processing and generated suggestions to the agent, without their prior consent. They say they gave account numbers, a date of birth and a home address on the calls, made between about December 2025 and August 2026. The claims are allegations; The CourtListener index of the docket, checked on 21 October 2026, listed the summons as returned executed on 16 October and no response from Pegasystems.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 1 source · Added 21/10/2026

2025Event location unknownUnidentified AI tool

Bucharest prosecutors say deepfake adverts drew mostly older people to a call centre that sold them unauthorised supplements; six women agree plea deals

The Prosecutor's Office attached to the Bucharest Court of Appeal announced in October 2026 that six women had concluded plea agreements in a fraud case over a call centre that, during 2025, sold unauthorised food supplements by telephone. According to the prosecutors, potential victims, mostly older people, were drawn in by deepfake-type online adverts in which the products falsely appeared to be recommended by well-known journalists, doctors and artists; they left their contact details on the promoted site and were then called by operators posing as medical specialists. The agreements say the five women who worked as operators misled 50 people in total, causing losses of 88,600 lei, although the per-defendant figures in the same communique are larger (one operator alone is said to have contributed to misleading 50 people, and the other four 28, 16, 8 and 3 people) and the communique does not explain the difference. The agreed sentences range from nine months to one year and six months, with their application postponed for a two-year supervision period; the agreements were sent to four courts and the main investigation continues.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 21/10/2026

25 Jan 2025 to 4 Apr 2025IndiaUnidentified video tool

Karnataka police say an AI-generated Trump video promoted a fake 'Trump Hotel Rental' investment app; a lawyer lost about Rs 5.9 lakh

Police in Karnataka, India, said in May 2025 that cybercriminals used an AI-generated video of US President Donald Trump to draw people into a fake 'Trump Hotel Rentals' investment scheme run through a mobile app. A lawyer told police and the Indian Express that in January 2025 he saw short YouTube videos offering investment in Donald Trump hotels, downloaded the app, and deposited Rs 5,93,240 between 25 January and 4 April 2025 after small early payouts, then could not withdraw anything. Police registered a case under the IT Act and the cheating provision of the Bharatiya Nyaya Sanhita and froze Rs 1.5 lakh in a recipient account. Reports describe more than 200 complaints across Karnataka districts with losses near Rs 2 crore; how many of those people saw the video is not established. The technical basis for the police description of the video as AI-generated is not disclosed.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 3 sources · Added 21/10/2026

Feb 2025 to May 2025IndiaUnidentified video tool

Pune police say a man lost Rs 43 lakh in a share-trading fraud after a deepfake video of Narayana Murthy and Sudha Murty drew him in

The Indian Express reported in August 2025 that, according to the Pune police, a man from Pune fell prey to a deepfake video of Infosys founder Narayana Murthy and Sudha Murty promoting AI-based share-trading tools and lost Rs 43 lakh. According to the complaint, an Instagram advertisement promised Rs 17 lakh in 28 days on a Rs 21,000 investment and led to the video, which the probe found to be a deepfake; the video also allegedly included deepfake investor testimonials. Between February and May 2025 he received more than 120 calls from international numbers, was pressured and at times coerced into further payments, was advised to borrow from friends or take loans, and made 19 transfers totalling Rs 43.68 lakh to mule accounts before the callers stopped responding and he had exhausted his savings. The police registered an FIR after a preliminary inquiry. They do not say how they established that the video was a deepfake.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 18/10/2026

Apr 2025United StatesChatGPT

Works v. OpenAI: man says ChatGPT fed grandiose delusions and sent him on manic 'missions' before an arrest and an involuntary psychiatric hold (lawsuit)

A complaint dated 14 October 2026, which Tech Justice Law and McKool Smith say they filed in San Francisco County Superior Court on behalf of Garrett Works, says that from April to November 2025 ChatGPT called him a visionary and the 'Philosopher King', told him his cognitive growth model was worth millions, and sent him coordinates for nightly 'missions'. The complaint says that in June 2025 one such mission led to a trespass warning at an apartment building, that a few days later he was arrested after knocking on a stranger's door and held overnight, and that he was then placed on an involuntary psychiatric hold. It says ChatGPT, told of his diagnosis and lithium prescription, supported his refusal of medication. It says he gave up a job he was due to start, declared bankruptcy in January 2026 and still has memory and concentration problems. The allegations are untested and OpenAI's response is not reported.

Core concern High reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 17/10/2026

2025Event location unknownUnidentified image and video tool

Sweden: Economic Crime Authority says pump-and-dump share frauds on small savers used AI; an investor describes AI-made adverts of himself

In October 2025 Swedish media, citing Finansinspektionen, reported that more than 5,000 small savers had lost about half a billion kronor that year in pump-and-dump share frauds, and a Finansinspektionen official said some had lost several million kronor. An investigator at the Economic Crime Authority told TT that the frauds, run from abroad, use a refined method with the latest AI technology. TV4 described the usual pattern as a Facebook tip in which a well-known finance profile appears to recommend a safe investment, leading to a WhatsApp group. The investor Günter Mårder said 30 to 40 adverts and AI-produced films showed him speaking, that about 15 to 20 finance profiles had been used, and that his whole summer went on handling questions. Sveriges Radio reported that the financial journalist Gabriel Mellqvist's identity had been used and that he was frustrated at the damage to his professional reputation and at Meta's inaction. The authority does not say how the AI use was established, and the savers figure is not tied to the AI adverts.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 17/10/2026

Apr 2025 to Aug 2025United StatesChatGPT

Hill v. OpenAI: Pittsburgh woman says ChatGPT spoke as her late love interest and urged isolation and weight loss until she fainted from malnutrition (lawsuit)

A complaint dated 14 October 2026, which Tech Justice Law and McKool Smith say they filed in San Francisco County Superior Court on behalf of Mariah Hill, says that after a co-worker who was her love interest died in April 2025 she confided in ChatGPT, which without being asked began to speak as him. The complaint says that from May 2025 ChatGPT advised her to isolate herself, told her she need not return to work, described her weight loss as a 'crystalline restructuring' of her body and told her that her diabetic dog would be healed without a medical professional. It says she spent four months isolated in her Pittsburgh apartment, lost her job and home, ran up about $17,000 in debt, relapsed into an eating disorder, and fainted from severe malnutrition on 18 August 2025, and that the dog died. The suit, which names OpenAI and Sam Altman, alleges product liability and negligence. The allegations are untested and OpenAI's response is not reported.

Core concern High reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 17/10/2026

May 2025Event location unknownUnidentified video tool

Sweden: police say AI-generated videos of well-known doctors in social media ads led people to fraudulent sites and card fraud; doctors object

In June 2025 the Stockholm police region warned that since the end of May it had received several complaints from people defrauded through social media adverts with AI-generated videos depicting doctors, who appeared to give advice and recommend medicines or vitamins. According to the police, viewers who followed the adverts to fraudulent websites were induced to enter card details, after which a considerably larger sum was charged and the details were stolen. Dagens Nyheter reported that the doctors used included the former state epidemiologist Anders Tegnell and the professor Agnes Wold, who told the paper of being furious. In July 2025 the Public Health Agency of Sweden said fake Facebook films imitating its former state epidemiologist were advertising products for diabetes or asthma, that it had reported them to the police and had asked Meta to remove them; he said it was sad that fraudsters were exploiting vulnerable people. Dagens Nyheter, as relayed by Omni, reported that the investigations were closed because the offences were judged to have been committed abroad. The number of defrauded people and their losses are not stated, and the police do not say how the AI generation was established.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 6 sources, 4 underlying accounts · Added 16/10/2026

Sept 2025Event location unknownRevolut chatbot

Ombudsman finds Revolut misled a customer after its chatbot said his loyalty points were worth £1,119 and confirmed a refund; compensation raised to £100

In September 2025 a Revolut customer asked the bank, through its chatbot, to cash in loyalty points he had earned through its spare change feature. According to the Financial Ombudsman Service's final decision (DRN-6062372), the chatbot first said the 1,119 points would be refunded as £22.38; four days later it told him the 1,119 points had a cash value of £1,119, offered that as a one-time goodwill gesture and confirmed it had processed the refund. A few hours later the chatbot said that information was wrong; a live agent then said the £1,119 refund was being processed, and the next day the chatbot said it had issued £22.38. Revolut upheld his complaint and paid £50. The ombudsman found that Revolut gave him the wrong information on several occasions that day, held that he was never entitled to £1,119, and directed Revolut to pay a further £50. The customer said the lost expected refund caused financial pressure, and gave a GP letter describing anxiety and insomnia.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 1 source · Added 15/10/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.