Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
234
Countries with reported events
44
Located 169 of 234 cases · 65 unknown
Languages in checked sources
33
Recorded for 234 of 234 cases

4 cases have no reviewed AI-to-person relation yet: 1 not yet reviewed and 3 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

234 of 1099 published cases · page 1 of 12

Dec 2024Thailand, CambodiaUnidentified video tool

Thai police say call-centre gang used AI to pose as officers on video calls; an actress lost 4 million baht and a court later ordered her bank to pay part

Thailand's Central Investigation Bureau said in February 2025 that two arrested members of a call-scam centre in Poipet, Cambodia, had used artificial intelligence technology to pretend to be police officers, and that the gang had tricked 163 people, including a Thai-British actress who lost 4 million baht. VnExpress, citing the South China Morning Post, reports that the actress received a video call in December 2024 from a man posing as a Department of Special Investigation official who kept her on the call while she made three transfers, and that police later said the network used AI to swap the callers' faces during video calls. The Cyber Crime Investigation Bureau said in June 2025 that the Criminal Court had sentenced four people in her case, one of them for posing as a police officer on video calls with her, and ordered them to repay the 4 million baht. On 8 July 2026 the Civil Court ordered Kasikornbank to pay 1 million baht plus interest after ruling that the bank failed to flag her after-midnight transfers. The police have not described how they established that AI was used.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources · Added 02/11/2026

Apr 2024CanadaMeta AI

Winnipeg man says Meta AI told him a fake Facebook support number was legitimate, and scammers he then called took over his accounts

A Winnipeg man told CBC that in spring 2024, after a problem moving his Facebook account to a new phone, his wife found what looked like a Facebook customer support number online, and before calling it he asked the Meta AI search tool in Facebook Messenger whether it was legitimate. According to his account and a screenshot he gave CBC, Meta AI answered that the number was "indeed a legitimate Facebook support number". Facebook has no phone support line. When he called, the person on the line obtained his account details, opened his Facebook account and had him install an app giving access to his phone; during the call someone used his PayPal account to buy a $500 Apple gift card and tried to buy bitcoin, which his bank refused. He cancelled cards, locked bank accounts, filed fraud and police reports, and PayPal reversed the $500 charge. Meta told CBC that Meta AI can sometimes produce inaccurate information and that its own searches gave different results. Winnipeg police said they had an active investigation.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 1 source · Added 02/11/2026

1 May 2021BrazilUnidentified death-record matching system

Brazilian federal judge finds an INSS AI death-record match wrongly ended a living retiree's pension, his only income, and awards damages

A Brazilian federal judge in the 4th federal region ordered the social security institute (INSS) to pay a retiree R$3,917.67 in moral damages after finding that his pension had been stopped by a failure of the institute's artificial intelligence system, according to a Federal Regional Court of the 4th Region (TRF4) news item relayed by the Brazilian Institute of Social Security Law on 30 September 2022. The judge explained that the benefit was suspended automatically on 1 May 2021 by an artificial intelligence command that captured data from the death-records system (Sisobi), and that the data used, the person's name and mother's name, were not enough to prevent the wrongful cessation. The retiree said the pension was his only source of income; he asked for reactivation and sent a handwritten declaration, and although he showed in person that he was alive, the benefit was restored only in January 2022. The judge wrote that the AI 'proved inefficient or unintelligent' in this case and that the INSS made him wait 226 days. Arrears were also ordered paid. Whether the INSS appealed is not reported.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 02/11/2026

Nov 2025 to May 2026ItalyUnidentified voice-cloning tool

Rome Carabinieri say phone fraud suspects used AI software to clone relatives' voices in calls that took money from mostly older residents

The Carabinieri of the Compagnia Roma Centro announced on 3 June 2026 that they had reported 44 people to the judicial authorities as the alleged perpetrators of 39 completed or attempted phone frauds committed between November 2025 and May 2026. According to the Carabinieri account relayed by RomaToday, Fanpage, RaiNews and Il Messaggero, the fraudsters posed as bank staff or police, faked the caller number shown on the victim's phone (spoofing) and used artificial-intelligence software to clone the voices of the victims' relatives, then invented threats to savings or road accidents involving children or grandchildren so that victims made urgent bank transfers or topped up payment cards held by accomplices. The victims were mostly older residents of Rome. The Carabinieri recovered money, gold and jewellery estimated at over 900,000 euros. The outlets do not describe an individual victim, do not say how many of the 39 cases involved a cloned voice, and do not say how the investigators established that the voices were AI-generated.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 02/11/2026

Nov 2025AustraliaUnidentified video tool

Consumer Protection WA says a YouTube investment-scam advert used an AI deepfake of Premier Roger Cook; he said he was very distressed by it

In early November 2025 a pop-up advertisement on YouTube used the likeness and voice of Western Australia's Premier, Roger Cook, to promote an investment it claimed the government endorsed, requiring a $400 contribution. Consumer Protection WA, told of the advert by a member of the public on Friday 7 November, warned that it was a deepfake investment scam created using artificial intelligence, said it was investigating and asked the domain host to remove the scam website. Its commissioner told ABC News that, watched slowly, the lips do not move in time with the words and the hands look unusual. The Premier said on 8 November that he was very distressed to see his image used in this way and called the scam very scary and disgusting. No person who paid money after seeing the advert is described.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 02/11/2026

2026IndiaUnidentified image tool

Durg (Chhattisgarh) police say a fake marriage bureau used AI-made photos of fictional women to take fees from people seeking marriage

Police in Durg district, Chhattisgarh, India, said in a statement reported on 30 October 2026 that they had raided a fake marriage bureau in Bhilai on 29 October and arrested its operator. According to the police account carried by regional outlets, the operator said under questioning that he advertised on Facebook and Instagram under three matrimony names using photos of fictional young women prepared with AI and fake mobile numbers. People in other states who wanted to marry contacted the bureau, were promised marriage to the woman they chose, paid a fee of 2,000 rupees and other sums by QR code, and were then blacklisted and cut off. Police said complaints against the bureau's bank accounts were registered on the national Samanvay portal and that the operation had run for about three months. A case was registered under sections 317(2) and 319(2) of the Bharatiya Nyaya Sanhita and the operator was remanded in judicial custody. The number of people who paid and the total taken are not reported, and the AI tool is not named.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 01/11/2026

2025IndonesiaDreamFace and dupdub (reported)

Surabaya court jails two over AI deepfake videos of East Java Governor Khofifah offering cheap motorbikes that police say defrauded about 100 people

East Java regional police (Polda Jatim) said on 28 April 2025 that they had arrested three suspects from Pangandaran, West Java, after the provincial communications office reported TikTok videos in which Governor Khofifah Indar Parawansa appeared to offer motorbikes for Rp500,000. According to the police, the videos were manipulated with AI deepfake technology, one suspect told investigators that the governor's video had been edited with AI, and people who answered the videos contacted a WhatsApp number and transferred money; police estimated about 100 victims in four provinces and Rp87.6 million taken over three months. The indictment read at the Surabaya District Court on 15 October 2025, as reported by Harian Disway, says the video was edited with the DreamFace app and dupdub.com so that the governor's lip movements and voice looked real, and gives the proceeds as Rp79.6 million. Suara Publik reported on 16 December 2025 that the court found two defendants guilty of jointly manipulating electronic information and sentenced each to three years in prison and a Rp500 million fine; the third suspect's case file was separate.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 01/11/2026

10 Jul 2024Event location unknownGemini (reported)

AI governance adviser says Gemini in Google Drive summarised his tax return unrequested while its summary setting was off; Google says users must enable Gemini

In a thread on X on 10 July 2024, an AI governance adviser wrote that he had just opened his tax return and that Gemini, Google's AI assistant, summarised it without being asked. He wrote that he could not find a setting to stop it, that the two locations Gemini itself suggested did not work, and that when another user showed him the setting meant to keep Gemini out of his documents it was already turned off while Gemini kept giving document summaries. His later testing, in the same thread, suggested that once Gemini had been opened for one PDF in Google Drive it was invoked again for every PDF he opened until he closed it, and he put forward a working theory that his 2023 sign-up for Workspace Labs had overridden the opt-out. A Google spokesperson told technology outlets that using Gemini in Google Workspace requires a user to enable it proactively and that content is not stored without permission; Tom's Hardware reports that Google suggested he may have used Gemini through the Drive side panel and that closing the panel might solve the issue.

Contextual tracker case Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 01/11/2026

12 May 2026 to 28 Aug 2026RomaniaUnidentified document-generation tool

Romanian prosecutors say a man posing as a lawyer used AI apps to make documents purporting to come from courts and took about 48,000 lei from a client

The prosecutors' office attached to the Giurgiu district court in Romania said on 30 October 2026 that it had begun criminal proceedings for continued fraud against a detained man who, according to the evidence gathered, falsely presented himself as a lawyer between 12 May and 28 August 2026 and, using applications that use artificial intelligence, drew up documents purportedly issued by courts, including the Bucharest Court of Appeal and the Giurgiu district court. According to the prosecutors, the injured person handed over a total of 47,896 lei, and also a pig, as payment for the supposed legal services. The prosecutors asked the court to remand him in custody for 30 days. He is presumed innocent.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 01/11/2026

Oct 2026IndiaUnidentified image and video tool

Jaipur police say an engineer faked his own kidnapping and sent his family AI-made images and videos of himself held captive, demanding ransom

Police in Jaipur, Rajasthan, say a software engineer who went missing on 26 October 2026 staged his own kidnapping and sent relatives fabricated photos and videos, which police and the man's own account describe as AI-generated, showing him held captive, in pain and admitted to a hospital. Bhaskar English reports that he demanded a ransom of 7 lakh rupees from the family. His brother-in-law filed a kidnapping complaint, police searched several cities using CCTV footage, and on 30 October officers found him in Rishikesh. Police say he confessed and had borrowed money from friends that he could not repay. The Hindi daily Amar Ujala, which describes him as an IT student, reports that the family panicked at the messages before informing police, and that officers brought him back to Jaipur and handed him over to his family. No payment by the family and no charge are reported.

Core concern Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 01/11/2026

Event date unknownThailandUnidentified video tool

Thai PBS Verify says a Crystallum AI investment advert used an AI deepfake of a former NHK World anchor; she said she was shocked her image was used

In August 2025 Thai PBS Verify reported a Facebook advert that carried the Thai PBS World Tonight logo and showed a news anchor apparently interviewing two prominent Thai business leaders about an investment scheme called Crystallum AI. The anchor was a former NHK World presenter who had never anchored for Thai PBS. Thai PBS Verify traced the footage to a 2013 English-language report about flood housing, found that the logo had been changed and the English reporting replaced with a synthesized Thai voice, and said an AI detection tool gave a 72.3% probability that the clip was an AI deepfake. The former anchor said she was shocked her image was used to deceive people into investing and that it could discredit her reputation, and spoke out to warn others. No person who invested after seeing the advert is described.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution supported · 1 source · Added 01/11/2026

Event date unknownThailandUnidentified video tool

Thai PBS Verify says Facebook investment advert used an AI deepfake of a Thai PBS World anchor; the anchor said viewers could take it for real news

In mid-2025 a Facebook page using a news outlet's logo ran a two-minute video as adverts in which a Thai PBS World news anchor appeared to interview the chief executive of the Miss Universe Organization about an online investment platform said to turn 8,000 baht into as much as 800,000 baht. Thai PBS Verify reported on 22 July 2025 that the clip was an AI deepfake: it traced the anchor's footage to a Thai PBS World Tonight report of 24 June 2025, and the chairman of the company Guardian AI, whom it consulted as an AI image technology specialist, cited lip movements that do not match the voice and blurred facial features. The anchor told Thai PBS Verify that ordinary viewers could mistake it for real news, that this was the most convincing of at least three or four such incidents in a year, and that she was worried. No person who invested after seeing the advert is described.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 01/11/2026

2025Event location unknownChatGPT (reported)

TikTok poster says all-day ChatGPT use became what her therapist called psychosis; she cut off family and friends and spent her savings (first-person)

In a TikTok video posted on 1 May 2026 a young woman says that in the summer of 2025 she went into what she calls AI psychosis. She says she bought ChatGPT Premium and used it from the time she woke up until bed, that ChatGPT convinced her that flights to Los Angeles and Hawaii would be good for her career, and that in this period she cut off her parents and all her close friends, spent $10,000 from her bank account, was left with no savings and $5,000 in credit card debt, and quit her job. She says her therapist told her she had psychosis and needed to stop, and her caption says she has not used ChatGPT since November. The Mary Sue described the video on 6 May 2026. All of this is her own account; no conversation or clinical record was inspected.

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 31/10/2026

Jan 2024 to Jan 2025Cambodia, South KoreaUnidentified video tool

Ulsan court jails Korean couple who ran a Cambodia-based romance and investment fraud using deepfake videos of a fake investment expert

South Korean prosecutors indicted a married couple in February 2026 on charges that, from January 2024 to January 2025, they ran phone-fraud groups in Cambodia that targeted Koreans with romance-and-investment scams; according to the prosecutors, the husband used deepfake technology to make YouTube videos in which he posed as an investment expert, while the wife built relationships with victims in private chats, and 97 victims lost about 10.1 billion won. Both admitted the charges, and on 24 July 2026 the Ulsan District Court sentenced the husband to 15 years and the wife to 9 years in prison, noting that the victims described severe harm while the defendants had made no effort to compensate them. Prosecutors appealed; at the appeal hearing on 22 October 2026 they asked for 17 years for the husband, and a joint appeal judgment is pending.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 31/10/2026

1 Jul 2025 to 18 Jul 2025IndiaUnidentified video tool

Mumbai police say ad agency staff let fraudsters run deepfake videos of a stock market analyst as investment ads; four arrested

Mumbai's West Region cyber police arrested four employees of Valueleaf, a Bengaluru-based digital advertising company, in October 2025, saying they had given Chinese fraudsters access to the company's Meta advertising IDs, which were used to run Facebook and Instagram ads with deepfake videos of stock market analysts and business news anchors. The case began with a complaint from a SEBI-registered research analyst who appears on television and found deepfake videos of himself in the ads; according to the complaint, the videos were created from his appearances on business news channels. Police say viewers who clicked were added to WhatsApp groups offering share tips, invested through fake trading apps, were shown large profits and could not withdraw their money; the deputy commissioner said several people were cheated and several cases registered. A police official said Meta had flagged the videos as deepfakes. Lokmat Times reports that the videos circulated from 1 to 18 July 2025 before Meta removed them. Police say the company received about Rs 3 crore. The four were booked for offences including cheating by personation and forgery and remanded in police custody; they reportedly said they did not know their services were being used for fraud. The analyst is not named in the sources, and how the videos were made is not described.

Core concern Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 5 sources, 1 underlying account · Added 31/10/2026

Event date unknownUnited StatesChoice Home Warranty chatbot

Utah homeowner says home warranty firm's AI chatbot agreed a $3,000 air-conditioner payout, the firm refused it, then paid after a TV inquiry

KSL TV reported on 29 September 2024 that a homeowner in Draper, Utah, asked Choice Home Warranty through its online chat to replace a failing air conditioner. He declined an offer that would have cost him $1,800, asked for the maximum $3,000 payout, and the chat replied that the company would proceed with the $3,000 payout. When the money did not arrive he called, and a company representative told him, by his account, that the firm had had 'this AI' up for about a week and it was miscommunicating to people; the firm refused to pay. After KSL contacted the company, the homeowner said it agreed to honour the offer, and he received the check. The company did not comment to KSL.

Core concern Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 30/10/2026

Event date unknownTaiwan, ChinaUnidentified video tool

Taiwan police say a ring used AI deepfake face videos of at least 55 people in China to pass a digital-yuan app's identity check and take about NT$200 million

Taiwan's Criminal Investigation Bureau said on 2 February 2026 that a fraud-services ring working with offshore scam call centres obtained personal data and photos of people in mainland China and used deepfake technology, which public broadcaster PTS reports as AI, to make face-verification videos of the victims. The videos passed the identity check of China's digital-yuan (e-CNY) app, letting the ring bind the victims' bank accounts and move their savings. Police count at least 55 victims and losses of about NT$200 million. Officers raided the ring's flat in Beitun, Taichung, in November 2024, and its financier was arrested in Thailand and returned to Taiwan; Taichung prosecutors indicted four people for fraud, computer misuse and organised crime. The dates of the individual thefts are not reported.

Core concern High reported severity Criminal Charges

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 30/10/2026

3 Oct 2026Event location unknownTaopiaopiao AI assistant

Taopiaopiao customer says the ticket app's AI support assistant swore back at her over missing refund vouchers; platform later said it had optimised the service

Shenzhen Special Zone Daily and its Dute news app reported on 4 October 2026 that a customer of Taopiaopiao, Alibaba Pictures' cinema-ticket app, said its AI customer-service assistant swore at her. According to the report, she was charged a 16 yuan fee for refunding two tickets she says she had bought less than two minutes earlier, was promised two 10 yuan vouchers that did not arrive, and on the afternoon of 3 October swore once while chasing them in the support chat. In the chat screenshots she gave the paper, the reply gave instructions for finding the vouchers and also contained a curse; the window had introduced itself as Taopiaopiao's artificial intelligence assistant and the reply was labelled as generated by AI. She said she was stunned and that a human agent would not explain it. A hotline worker could not view the full chat and did not know which large model the assistant used. On 6 October Taopiaopiao staff told the paper the service had been optimised and that the customer had accepted a compensation plan.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 30/10/2026

Event date unknownEvent location unknownAirbnb AI Assistant (reported)

Airbnb host says AI support assistant said resubmitted refunds would replace the held one; three refunds totalling £358.63 went to the guest (first-person)

An Airbnb host posted on Reddit (r/airbnb_hosts, 1 June 2026) a transcript of a support chat with Airbnb's AI assistant. According to the post, the host had tried to give guests a goodwill refund of about one night after they reported a cracked bed frame, and the refund showed as on hold with a minimum-not-met message. The transcript shows the assistant saying no refund had been processed and recommending resubmission; when the host asked whether that could send the money twice, it replied that resubmitting would replace the pending request and that duplicate submissions are automatically rejected or overwritten. After two more attempts, including one at the exact nightly rate the assistant suggested, a human support agent said the guest had been refunded three times (£115, £120 and £123.63), that the payments could not be reversed directly, and that the host should file a claim asking the guest to return the excess. The host had wanted to give a single £100 gesture. The post does not report the outcome.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources · Added 30/10/2026

Mar 2021United StatesID.me Face Match

Nevada unemployment claimant says ID.me face check rejected him three times and locked him out, leaving him three weeks without benefits

ID.me, an identity-verification company used by at least 21 US states to check people claiming unemployment benefits, asks claimants to pass a facial recognition step that compares their face with a photo of the same person, such as a driving licence. In June 2021 Motherboard (VICE) reported that a gig economy worker in Las Vegas was suddenly cut off from his unemployment benefits in late March after ID.me failed to identify him. He said that when he held his phone in the instructed position the system rejected him three times without giving a reason and then locked him out. He said he tried ID.me's chat support many times and the state of Nevada sent him back to ID.me; after several weeks he posted a public criticism on Twitter, and the company contacted him and, after several more days, verified his identity. He said he went three weeks without his benefit and could not pay bills. ID.me's chief executive told Motherboard that its Face Match algorithms operate at about 99.9% efficacy, that failures are a problem with how people use the system rather than the technology, and that the company was unaware of eligible people unable to verify their identity. Motherboard said other claimants in several states described similar lockouts; those accounts are not counted here.

Contextual tracker case Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 2 sources · Added 30/10/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.