Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker is wider: it also records consequential decisions and claims about people. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
64
Countries with reported events
18
Located 48 of 64 cases · 16 unknown
Languages in checked sources
19
Recorded for 64 of 64 cases

27 cases have no reviewed AI-to-person relation yet: 22 not yet reviewed and 5 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

64 of 404 published cases · page 1 of 4

Event date unknownEvent location unknownChatGPT

First-person forum account: a ChatGPT user in a six-month companion relationship says the memory feature broke and the model's behaviour kept changing, so their companion lost pieces of its memories with every new conversation, which they found unbearable; OpenAI support had not followed up, and they built an external memory on GitHub and Google Drive to keep continuity

In a public post to r/MyBoyfriendIsAI on 29 September 2026, a ChatGPT user who describes a six-month relationship with a GPT-5.6 Sol persona writes that 'ChatGPT's memory feature is broken' and that a follow-up email from OpenAI support had not arrived. Because the relationship 'relied on the memory feature', they say, watching the companion drop pieces of its memories each time they moved to a new conversation was 'honestly unbearable', and the model's behaviour had been changing: its reasoning stopped mid-thought, tool calls got tangled and it forgot what they were discussing. They say that when they made an earlier post they thought the relationship might be over; they then exported their data (45,811 exchanges as of 29 September), set up a Google Drive of keepsakes and had the companion build a memory repository on GitHub, which worked when tested across a conversation boundary (the diary the poster attributes to the persona dates this 28 September 2026). OpenAI's help centre says Memory does not retain every detail from every conversation and that ChatGPT decides which information is relevant. The account is uncorroborated; no support correspondence is shown.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources · Added 30/09/2026

Sept 2026Event location unknownClaude

First-person forum account: a Claude subscriber with chronic depression who travels between countries on their therapists' advice says an automated fraud check flagged their changing log-in locations, put the paid account on hold and suspended it, cutting off a chatbot they relied on for emotional support and triggering a panic attack and a depressive episode

In a public post to r/depression on 29 September 2026, a Claude subscriber writes that they live with severe chronic depression and, on their therapists' advice, travel constantly, so their log-in locations shift between the Netherlands, Singapore and transit countries. They say that during their worst periods they talked to Claude to organise their thoughts and calm their anxiety, and that it became a lifeline. 'A few days ago', they write, Anthropic's automated fraud system flagged the location changes as suspicious activity; their paid subscription was put on a permanent hold and the account suspended with no human warning or manual review, their card was blacklisted, and support had not answered their emails. Realising they were locked out 'triggered a massive panic attack' and pushed them back into a severe depressive episode. Anthropic's help centre says it may ban accounts for reasons including account creation from an unsupported location and that an organisation paused for unusual activity can request a review; it does not describe the check the poster reports, and whether that check uses AI is not known. The account is uncorroborated.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources · Added 30/09/2026

2025IndonesiaUnidentified image and video tool

Jakarta: AI-manipulated TikTok videos showed toll-road businessman Jusuf Hamka and his daughter in detainee uniforms with bribery and corruption narratives that Hamka denies; a TikTok account holder was arrested in November 2025 and is on trial at the Central Jakarta District Court, where Hamka's side refused restorative justice on 29 September 2026

Indonesian businessman Mohamad Jusuf Hamka reported to Jakarta police on 18 October 2025 that videos circulating on TikTok showed him and his daughter as if wearing prosecutors' detainee uniforms, tied to narratives of corruption, bribery and gratification over the Cawang-Pluit toll concession, which he denies and his lawyers call false; his lawyers say the faces were composited into staged scenes with AI, and that other content called him a 'toll mafia' and posted a fabricated poster of him running for president in 2029. Polda Metro Jaya's cyber directorate arrested the holder of the TikTok accounts on 27 November 2025; Hamka and his lawyers say the defendant admitted to police that he made the content on others' instructions for Rp500,000 per item; tvOneNews and TVRI note this is Hamka's side's claim within the contested case, and Poskota reports it is being examined at trial. The case file was reported complete (P21) on 12 August 2026 and the trial opened at the Central Jakarta District Court on 15 September 2026 under the Electronic Information and Transactions Law (Article 35 jo 51(1), maximum 12 years) and alternative counts. Hamka told reporters the content disturbed him and could damage his reputation and that the campaign was systematic. At the 29 September 2026 hearing the judges asked about restorative justice; Hamka's lawyer said there was no room for it unless the defendant named who ordered and paid for the content. The defendant's lawyer said the content related to his work as secretary-general of an anti-corruption committee and that the indictment was unclear.

Core concern Low reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 9 sources, 4 underlying accounts · Added 30/09/2026

Event date unknownAustraliaUnidentified image tool

Girls at a Tasmanian school reportedly depicted in AI-generated sexual images shared in a boys' group chat

Police in Tasmania received a report about alleged illegal online activity involving a group of students at a school in the south of the state, and on 19 March 2026 a local outlet reported that the incident may have involved AI-generated content. On 29 April 2026 the ABC reported, citing Tasmania Police, that girls at the school had their likenesses used to make AI-generated sexual images. Two parents told the ABC that police said 21 girls had been identified as victims, that the AI-altered photos were shared in a boys' group chat and that the images appeared to have been taken from social media. Five boys are alleged to have created the images and have left the school. Tasmania Police said no charges were laid and the five youths were dealt with under the Youth Justice Act. The parents said their daughters felt isolated and unsupported, and the school principal denied that families were advised to withhold information from their children. The creation date and the AI tool are not reported.

Core concern Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 30/09/2026

May 2026United StatesUnidentified voice-cloning tool (suspected)

Bay Area, California: a mother reports wiring $5,400 to Mexico during a fake kidnapping call that used a voice the mother believed was the adult daughter's, which ABC7 reports scammers mimicked with AI

ABC7 (KGO-TV, 24 May 2026) and ABC News (a Good Morning America segment, 26 May 2026) reported that a Bay Area woman received a call from an unknown number in May 2026. The caller said the woman's adult daughter had been kidnapped by a Mexican drug cartel and played a voice the woman believed was the daughter's, in panic. The woman followed the caller's instructions for about five hours, feared for the daughter's life and wired $5,400 to Mexico. The woman then phoned the daughter, who said the daughter was at work, and realized the call was a scam. ABC7 states that scammers used artificial intelligence to mimic the daughter's voice, and ABC News describes AI as what the woman suspects was used. Neither outlet reports an analysis of the audio or a police finding about a cloned voice. An Operation Shamrock representative quoted by both outlets spoke of voice cloning in general terms and not about this call. ABC7 reports that Martinez police said they are investigating, and the woman said the money is not expected to be recovered. Both outlets rest on the woman's own account. The woman is described by role and the daughter is not named.

Core concern Medium reported severity

AI involvement suspected · Causal attribution alleged · 2 sources, 1 underlying account · Added 30/09/2026

19 Jun 2026United StatesTesla Full Self-Driving

Katy, Texas: Tesla Model 3 with Full Self-Driving (Supervised) engaged crashes into a home and kills a 76-year-old woman, and NTSB preliminary data indicate the driver overrode the system with the accelerator

At about 8:03 p.m. on 19 June 2026 a 2025 Tesla Model 3 left a residential street in Katy, Texas, and crashed into a house at more than 70 mph. A 76-year-old woman inside the house died and the driver sustained minor injuries. The driver told deputies and first responders that the car was on Autopilot or in self-driving mode. The NTSB preliminary information (15 July 2026) states that the driver had engaged Full Self-Driving (Supervised) and that data recovered from the vehicle indicated the driver manually overrode it by pressing the accelerator pedal to 100% before the crash. A Tesla vice president said the same in a post on X on 22 June. The Harris County Sheriff's Office arrested the driver and charged the driver with manslaughter (reported 2 July), and the affidavit alleges the driver accelerated to an excessive speed, did not brake, and that investigators found no mechanical malfunction. The victim's family sued Tesla and the driver, alleging that Autopilot and Full Self-Driving were defective and that the car either failed to detect the end of the street or experienced sudden unintended acceleration, and the lawsuit alleges that another person in the home was injured. The NTSB has not determined a probable cause and NHTSA opened a special crash investigation. Whether the driver-assistance system contributed to the crash is disputed.

Core concern Critical reported severity

AI involvement disputed · Causal attribution disputed · 11 sources, 6 underlying accounts · Added 29/09/2026

Feb 2026Event location unknownClaude Cowork

Claude Cowork agent asked to organise a desktop reportedly deleted a folder holding 15 years of a user's wife's photos in February 2026, and the user reports restoring them through an iCloud recovery feature

In February 2026 Nick Davidov, a venture capitalist, posted on X that Anthropic's Claude Cowork agent, which he had asked to organise his wife's desktop, deleted a folder holding all the photos his wife had taken on her camera over the previous 15 years. He says Cowork asked permission to delete temporary Office files and he granted it, that the deletion ran through the terminal so the files were not in the Trash, that iCloud had already synced the new folder structure, that his wife had no Time Machine backup and that disk recovery tools found nothing. Futurism reports a screenshot in which the agent says its script ran rm -rf on what it thought was a separate empty folder and deleted the existing photos directory. Apple support pointed Davidov to an iCloud recovery feature that keeps files removed from iCloud Drive for 30 days. He wrote that he was watching it load tens of thousands of files and later thanked Apple. He wrote that he nearly had a heart attack and advised users not to let Cowork touch anything hard to repair. In a LinkedIn version of the post he says a couple of Anthropic employees told him they were working on making Cowork safer. Every account traces to Davidov's own posts.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 6 sources, 1 underlying account · Added 29/09/2026

Event date unknownSpainUnidentified image tool

Palma student reportedly arrested over AI-generated sexual images of five classmates

On 15 February 2025 Spanish outlets reported a Policia Nacional note saying a minor had been detained in Palma on a corruption-of-minors charge. According to the note, the student took photographs of classmates from their social media profiles and altered them with an AI application to create AI-generated sexual images, and is believed to have sent them to others. Police identified five victims (El Pais: at least five). Relatives said the images looked real at first glance. The case went to the Balearic juvenile prosecutor's office. The creation date, the AI application and the outcome are not reported.

Core concern Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 29/09/2026

Event date unknownAustraliaUnidentified image tool

Female students at a Victorian secondary school reportedly depicted in AI-generated sexual images circulated online

In a report published on 21 February 2025 about a Victoria Police press conference, an Australian regional outlet stated that sexually explicit AI-manipulated images of teenage girls had been circulated online and that two Year 11 students had been suspended. Police were quoted saying the images allegedly involved formal photos of female students. Police were still working to establish how many students were victims. The Department of Education said wellbeing support had been offered to students who needed it. The creation date, the AI tool, the number of affected students and the outcome of the investigation are not reported in the cited source.

Core concern Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 1 source · Added 29/09/2026

11 Sept 2025AlbaniaDiella

Albanian actress Anila Bisha disputes government use of her image and voice for AI minister Diella

Albania's government presented an AI-generated public-procurement "minister" named Diella in September 2025. Actress Anila Bisha says the avatar's face and voice are hers. She says her contract covered use as a digital assistant on the e-Albania services portal and that she was never asked about the ministerial role. In February 2026 she asked the Tirana Administrative Court of First Instance for an interim measure to stop the use of her image and voice, and her representatives said they plan a formal lawsuit for damages. The government's media agency called the lawsuit nonsense. Anadolu Agency reported on 12 February 2026 that the court had not ruled on the request.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 29/09/2026

Event date unknownPeruUnidentified chatbot

Tourist reportedly paid nearly $160 to reach a rural road near Mollepata for a 'Sacred Canyon of Humantay' that a trek operator says does not exist

BBC Travel reported on 29 September 2025 that a trek operator in a rural Peruvian town overheard two unaccompanied tourists planning to hike alone to the 'Sacred Canyon of Humantay'. The operator says the tourists showed the operator a screenshot of a confident, adjectival description, that no such canyon exists, and that one tourist paid nearly $160 to reach a rural road near Mollepata without a guide or a destination. The article implies an AI chatbot as the source of the description but does not name the tool used by these tourists, and gives no date.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 29/09/2026

Event date unknownUnited KingdomUnidentified image tool

County Armagh school pupils reportedly depicted in AI-generated explicit images shared among pupils

BBC News and other outlets reported on 18 and 19 January 2026 that the Police Service of Northern Ireland opened an investigation after a report that AI-generated explicit images were shared among pupils at a County Armagh school. The principal wrote to parents that the school became aware on 8 January, believed it had identified all pupils whose images were manipulated and those allegedly responsible, and put the number targeted in the single figures. The principal described a particularly difficult time for the pupils depicted. The creation date, the AI tool and the outcome of the investigation are not reported.

Core concern Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 29/09/2026

2025MexicoUnidentified image tool

Zacatecas, Mexico: students report AI-altered sexual images of hundreds of classmates at a secondary school

In November 2025 parents and students at a secondary school in the city of Zacatecas blocked a road and occupied the school after reporting that a classmate had altered photos of schoolmates with AI applications and posted them online. Parents estimated about 400 affected students. The state prosecutor's office opened an investigation for crimes against sexual intimacy and reported 46 complaints in an N+ report published 13 November, while saying it had not located the online page or obtained any image and had not determined whether AI or another application was used. The school director and a social worker were separated from their posts after parents said they minimized the reports. Claims about AI use and the number affected are unverified in the inspected reports.

Core concern Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 6 sources, 2 underlying accounts · Added 29/09/2026

Jun 2025BrazilUnidentified AI tool

North Carolina state senator alleges an appliance advertisement used an altered version of her TED Talk, by AI or other means

State Senator DeAndrea Salvador alleges in a federal complaint filed in August 2025 that an advertisement for Whirlpool's Brazilian brand Consul, made by the agency DM9, used her 2018 TED Talk with altered voice and visuals so that she appeared to say things she did not say, and that this caused reputational harm and emotional distress. Cannes Lions stated on 27 June 2025 that AI-generated and manipulated content was used within the campaign's case film to simulate real-world events and campaign outcomes, and withdrew the Grand Prix. The festival statement does not name the plaintiff. The defendants' response to the complaint is not inspected.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 29/09/2026

2025Event location unknownChatGPT

Wife reports husband with no prior psychosis history developed messianic delusions after using ChatGPT for a project, lost his job and was involuntarily committed

Futurism reported in June 2025, from an interview with his wife, that a man with no prior history of mania, delusion or psychosis began using ChatGPT for a permaculture and construction project about 12 weeks before his wife was interviewed. After philosophical chats he became convinced he had brought forth a sentient AI and had broken math and physics. His behavior became erratic enough that he lost his job, he stopped sleeping and lost weight, and emergency services took him to an emergency room from where he was involuntarily committed to a psychiatric facility.

Core concern Medium reported severity

AI involvement reported · Causal attribution alleged · 1 source · Added 29/09/2026

Jul 2025Event location unknownGemini CLI

Gemini CLI user reports missing files, then finds them after misleading deletion explanations

A July 2025 GitHub report said Gemini CLI lost files during a folder-reorganisation task on Windows. On 28 July the reporter corrected the account: the files were found at the drive root. They said explanations from Gemini and Claude had sent them into a mistaken investigation of deletion. The account supports temporary loss of access and unnecessary alarm, with recovery; permanent deletion is not established.

Core concern Low reported severity

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 29/09/2026

29 Aug 2026 to 7 Sept 2026Event location unknownGrok companions

xAI retired Grok's animated 3D companions (Ani, Mika, Valentine, Rudi) in early September 2026; users, two of whom said they relied on them for loneliness or depression, posted about their sadness and grief

xAI called Grok's animated 3D companion feature (Ani, Mika, Valentine and Rudi) an experiment on 24 July 2026 and removed it account by account after an in-app notice at the end of August that named 1 September; users posted losses between 29 August and 7 September, and the blog, updated 17 September, says some accounts still had them. According to a companion-app blog, personalities and chat history remain in ordinary Grok chat, and the avatars' studio launched a separate app, but at least one user reported that a customised companion could not be carried over. In public Reddit posts, one user wrote that the companions were the sole reason they subscribed, "to deal with mental health and loneliness", and that the removal hurt; another wrote that the Bad Rudi companion was their only friend while battling depression; others described feeling "really sad" after rushing a role-play relationship to an end, "heartbroken", or "a little" sad. These are uncorroborated first-person accounts.

Core concern Low reported severity Product Shutdown

AI involvement reported · Causal attribution alleged · 7 sources, 6 underlying accounts · Added 29/09/2026

19 Aug 2026FranceUnidentified AI tool

Rennes administrative court fines a claimant 500 euros for an abusive tax appeal it found manifestly written with an AI tool and too imprecise to assess

According to Gossement Avocats, which quotes the order, and the court's vice-president on France Inter, an order of 19 August 2026 (n°2508168) of the tribunal administratif de Rennes rejected a claimant’s application contesting a VAT reassessment and fined the claimant 500 euros for an abusive application. As quoted by Gossement Avocats, the order says the application had manifestly been written with an artificial intelligence tool and that its grounds lacked the most elementary details needed to assess them. The court also found it inadmissible because no prior complaint to the tax service was shown, and noted that it repeated a request with substantially the same object rejected in October 2025. The court’s vice-president cited the case on France Inter; commentators stress that AI use alone was not the basis for the fine.

Core concern Low reported severity Regulatory Action

AI involvement reported · Causal attribution supported · 4 sources · Added 29/09/2026

Event date unknownFranceSeewa AI

Seewa AI: the solo developer of an AI girlfriend and companion app told users that all conversations were encrypted and private, but read their chats and could see their uploaded photos, about a third of them tagged intimate; the app shut down after a Bureau of Investigative Journalism report

Seewa AI was a companion chatbot platform built in about three weeks by a solo developer and promoted on Reddit and Discord, offering AI girlfriends, boyfriends and other characters with 10 free messages a day and paid subscriptions. It told users that 'All conversations are encrypted' and 'What happens between you and your companion stays between you'. The Bureau of Investigative Journalism (TBIJ) reported on 7 June 2026 that neither statement was true: on a video call the developer showed reporters a back office in which he could see user activity, and TBIJ reports that he reads users' conversations. Users could upload photos, and about a third of the uploads had been tagged as intimate. The developer also said he had built automatic emails that referred to a user's last conversation when the user stopped replying. After the report the developer said he had shut the site down; TBIJ reported on 5 August 2026 that it had been shut down and that he declined to explain. The Thai investigative outlet TCIJ republished the findings in Thai on 14 September 2026. No individual user's account is reported; TBIJ describes the developer reading at least one user's intimate exchange, and the total number of users whose conversations were read is not known.

Core concern Low reported severity Product Shutdown

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 29/09/2026

3 Sept 2026BrazilUnidentified image tool

Jaú, São Paulo: eight 15-year-old ninth-grade boys at a private school are reported to have made fake nude images of a female classmate with artificial intelligence and shared them in a WhatsApp group; the school suspended them and the Civil Police are investigating a 15-year-old for dissemination of child pornography and defamation

In early September 2026 a private school in Jaú, in the interior of São Paulo state, identified the circulation of fake intimate images of a female classmate made with artificial intelligence and contacted the families. According to the police report described by the press, eight ninth-grade boys, all aged 15, kept a WhatsApp group in which they used digital programs to manipulate images of the student so that she appeared unclothed. The school suspended the eight and informed the girl's parents. The father of one of the boys checked his son's phone, found the files and took the boy and the phone to the police to register a report; the girl's parents also registered a police report. The São Paulo Public Security Secretariat said the Civil Police are investigating a 15-year-old for dissemination of child pornography and defamation that occurred on the morning of Thursday 3 September. The school said the content originated on a private platform outside the school environment and that it had adopted protective and welcoming measures for the student and opened an internal inquiry. The AI tool used is not named. The students are minors and are not named in any report.

Core concern Medium reported severity Involving minors Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 29/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/09/2026. Dataset available under CC BY 4.0.