Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
11
Countries with reported events
2
Located 6 of 11 cases · 5 unknown
Languages in checked sources
2
Recorded for 11 of 11 cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity MediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

11 of 1102 published cases

10 Jul 2024Event location unknownGemini (reported)

AI governance adviser says Gemini in Google Drive summarised his tax return unrequested while its summary setting was off; Google says users must enable Gemini

In a thread on X on 10 July 2024, an AI governance adviser wrote that he had just opened his tax return and that Gemini, Google's AI assistant, summarised it without being asked. He wrote that he could not find a setting to stop it, that the two locations Gemini itself suggested did not work, and that when another user showed him the setting meant to keep Gemini out of his documents it was already turned off while Gemini kept giving document summaries. His later testing, in the same thread, suggested that once Gemini had been opened for one PDF in Google Drive it was invoked again for every PDF he opened until he closed it, and he put forward a working theory that his 2023 sign-up for Workspace Labs had overridden the opt-out. A Google spokesperson told technology outlets that using Gemini in Google Workspace requires a user to enable it proactively and that content is not stored without permission; Tom's Hardware reports that Google suggested he may have used Gemini through the Drive side panel and that closing the panel might solve the issue.

Contextual tracker case Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 01/11/2026

23 Feb 2024United KingdomMetropolitan Police live facial recognition

London: Met Police live facial recognition wrongly matched a man to his watchlisted brother; officers stopped him and he later received a settlement

On 23 February 2024 Shaun Thompson, a London community volunteer whom the 2026 judgment describes as 39, walked past a Metropolitan Police live facial recognition deployment near London Bridge station. The High Court records as not in dispute that the system detected a high level of facial similarity between images of him and the watchlist image of his brother, who was the subject of an outstanding arrest warrant, and generated an alert. According to the court's account, officers stopped, detained and questioned him and made him prove his identity, and when he declined to have his fingerprints taken he was threatened with arrest; he says the experience left him angry and distressed. Officers ended the engagement after checking police records about his brother, and he confirmed his identity with a passport photograph on his phone. Big Brother Watch, whose director was his co-claimant, says he was held for almost 30 minutes despite showing several identity documents. His judicial review claim about the stop, issued in May 2024, was withdrawn under a consent order agreed on 18 December 2024 on terms including a settlement sum paid to him. An amended challenge to the Met's revised live facial recognition policy of September 2024, brought with Big Brother Watch's director, was dismissed by the Divisional Court on 21 April 2026; the court said it was not judging the merits of the technology, and the claimants announced plans to appeal.

Contextual tracker case Medium reported severity Lawsuit Dismissed

AI involvement supported · Causal attribution established · 4 sources, 3 underlying accounts · Added 26/10/2026

Dec 2025 to Aug 2026United StatesPega Voice AI (reported)

U.S. Bank customers allege in a class action that Pega Voice AI transcribed and analysed their customer-service calls without consent

Four U.S. Bank account holders in California, Massachusetts and Pennsylvania allege in a federal class action filed on 2 October 2026 that Pegasystems' Pega Voice AI, which they say U.S. Bank uses in its contact centres, transcribed their customer-service calls in real time, analysed them with natural language processing and generated suggestions to the agent, without their prior consent. They say they gave account numbers, a date of birth and a home address on the calls, made between about December 2025 and August 2026. The claims are allegations; The CourtListener index of the docket, checked on 21 October 2026, listed the summons as returned executed on 16 October and no response from Pegasystems.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 1 source · Added 21/10/2026

18 Oct 2026Event location unknownUnidentified AI transcription tool

Writing-group member says online session host began recording members with AI transcription software without asking; two members objected (first-person)

In a Reddit post on 19 October 2026, a member of an online creative writing group writes that the day before, the group's host started recording the session using AI transcription software without asking. According to the post, a participant noticed the notification and asked him about it, and the poster and that participant told him they were not comfortable with it. The poster says the host seemed embarrassed and said he should have asked first, but also said members had requested it. The poster had earlier told the host and regulars that they had left another group because it used AI transcription software, and describes the group as one where people read out their original work. The post does not name the software or say whether the recording stopped or what happened to it. The account is uncorroborated.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 1 source · Added 20/10/2026

1 Mar 2025 to 18 Nov 2025United StatesFireflies.AI meeting assistant (reported)

Illinois residents allege in lawsuits that Fireflies.AI's meeting assistant captured their voiceprints without notice or consent

Four Illinois residents who say they never had Fireflies accounts allege in four federal lawsuits, two of them later consolidated, that the Fireflies.AI meeting assistant, enabled by a colleague, boss or meeting organiser, recorded their voices in Zoom or Microsoft Teams meetings between March and November 2025, analysed their vocal characteristics to tell speakers apart and generated transcripts attributing statements to them, capturing voiceprints without telling them or obtaining written consent, in breach of the Illinois Biometric Information Privacy Act. One plaintiff dismissed her case without prejudice in March 2026; the California court stayed its case at both parties’ joint request in April 2026; Fireflies has moved to dismiss the consolidated Illinois case and does not concede that it collected biometric data about the plaintiffs.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 6 sources · Added 20/10/2026

Jul 2025United StatesAbridge (reported)

Class action alleges San Diego health system Sharp's Abridge AI scribe recorded a patient's exam-room visit without consent and charted false consent

A proposed class action filed in San Diego Superior Court in late 2025 alleges that Sharp HealthCare, which began using the AI documentation app Abridge in April 2025, recorded doctor-patient conversations without telling patients, sent the audio to the vendor's servers and used it to generate draft medical notes. According to the lawsuit as reported by KPBS, the named plaintiff discovered that a July appointment at a Sharp clinic had been recorded only when he read his medical notes; the clinic apologised, acknowledged the recording and told him the file could stay on the vendor's servers for about a month. The complaint also alleges that Abridge inserted statements into charts that patients had been advised of the recording and had consented, when the plaintiff says that never happened. It seeks damages, corrected medical records and an order against using the tool without consent, and estimates that more than 100,000 patients may have been recorded. Sharp told reporters it could not comment on pending litigation. The allegations have not been tested in court in the sources read.

Contextual tracker case Low reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 17/10/2026

Oct 2026Event location unknownUnidentified AI medical scribe

First-person post: patient says the AI summary of a doctor's appointment listed, among current medications, a drug the patient has never taken

In a Bluesky post on 14 October 2026, a patient says their doctor asked whether they minded his use of AI to summarise the appointment the day before. The patient says they explained their objections and then consented because they wanted to see the summary it generated. When the summary was posted in the patient portal, it listed among the patient's current medications a drug the patient says they do not take and have never taken. In a reply shortly afterwards the patient said the drug had not made its way to the official medication list but was listed in the clinical notes, and that they had messaged the doctor. In an update the next day the patient wrote that they and the doctor agree the medication was likely inserted because the AI took something else the doctor said for the drug's name, and that the doctor tells them the record has been corrected. The AI product, the medication and the summary are not public, and the doctor's own account is known only through the patient.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 15/10/2026

Oct 2026Event location unknownChatGPT (reported)

Patient reports a nurse was already recording with ChatGPT when they declined AI notes

In a public Reddit account, a patient says a nurse asked whether AI could take notes at a medical appointment. After the patient objected, the nurse picked up a phone that the patient described as showing ChatGPT already recording. The patient describes the recording as occurring without prior notice and says their objection was dismissed. In replies, the author says the phone had Chrome open to ChatGPT, that recording had started when the nurse entered the room, before she asked consent, and that the recording was disabled only after the author insisted. This is an uncorroborated first-person account. It does not establish what was captured, whether anything was sent to a server, retained or used for training, or whether a law was broken. The clinic’s location, account type and response are unknown.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 06/10/2026

Mar 2024 to May 2025United StatesOtter Notetaker

United States: seven people who say they had no Otter account allege its AI Notetaker recorded calls without consent; a judge let core privacy claims proceed

Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026

Mar 2026Event location unknownUnidentified AI medical scribe

Reported by ABC News (Australia): an AI scribe used at a urology appointment inserted a false claim that the patient took psychedelic mushrooms into her record; the error reached her GP in a post-operative letter and was corrected only after she complained

A patient who consented to having her first urology appointment transcribed by an artificial-intelligence scribe discovered, after her kidney-stone surgery in March 2026, that the post-operative letter her specialist sent to her GP stated she micro-dosed psychedelic mushrooms and that this could explain earlier bleeding around the kidneys. She says she has never taken mushrooms. She was receiving workers' compensation and feared that any mention of illegal drugs on her medical record could affect her case. After she complained, the urologist sent a letter of apology saying the practice takes documentation accuracy seriously, that she could not determine how the claim came to be included but that it appeared to be an error during the 'dictation or transcription process', that the correspondence had been corrected and that she would review how AI was used in her practice. The doctor did not answer ABC's questions about what changes had been made. Australia's practitioner regulator AHPRA told ABC that clinicians must check all AI-scribe output; the patient says it was clear her doctor had not. The account is a single ABC News report (14 August 2026) based on the patient's interview and the letters she received; the scribe product and the clinic's location are not named.

Contextual tracker case Low reported severity Internal Action

AI involvement reported · Causal attribution alleged · 1 source · Added 20/09/2026

29 Jan 2025United StatesSnapchat content-flagging system

Washington, Illinois: Snapchat flagged a student teacher's private joke to the FBI; she was arrested at her school and lost her placement

On 29 January 2025, a 22-year-old student teacher at a District 50 elementary school in Washington, Illinois, vented in a private Snapchat group chat with her boyfriend and two roommates after a third-grade student turned off her computer mid lesson-plan, asking whether she should 'shoot the child or just the whole school' (per sheriff's reports). Snapchat's systems flagged the message and warned the FBI, which notified the Tazewell County Sheriff's Office at 1:06 p.m. Deputies interviewed her at the school, confirmed she sent it as a joke, searched her phone and belongings with her consent and found no weapons, and arrested her on a disorderly conduct charge; they concluded she had spoken out of 'exasperation' with no intent to harm and no threat to the school. The district told parents she would not return to complete her educational assignment.

Contextual tracker case Medium reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 15/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 18/11/2026. Dataset available under CC BY 4.0.