Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
11
Countries with reported events
2
Located 8 of 11 cases · 3 unknown
Languages in checked sources
2
Recorded for 11 of 11 cases

2 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 2 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity MediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

11 of 1099 published cases

2019Event location unknownSiri

Whistleblower says accidental Siri activations recorded private conversations heard by Apple contract graders; Apple apologised and later settled class suit

On 26 July 2019 the Guardian reported that contractors grading a small share of Siri recordings for Apple regularly heard confidential information. Its anonymous source, a contractor, said Siri was often activated by mistake, for example by the sound of a zip, and that these accidental activations captured private discussions between doctors and patients, business deals, apparently criminal dealings and sexual encounters, with location, contact details and app data attached. Apple told the Guardian that requests were not linked to users' Apple IDs and that less than 1% of daily activations were graded. On 28 August 2019 Apple apologised, said it had suspended human grading, and said audio would no longer be retained by default, grading would become opt-in and recordings found to be inadvertent triggers would be deleted. Device owners' class action, Lopez v. Apple in the federal court in Oakland, alleged that Apple recorded private conversations after unintended Siri activations and disclosed them to third parties. Apple agreed to pay $95 million while denying wrongdoing, and co-class counsel say the judge granted final approval on 16 October 2025.

Contextual tracker case Medium reported severity Lawsuit Settled

AI involvement supported · Causal attribution supported · 4 sources · Added 29/10/2026

2024United StatesGaggle

Lawrence, Kansas: students say Gaggle AI monitoring flagged class photography as child sexual images, leading to questioning and removed work

The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026

23 Feb 2024United KingdomMetropolitan Police live facial recognition

London: Met Police live facial recognition wrongly matched a man to his watchlisted brother; officers stopped him and he later received a settlement

On 23 February 2024 Shaun Thompson, a London community volunteer whom the 2026 judgment describes as 39, walked past a Metropolitan Police live facial recognition deployment near London Bridge station. The High Court records as not in dispute that the system detected a high level of facial similarity between images of him and the watchlist image of his brother, who was the subject of an outstanding arrest warrant, and generated an alert. According to the court's account, officers stopped, detained and questioned him and made him prove his identity, and when he declined to have his fingerprints taken he was threatened with arrest; he says the experience left him angry and distressed. Officers ended the engagement after checking police records about his brother, and he confirmed his identity with a passport photograph on his phone. Big Brother Watch, whose director was his co-claimant, says he was held for almost 30 minutes despite showing several identity documents. His judicial review claim about the stop, issued in May 2024, was withdrawn under a consent order agreed on 18 December 2024 on terms including a settlement sum paid to him. An amended challenge to the Met's revised live facial recognition policy of September 2024, brought with Big Brother Watch's director, was dismissed by the Divisional Court on 21 April 2026; the court said it was not judging the merits of the technology, and the claimants announced plans to appeal.

Contextual tracker case Medium reported severity Lawsuit Dismissed

AI involvement supported · Causal attribution established · 4 sources, 3 underlying accounts · Added 26/10/2026

9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)

Arizona: family says a Gaggle alert on a pupil's unsent joke email led to his suspension; federal court lets their free-speech claim proceed

On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.

Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026

Dec 2025 to Aug 2026United StatesPega Voice AI (reported)

U.S. Bank customers allege in a class action that Pega Voice AI transcribed and analysed their customer-service calls without consent

Four U.S. Bank account holders in California, Massachusetts and Pennsylvania allege in a federal class action filed on 2 October 2026 that Pegasystems' Pega Voice AI, which they say U.S. Bank uses in its contact centres, transcribed their customer-service calls in real time, analysed them with natural language processing and generated suggestions to the agent, without their prior consent. They say they gave account numbers, a date of birth and a home address on the calls, made between about December 2025 and August 2026. The claims are allegations; The CourtListener index of the docket, checked on 21 October 2026, listed the summons as returned executed on 16 October and no response from Pegasystems.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 1 source · Added 21/10/2026

1 Mar 2025 to 18 Nov 2025United StatesFireflies.AI meeting assistant (reported)

Illinois residents allege in lawsuits that Fireflies.AI's meeting assistant captured their voiceprints without notice or consent

Four Illinois residents who say they never had Fireflies accounts allege in four federal lawsuits, two of them later consolidated, that the Fireflies.AI meeting assistant, enabled by a colleague, boss or meeting organiser, recorded their voices in Zoom or Microsoft Teams meetings between March and November 2025, analysed their vocal characteristics to tell speakers apart and generated transcripts attributing statements to them, capturing voiceprints without telling them or obtaining written consent, in breach of the Illinois Biometric Information Privacy Act. One plaintiff dismissed her case without prejudice in March 2026; the California court stayed its case at both parties’ joint request in April 2026; Fireflies has moved to dismiss the consolidated Illinois case and does not concede that it collected biometric data about the plaintiffs.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 6 sources · Added 20/10/2026

Jul 2025United StatesAbridge (reported)

Class action alleges San Diego health system Sharp's Abridge AI scribe recorded a patient's exam-room visit without consent and charted false consent

A proposed class action filed in San Diego Superior Court in late 2025 alleges that Sharp HealthCare, which began using the AI documentation app Abridge in April 2025, recorded doctor-patient conversations without telling patients, sent the audio to the vendor's servers and used it to generate draft medical notes. According to the lawsuit as reported by KPBS, the named plaintiff discovered that a July appointment at a Sharp clinic had been recorded only when he read his medical notes; the clinic apologised, acknowledged the recording and told him the file could stay on the vendor's servers for about a month. The complaint also alleges that Abridge inserted statements into charts that patients had been advised of the recording and had consented, when the plaintiff says that never happened. It seeks damages, corrected medical records and an order against using the tool without consent, and estimates that more than 100,000 patients may have been recorded. Sharp told reporters it could not comment on pending litigation. The allegations have not been tested in court in the sources read.

Contextual tracker case Low reported severity Lawsuit Filed

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 17/10/2026

Aug 2026Event location unknownGoogle AI Mode

German court bars Google from repeating an AI Mode answer that falsely called a doctor a convicted sex offender

In late August 2026 a colleague told a German physician, until that summer a chief physician at a hospital, that searching his name with the word for suspension in Google's AI Mode produced what read like a factual report: that he had been suspended and dismissed and had received a suspended sentence for sexual coercion. According to legal news site beck-aktuell, none of it concerned him; the AI had apparently attached facts about another former senior employee of the same hospital to his name, and the newspaper articles it linked as sources did not name him. Google said it had reviewed his complaint and would take no action, and a lawyer's warning letter also failed. On 24 September 2026 the Aachen Regional Court issued a preliminary injunction (8 O 268/26) barring Google Ireland Limited from spreading the claims through AI Mode, finding that they violated his personality rights and that Google is responsible for its AI search answers.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 15/10/2026

17 Sept 2023United StatesUnidentified facial recognition system

Reno casino's facial recognition wrongly matched a patron to a barred man and police jailed him for about eleven hours, his federal lawsuit alleges

Jason Killinger, a UPS truck driver, alleges in a federal civil-rights complaint filed in July 2025 that on 17 September 2023 the Peppermill Casino in Reno reported to police that its AI facial recognition software had identified him as a man barred from the casino months earlier. According to the complaint, casino security handcuffed him, and the responding Reno police officer, told the system had found a 100 percent match, did not examine his other identification and took him to jail as an unidentified person, where fingerprints confirmed who he was. The complaint says he was handcuffed for about four hours, starting in the casino security office, spent about eleven hours in police and jail custody, and was treated the next day for bruised wrists. According to the complaint, he was then charged with trespassing, and a prosecutor dismissed the charge without prejudice at the bench trial. Casino.org reports that he settled a suit against the casino. In March 2026 the court let him add the City of Reno and a municipal liability claim over facial recognition policies, but refused a new wrongful arrest claim against the officer on qualified immunity grounds. In September 2026 the ACLU, the ACLU of Nevada and the Innocence Project filed a proposed amicus brief supporting him. His September 2026 motion for partial summary judgment says a Reno police detective later concluded that the match was wrong and that he and the barred man were different people, and it cites a declaration by a former casino security officer, who worked there from about October 2024, that the system often alerted at 100 percent on the wrong people; in a declaration reported by Casino.org, the officer said he had never known the system to misidentify anyone. The case is ongoing.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 9 sources, 3 underlying accounts · Added 04/10/2026

Mar 2024 to May 2025United StatesOtter Notetaker

United States: seven people who say they had no Otter account allege its AI Notetaker recorded calls without consent; a judge let core privacy claims proceed

Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026

24 May 2025 to 27 Jun 2025Event location unknownGoogle AI Overviews

Keene v. Google: defamation claim over AI Overviews calling an author a convicted murderer survives dismissal

An author and television producer, the subject of the Apple TV series 'Black Bird', sued Google, alleging that AI Overviews shown for searches about him in May and June 2025 falsely said he was serving a life sentence without parole, in one version for the murders of three women. He says he notified Google three times and received apologies attributing the statements to its AI, yet similar statements kept appearing. On 14 September 2026 the Northern District of Illinois denied Google's motion to dismiss as to two of the four challenged Overviews and dismissed the other two without prejudice. This was a ruling on the pleadings, not a finding that the allegations were proven.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement supported · Causal attribution alleged · 4 sources, 1 underlying account · Added 15/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.