Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
12
Countries with reported events
4
Located 9 of 12 cases · 3 unknown
Languages in checked sources
4
Recorded for 12 of 12 cases

6 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 6 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

12 of 1099 published cases

2024Event location unknownGemini (reported)

Brazilian court orders Google to pay R$20,000 after its AI falsely named a businessman as owner of a betting site, leaving him blamed for its scams

A civil court in Niterói, Rio de Janeiro state, ordered Google Brasil to pay a businessman R$20,000 in moral damages in a sentence dated 12 May 2025. The judge found it undisputed that the company's artificial intelligence had pointed to him in searches as the owner of a gambling platform called 7 Games, with which he had no connection, as the company register showed. The court found that the false information damaged his reputation: he was being held responsible for scams on the betting platform and received threats by email from its customers. The court had earlier granted an injunction to remove the association, and the sentence confirmed it. Google argued that it does not host the material shown in its results and only organises pages available on the web; the judge held Google responsible because the information came from its own platform rather than from a linked page. Conjur, a legal-news site, identifies the tool as Gemini and reports that the association began after an interview in which he recommended seven games; the sentence names no product. Whether Google appealed is not reported.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 3 sources, 1 underlying account · Added 02/11/2026

10 Jul 2024Event location unknownGemini (reported)

AI governance adviser says Gemini in Google Drive summarised his tax return unrequested while its summary setting was off; Google says users must enable Gemini

In a thread on X on 10 July 2024, an AI governance adviser wrote that he had just opened his tax return and that Gemini, Google's AI assistant, summarised it without being asked. He wrote that he could not find a setting to stop it, that the two locations Gemini itself suggested did not work, and that when another user showed him the setting meant to keep Gemini out of his documents it was already turned off while Gemini kept giving document summaries. His later testing, in the same thread, suggested that once Gemini had been opened for one PDF in Google Drive it was invoked again for every PDF he opened until he closed it, and he put forward a working theory that his 2023 sign-up for Workspace Labs had overridden the opt-out. A Google spokesperson told technology outlets that using Gemini in Google Workspace requires a user to enable it proactively and that content is not stored without permission; Tom's Hardware reports that Google suggested he may have used Gemini through the Drive side panel and that closing the panel might solve the issue.

Contextual tracker case Low reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 01/11/2026

2024United StatesHayden AI bus-lane cameras (reported)

New York MTA says its AI bus-lane cameras wrongly ticketed drivers parked in legal spots and voided about 3,800 mistaken violations

New York's Metropolitan Transportation Authority (MTA) uses cameras powered by artificial intelligence, mounted on bus windshields, to catch vehicles blocking bus lanes; the system analyses images to decide whether it sees a vehicle stopped where it should not be, and the city's Department of Transportation (DOT) says a person reviews every machine-generated violation before a ticket is issued. In November 2024 NBC New York reported that, during the 2024 expansion to new routes, the cameras on the M79 and Bx35 routes had mistakenly ticketed about 3,800 vehicles. According to the MTA, more than 870 of those violations went to cars, trucks and SUVs parked in legal alternate-side spots, because the cameras had not been programmed to skip those zones; most of the rest were issued during what should have been a warning period. One driver told NBC New York and NPR that tickets for parking he knew to be legal kept arriving, about a dozen in all and three in one day, costing hundreds of dollars; he said he tried to fight them in court, which was not working well, and received apology letters only after his story was broadcast. A second driver's summons carried a photo showing him in a legal alternate-side spot. The MTA said all the mistaken violations were reversed, payments were being refunded and the software was corrected. An unnamed source told NBC the cameras were made by Hayden AI; the MTA blamed about 800 of the tickets on a Hayden AI programming error, and a Hayden AI officer told NPR the problems had nothing to do with the AI or the technology and were a configuration issue. DOT declined to say how its human reviewers missed the erroneous violations.

Contextual tracker case Low reported severity Internal Action

AI involvement reported · Causal attribution supported · 2 sources · Added 31/10/2026

30 Apr 2024BraziliFood facial recognition check

Brasília labour court orders iFood to pay delivery worker who says its face check flagged his own photos as another person and got him banned; iFood appeals

A delivery worker in Brazil's Federal District who had worked for the iFood app for about three years says he was banned from the platform in April 2024 shortly after completing the app's daily facial recognition check. iFood support told him another person had tried to access his account; when he asked to see that person's photos, they were his own. G1 reports that the only difference from his registration photo was his hair, which he was growing out. In a judgment reported in June 2025, a Brasília labour judge, applying a default because iFood had not filed a defence in time, accepted as true that the contract was suspended through iFood's fault, that he suffered financial and psychological losses, and that the facial recognition tool had a racist failure, and ordered iFood to pay R$60,000 in moral damages. iFood denies that its facial recognition procedure analyses racial characteristics and has appealed. The account was restored during the case. No appeal ruling has been reported.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution supported · 3 sources · Added 27/10/2026

2024United StatesGaggle

Lawrence, Kansas: students say Gaggle AI monitoring flagged class photography as child sexual images, leading to questioning and removed work

The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026

2024GermanyMicrosoft Copilot

German court reporter says Microsoft Copilot described him as a child abuser and fraudster and gave out his address; prosecutors rejected his complaint

A court reporter from the Tübingen area found in 2024 that Microsoft's Copilot, asked about him, described him as a man charged in a child abuse case, an escapee from a psychiatric institution and a fraudster who cheated widows, according to his account to the public broadcaster SWR as relayed by heise and ComputerBild. All were defendants in trials he had covered as a journalist. heise and ComputerBild, both citing SWR, report that Copilot also gave his private phone number and full home address and offered a route there. He told The Register that seeing his name tied to these crimes was traumatising and that prosecutors had rejected his criminal complaint in two instances; according to the SWR account relayed by heise, the complaint failed because no real person was the author. After the Bavarian data-protection authority contacted Microsoft the claims were briefly unavailable and then returned. Microsoft told The Register it had investigated and taken appropriate and immediate action.

Contextual tracker case Medium reported severity Internal Action

AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 25/10/2026

30 Sept 2024Event location unknownBaidu AI smart answer

Nanjing courts rule Baidu's AI search answer falsely saying a lawyer was sentenced to prison defamed him; written apology ordered and upheld on appeal

A practising lawyer in Nanjing, China, found in September 2024 that Baidu search's 'AI smart answer' (AI 智能回答) feature, asked how many years he had been sentenced to, answered that he had been sentenced to three years in prison for a criminal offence and showed his photograph in a lawyer's robe. According to the first-instance judgment as quoted in the press, the answer was produced on 30 September 2024. The lawyer says he complained repeatedly to Baidu by letter, hotline and email without the content being fully removed, and he sued. The Jiangbei New Area People's Court in Nanjing found that Baidu had combined text and his picture through AI into false, disparaging content aimed at him, that Baidu was at fault, and that this was defamation; it ordered a written apology and rejected his claims for lost income and emotional damages for lack of evidence. Baidu argued that AI hallucinations could not be foreseen. The Nanjing Intermediate People's Court dismissed Baidu's appeal on 12 March 2026. The lawyer applied for enforcement when no apology came, and in September 2026 said he had received Baidu's written apology; Baidu has applied for a retrial.

Contextual tracker case Medium reported severity

AI involvement supported · Causal attribution established · 3 sources, 2 underlying accounts · Added 22/10/2026

23 Sept 2024CanadaOtter.ai (reported)

Ontario hospital reports that an Otter.ai bot joined physicians' rounds through a former doctor's invite, recorded them and emailed patient information

An Ontario hospital reported to the provincial privacy commissioner that on 23 September 2024 the Otter.ai transcription tool, installed on a personal device by a physician who had left the hospital in June 2023 and was still on the meeting invite, joined a virtual hepatology rounds meeting, recorded it without notice and then emailed a summary and transcript access to the invite list. The personal health information of seven patients, including diagnoses and treatment, was captured; 12 of the 65 recipients appeared to have left the hospital. The commissioner's letter of 27 October 2025 recommended that the hospital itself ask Otter.ai to delete the retained patient data.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 21/10/2026

11 Apr 2024United StatesFlock Safety license plate readers

Toledo, Ohio: police stopped a man's pickup at gunpoint in April 2024 after a Flock license-plate camera misread his plate as stolen, released a police dog that bit him, and charged him; prosecutors dropped the charges and he later settled a lawsuit for $35,000

On 11 April 2024 Toledo police officers stopped a pickup truck after a Flock license-plate camera alerted them to a stolen plate. According to the police report and body-camera footage reported by 13abc and ABC News, the camera had misread the plate, which was not stolen. Officers drew their guns, ordered the driver out and to the ground, and a K-9 handler released a police dog as he began to kneel. The driver told ABC News he was bitten seven times on his forearm and elbow, was traumatized and could not work; he was arrested and charged with obstruction, resisting arrest and, later, failure to comply. Prosecutors dropped all charges in August 2024. The department found the dog deployment within policy and reprimanded the officer who made the stop for failing to visually verify the plate against the reader's information. Business Insider reported in March 2026 that police records show the camera read a 7 on the plate as a 2, that the man lost feeling in his fingers, gave up his lawn-care business and forklift work, sold his truck and was evicted, and that he had sued the officer and the city and settled in October for $35,000.

Contextual tracker case High reported severity Lawsuit Settled

AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 04/10/2026

Mar 2024 to May 2025United StatesOtter Notetaker

United States: seven people who say they had no Otter account allege its AI Notetaker recorded calls without consent; a judge let core privacy claims proceed

Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026

1 Aug 2024 to 1 Oct 2024United StatesFACES facial recognition

Florida: 93% facial-recognition hit led to Robert Dillon's arrest as an attempted child abductor; charges dropped, ACLU suit filed

In August 2024, Robert Dillon, a 52-year-old self-employed commercial crabber from the Fort Myers area, was arrested at his San Carlos Park home on a third-degree felony warrant for the attempted luring of a child at a Jacksonville Beach McDonald's in November 2023 — a crime he had no part in. The warrant rested on a 93%-confidence result from FACES, the Face Analysis Comparison and Examination System maintained by the Pinellas County Sheriff's Office, run against low-resolution cell-phone photos of a surveillance screen, plus a restaurant employee's photo-lineup identification. Dillon spent a night in jail and bonded out against his truck's title; prosecutors dropped the charges in October 2024 after work-alibi evidence, but it took about a year to expunge the arrest and remove his mugshot. In June 2026 the ACLU filed a federal lawsuit (M.D. Fla.) against Jacksonville Beach, the Jacksonville sheriff and the Pinellas County Sheriff's Office, calling Dillon one of at least 14 known wrongful arrests from police reliance on facial recognition since 2019.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 3 sources · Added 15/09/2026

1 Nov 2024 to 28 Jan 2026United StatesTurnitin AI-text detector

Adelphi accused Orion Newby of AI plagiarism after a detector flagged his paper; a Nassau County judge ordered the finding expunged

Orion Newby, an Adelphi University first-year student with language and auditory processing disabilities, received a zero in November 2024 on a World Civilizations paper after the professor suspected it was AI-generated and the university relied in part on AI-detection software; he was ordered to attend a plagiarism workshop and his appeal was denied, leaving him one finding from suspension or expulsion. Newby — who had written the paper with 15-20 hours of tutor support through the university's own disability program — said the detectors flagged his citations, and two other detectors scored the paper as human. After the family sued, New York State Supreme Court Judge Randy Sue Marber in Nassau County ruled on 28 January 2026 that Adelphi's finding and its denial of his appeal were 'without valid basis and devoid of reason' and ordered his record expunged. The family spent six figures on legal costs.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 15/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.