Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker also records consequential decisions, claims and privacy harms involving AI. Each case needs a described connection between AI use and the harm, including private information recorded into or disclosed to an AI service. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
74
Countries with reported events
6
Located 60 of 74 cases · 14 unknown
Languages in checked sources
11
Recorded for 74 of 74 cases

8 cases have no reviewed AI-to-person relation yet: 0 not yet reviewed and 8 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity CriticalHighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

74 of 1099 published cases · page 1 of 4

1 May 2021BrazilUnidentified death-record matching system

Brazilian federal judge finds an INSS AI death-record match wrongly ended a living retiree's pension, his only income, and awards damages

A Brazilian federal judge in the 4th federal region ordered the social security institute (INSS) to pay a retiree R$3,917.67 in moral damages after finding that his pension had been stopped by a failure of the institute's artificial intelligence system, according to a Federal Regional Court of the 4th Region (TRF4) news item relayed by the Brazilian Institute of Social Security Law on 30 September 2022. The judge explained that the benefit was suspended automatically on 1 May 2021 by an artificial intelligence command that captured data from the death-records system (Sisobi), and that the data used, the person's name and mother's name, were not enough to prevent the wrongful cessation. The retiree said the pension was his only source of income; he asked for reactivation and sent a handwritten declaration, and although he showed in person that he was alive, the benefit was restored only in January 2022. The judge wrote that the AI 'proved inefficient or unintelligent' in this case and that the INSS made him wait 226 days. Arrears were also ordered paid. Whether the INSS appealed is not reported.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement supported · Causal attribution established · 2 sources, 1 underlying account · Added 02/11/2026

Jan 2021United StatesHireVue (reported)

Massachusetts job applicant alleges CVS's AI-analysed HireVue video interview was an unlawful lie detector test; court let his claim proceed, then he settled

A man who applied for a supply chain job with CVS in Massachusetts around January 2021 says CVS put him through a HireVue video interview with questions about integrity, and alleges that HireVue sent the recording to a platform called Affectiva, which analysed his facial expressions, eye contact, voice intonation and inflection with artificial intelligence and fed a score to CVS. He sued CVS in a proposed class action under the Massachusetts Lie Detector Statute, alleging the interview was a lie detector test and that the online application lacked the notice of rights the law requires. He says he did not know the interview was a lie detector test and would not have taken part had he known. In February 2024 a federal judge in Massachusetts denied CVS's motion to dismiss the notice claim, finding a concrete informational injury; CVS had not challenged the other claims at that stage. A law firm commentary says he was not hired. In July 2024 he reached an individual settlement with CVS, whose terms were not reported. The allegations about the AI analysis were not tested in court.

Contextual tracker case Low reported severity Lawsuit Settled

AI involvement reported · Causal attribution alleged · 3 sources · Added 02/11/2026

2019Event location unknownSiri

Whistleblower says accidental Siri activations recorded private conversations heard by Apple contract graders; Apple apologised and later settled class suit

On 26 July 2019 the Guardian reported that contractors grading a small share of Siri recordings for Apple regularly heard confidential information. Its anonymous source, a contractor, said Siri was often activated by mistake, for example by the sound of a zip, and that these accidental activations captured private discussions between doctors and patients, business deals, apparently criminal dealings and sexual encounters, with location, contact details and app data attached. Apple told the Guardian that requests were not linked to users' Apple IDs and that less than 1% of daily activations were graded. On 28 August 2019 Apple apologised, said it had suspended human grading, and said audio would no longer be retained by default, grading would become opt-in and recordings found to be inadvertent triggers would be deleted. Device owners' class action, Lopez v. Apple in the federal court in Oakland, alleged that Apple recorded private conversations after unintended Siri activations and disclosed them to third parties. Apple agreed to pay $95 million while denying wrongdoing, and co-class counsel say the judge granted final approval on 16 October 2025.

Contextual tracker case Medium reported severity Lawsuit Settled

AI involvement supported · Causal attribution supported · 4 sources · Added 29/10/2026

13 Oct 2025 to 26 Nov 2025BrazilUnidentified video tool

Brasília police say a group used AI deepfake videos of singer Gusttavo Lima and two priests in fake donation drives that took in nearly R$10 million

The Federal District Civil Police (PCDF) in Brazil say a criminal group ran fake online donation campaigns that used images of elderly people, children and seriously ill people, and used artificial intelligence tools, including deepfakes, to make fake videos with the images of the singer Gusttavo Lima and the Catholic priests Marcelo Rossi and Fábio de Melo. The posts circulated on social media and sent people to pages imitating legitimate charity appeals; the money went to bank accounts the group controlled. Police say one company linked to the group received 215,575 transactions totalling about R$9.8 million between 13 October and 26 November 2025, mostly of R$30 and R$50, and that the number of transactions does not necessarily match the number of victims. On 28 October 2026 the PCDF launched Operação Cáritas with six preventive arrest warrants and search warrants in the Federal District and four states; five suspects had been arrested by the time of most reports (g1 reported six). How the police established that the videos were AI-made is not disclosed, and no response from the people depicted is reported.

Core concern Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 1 underlying account · Added 29/10/2026

1 Mar 2023 to 22 Jun 2023Event location unknownChatGPT

New York federal judge sanctions two lawyers whose brief cited cases ChatGPT invented, after the chatbot told one of them the cases were real (2023)

In a passenger's personal-injury suit against the airline Avianca in the US District Court for the Southern District of New York, an opposition brief filed on 1 March 2023 cited judicial opinions that did not exist. The court found that the lawyer who did the research had used ChatGPT, which fabricated the cases, and that when he asked the chatbot whether one of them was real it replied that it had supplied real authorities that could be found on legal databases. On 22 June 2023 the court found bad faith by the two lawyers, based on their conduct after the citations were questioned, and imposed a USD 5,000 penalty jointly on them and their firm, together with letters to the client and to each judge falsely named as an author of the fake opinions.

Core + contextual relations Medium reported severity Regulatory Action

AI involvement supported · Causal attribution established · 2 sources · Added 28/10/2026

30 Apr 2024BraziliFood facial recognition check

Brasília labour court orders iFood to pay delivery worker who says its face check flagged his own photos as another person and got him banned; iFood appeals

A delivery worker in Brazil's Federal District who had worked for the iFood app for about three years says he was banned from the platform in April 2024 shortly after completing the app's daily facial recognition check. iFood support told him another person had tried to access his account; when he asked to see that person's photos, they were his own. G1 reports that the only difference from his registration photo was his hair, which he was growing out. In a judgment reported in June 2025, a Brasília labour judge, applying a default because iFood had not filed a defence in time, accepted as true that the contract was suspended through iFood's fault, that he suffered financial and psychological losses, and that the facial recognition tool had a racist failure, and ordered iFood to pay R$60,000 in moral damages. iFood denies that its facial recognition procedure analyses racial characteristics and has appealed. The account was restored during the case. No appeal ruling has been reported.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution supported · 3 sources · Added 27/10/2026

2024United StatesGaggle

Lawrence, Kansas: students say Gaggle AI monitoring flagged class photography as child sexual images, leading to questioning and removed work

The Lawrence, Kansas, school district began using Gaggle, a student-monitoring service, on school accounts in November 2023. A federal lawsuit filed on 1 August 2025 by current and former students alleges that Gaggle, which the complaint says operates through artificial intelligence that flags items for review by Gaggle moderators, flagged original photography assignments uploaded by art and photography students. According to the complaint, in early 2024 security officers took students out of class to the front office of a Lawrence high school, where administrators told them their images had been flagged by Gaggle for indecent exposure and child pornography; an assistant principal accused a photography student of having such material, refused to let her view the images, and questioned her about them from memory, and administrators admitted they had not seen the flagged content. The student told them she had uploaded that day a photography assignment showing a fully clothed friend; the complaint says the flagged content consisted of original photographs taken for class assignments, that students found their photographs removed from their school accounts only by comparing them with personal backups, that one student had to explain each image in her portfolio to district staff and became concerned that future assignments would bring more scrutiny, and that the district restored the images only after months of advocacy. The Associated Press, in reporting that included an analysis of the district's Gaggle alert records, said the photos had been automatically deleted and that students with backups showed it was a false alarm, and that district officials said they later adjusted the software's settings to reduce false alerts. On 8 April 2026 the federal court dismissed, on qualified immunity, the claims against the assistant principal and another official, saying it had found no law establishing that a school official cannot rely on an AI surveillance flag to call in a student for questioning; other claims against the district continue, and the docket shows depositions noticed in October 2026.

Contextual tracker case Medium reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources · Added 27/10/2026

18 Oct 2026BrazilUnidentified AI tool

São Luís (Brazil): Federal Police arrest Bar exam candidate they say used a phone linked to an AI tool to cheat

The Federal Police arrested a man in the act during the Brazilian Bar Association (OAB) Exame de Ordem in São Luís, Maranhão, on Sunday 18 October 2026, according to the police account reported by Metrópoles and Migalhas. Police say officers sent to the exam venue after a criminal complaint about possible fraud found him using a mobile phone integrated with an artificial-intelligence tool to cheat. He was booked in the act for fraud in an exam of public interest and released after paying bail. Police said the investigation continues into the extent of the attempt and whether others took part. The reports do not name the AI tool, say whether it produced answers, or report an exam disqualification or charging decision.

AI relation unknown Low reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 24/10/2026

Event date unknownAustraliaUnidentified AI checkout camera monitoring system

Australian supermarket cashier got final written warning after AI checkout camera system flagged scanning errors, union submission says

The Shop, Distributive and Allied Employees' Association (SDA), an Australian union representing retail, warehouse and fast-food workers, told the federal parliament's Joint Select Committee on Artificial Intelligence in its written submission that a supermarket employee with more than 30 years' service had recently received a final written warning for scanning inaccuracy generated by an AI checkout monitoring system. According to the union, the system uses overhead cameras to compare items moved through the checkout with items scanned and automatically flags possible mismatches, which set off escalation to head office and pressure on store managers to act. The SDA says her error rate was about 0.18 per cent, roughly one error in 533 items scanned, and that she was never told what standard the system applied. The Sydney Morning Herald (10 October 2026) and Guardian Australia (20 October 2026) reported the case; the Herald says the union has challenged the warning. The account is the union's; the supermarket is not named, and its response and the result of the challenge are not reported.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 24/10/2026

Event date unknownEvent location unknownUnidentified AI tool

Belgian Pensions Ombudsman says an AI tool told a new retiree his missed first pension month could be paid retroactively, an answer based on Dutch rules

The Belgian Pensions Ombudsman (Ombudsdienst Pensioenen) published an anonymised example from its casework. According to the Ombudsman, a future retiree with limited digital skills wanted to apply online for an early retirement pension but did not press the send button, so no application was filed and his pension was not paid in his first month of retirement. The Federal Pension Service told him that an early pension can start at the earliest in the month after the application, so that month could not be paid. He checked this using AI and received the answer that a pension can be paid retroactively for up to one year. He complained to the Federal Pension Service and then to the Ombudsman. The Ombudsman confirmed that the service's answer was correct, told him that the information he had found concerned Dutch legislation, referred him to the pension services' websites and says it tried in this way to restore his trust in the pension service. It could not recover the missed month because Belgian pension law has no right to correct good-faith errors. The lost month resulted from the unsubmitted application; the AI answer misinformed him about whether it could be recovered. The tool is not named and the dates of the exchange and complaint are not stated; European Pensions reported the case on 9 July 2026.

Core concern Low reported severity Regulatory Action

AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 24/10/2026

Dec 2023 to Mar 2024United StatesGrammarly (reported)

Massachusetts: federal court refuses to undo a high school's penalties on a pupil found to have submitted Grammarly AI text with invented citations

In late 2023 a junior at a public high school in Hingham, Massachusetts, and a classmate submitted a script for an AP U.S. History project that, a federal court later found on a preliminary record, contained text copied from Grammarly, a publicly available AI tool, including citations to nonexistent books, with no acknowledgement of AI use. Turnitin and other AI detection tools had flagged the script, and a school official says the pupil admitted using Grammarly. In December 2023 the school treated it as cheating: the pupil failed two parts of the project, served a Saturday detention and was rejected from the National Honor Society in spring 2024, though he was later admitted. His parents sued, arguing the school had not made its AI rules clear; on 20 November 2024 the US District Court for the District of Massachusetts refused a preliminary injunction to undo the penalties, and in February 2025 the parties dismissed the case with prejudice.

Core + contextual relations Low reported severity Involving minors Lawsuit Dismissed

AI involvement reported · Causal attribution supported · 2 sources · Added 23/10/2026

9 Oct 2024 to 5 Dec 2024United StatesGaggle (reported)

Arizona: family says a Gaggle alert on a pupil's unsent joke email led to his suspension; federal court lets their free-speech claim proceed

On 9 October 2024 a Marana Unified School District pupil in Arizona, typing at home on a school Chromebook in front of his mother, wrote a threat-like joke about shooting up the school in a draft email to a teacher and deleted it without sending it, according to his family's federal lawsuit. The family says Gaggle, the AI-based monitoring software the district used, flagged it: the principal received a Gaggle notification with a photograph of the screen and, with the school resource officer, called the mother within the hour. The family says the pupil was suspended for ten days, a long-term suspension hearing imposed 45 days reducible to eleven with counselling, and the superintendent finally affirmed a nine-day suspension in December 2024. In March 2026 the District of Arizona let the family's First Amendment claim proceed and dismissed its procedural due process claims. The district declined to comment to the press.

Contextual tracker case Low reported severity Involving minors Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 23/10/2026

Nov 2020Event location unknownTikTok text-to-speech

Canadian voice actor alleged TikTok's text-to-speech feature used a computer-generated version of her voice without permission; suit settled in 2021

Canadian voice actor Bev Standing alleged in a May 2021 federal suit in New York that ByteDance's TikTok was using her voice, without permission or payment, as the female computer-generated voice of its text-to-speech feature, which lets users choose the words spoken over their videos. Her complaint says she discovered this in November 2020, that the voice came from recordings she had made for the Institute of Acoustics for work described as Chinese translations related to text-to-speech, and that some videos made the voice say foul and offensive language. About three weeks after she sued, users noticed a new female voice on the feature (CBC); TikTok did not comment and never confirmed that the original voice was hers. The case was dismissed in September 2021 after her lawyer reported a settlement, whose terms were not disclosed.

Core concern Low reported severity Lawsuit Settled

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 23/10/2026

2020United StatesLovo Genny (reported)

Voice actors allege AI voice firm Lovo sold clones of voices they recorded for research use; US court lets publicity, contract and consumer claims proceed

Voice-over actors Paul Lehrman and Linnea Sage allege in a proposed class action in the Southern District of New York that Lovo, a text-to-speech company, hired them through Fiverr in 2019 and 2020 for recordings it said were for internal research or test scripts, then used its AI software to make and sell clones of their voices under the names "Kyle Snow" and "Sally Coleman". According to the complaint as recounted by the court, they learned of it when they heard a podcast narrated in part by a Lovo-generated voice that they say was identical to Lehrman's, and Lovo answered their cease-and-desist letter by saying the characters were created from those recordings and that its use was "fully permissioned". On 10 July 2025 Judge J. Paul Oetken dismissed most federal trademark and copyright claims but let their New York Civil Rights Law, consumer-protection and contract claims, and Sage's copyright claim over her original recording, proceed. The case was stayed on 28 May 2026 after Lovo filed a suggestion of bankruptcy. The allegations have not been tested at trial.

Core concern Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 23/10/2026

15 Nov 2022 to 27 May 2023Event location unknownUnidentified video tool

Australian Federal Court orders man to pay A$343,500 for posting AI-generated deepfake intimate images of six women, in eSafety's first civil penalty case

On 26 September 2025 the Federal Court of Australia ordered a man to pay civil penalties of A$343,500 plus costs, in what the eSafety Commissioner said was the first proceeding to impose a civil penalty under the Online Safety Act 2021. On facts he admitted, he posted 12 non-consensual deepfake intimate images of six women ordinarily resident in Australia to a deepfake website between November 2022 and May 2023. He made each one by uploading a photo of the woman found online to a webpage that created semi-naked or naked images and saving the generated image. He refused eSafety's removal notice, so two images stayed online for almost a year, and he admitted posting some later images in retaliation against people involved in issuing the notice. Each woman complained to eSafety, and the court found the posts were likely to have caused them hurt and distress. The eSafety Commissioner called this kind of deepfake abuse a misuse of easily accessible AI tools.

Core concern High reported severity Regulatory Action

AI involvement supported · Causal attribution established · 5 sources · Added 23/10/2026

28 Sept 2026Event location unknownChatGPT (reported)

Switzerland: Federal Supreme Court refuses to hear a 243-page appeal that the appellant said was drafted with intensive ChatGPT Plus support

A father in a dispute with the canton of Basel-Stadt over an electricity-price bonus for his newborn daughter filed a 243-page appeal with 17 requests to Switzerland's Federal Supreme Court, about 28 times the length of the cantonal judgment he challenged, which ran to just under eight and a half pages. He told the court that drafting it had been possible only through his "above-average intelligence", his analytical skills and the intensive support of ChatGPT Plus. In judgment 2C_549/2026 of 28 September 2026 the presiding judge, sitting alone, found the brief excessively prolix, held that using artificial intelligence did not release him from the pleading requirements and was no free pass for sprawling briefs, refused him a period to shorten it and declined to hear the appeal. No court costs were imposed. blue News reported the judgment on 20 October 2026.

Core concern Low reported severity Lawsuit Dismissed

AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 23/10/2026

Dec 2019 to Jul 2020United StatesUnidentified facial recognition system

US: FTC says Rite Aid's facial recognition falsely matched shoppers to a watchlist, leading staff to search an 11-year-old girl and call police on a woman

In a complaint filed in federal court in Pennsylvania on 19 December 2023, the US Federal Trade Commission alleged that the pharmacy chain Rite Aid used facial recognition in its stores to match customers against a database of people it suspected of shoplifting or other wrongdoing, and that staff acted on the match alerts by following, searching, ejecting and publicly accusing customers and by calling the police. The FTC says many alerts were false positives: employees recorded thousands of false-positive alerts between December 2019 and July 2020, staff stopped and searched an 11-year-old girl on a false match, and employees called the police on a Black woman matched to an image of a white woman with blonde hair. Rite Aid agreed to a proposed order barring it from using facial recognition in retail stores for five years, without admitting or denying the allegations.

Contextual tracker case Medium reported severity Regulatory Action

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026

Feb 2026Event location unknownUnidentified image tool

Brasília appeals court upholds 20,000-reais damages against a federal deputy for an AI-made image placing Bolsonaro in a nonexistent scene

In February 2026 federal deputy Rogério Correia posted on X a realistic image produced with artificial intelligence that, according to the Federal District court, inserted former president Jair Bolsonaro into a nonexistent scene and linked him to the banker Daniel Vorcaro, Banco Master and an alleged illicit scheme. Bolsonaro sued; a first-instance court ordered the deputy in May 2026 to pay 20,000 reais in moral damages and publish a retraction. On 8 October 2026 the First Civil Panel of the Federal District and Territories Court of Justice (TJDFT) unanimously dismissed the deputy's appeal, holding that parliamentary immunity does not cover a realistic AI image of a nonexistent event presented without a clear warning, and that the association harmed Bolsonaro's honour and image. The judgment was made public on 20 October 2026.

Core concern Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 22/10/2026

20 Oct 2026BrazilUnidentified document-analysis tool

Brazil's Superior Court of Justice fines lawyers 20,000 reais over hidden commands aimed at AI in an appeal petition and refers them to the bar and prosecutors

On 20 October 2026 the First Panel of Brazil's Superior Court of Justice (STJ) ordered the lawyers acting in a special appeal (AREsp 3.095.458) to pay a fine of 20,000 reais for an act against the dignity of justice, after the court's case-processing office certified that the petition carried hidden text layers with commands addressed to automated AI processing, such as an instruction to draft a firm conclusion that the appeal should be admitted and granted. The panel also ordered a technical report on the concealment techniques and the communication of the case to the Brazilian bar (OAB) and the Federal Public Prosecutor's Office. One of the lawyers said the text was probably residue of content produced by an AI tool used to draft the petition and denied any intent to interfere. The court said the commands did not influence the outcome; the appeal was not admitted.

AI relation unknown Low reported severity Regulatory Action

AI involvement reported · Causal attribution established · 2 sources · Added 22/10/2026

Dec 2025 to Aug 2026United StatesPega Voice AI (reported)

U.S. Bank customers allege in a class action that Pega Voice AI transcribed and analysed their customer-service calls without consent

Four U.S. Bank account holders in California, Massachusetts and Pennsylvania allege in a federal class action filed on 2 October 2026 that Pegasystems' Pega Voice AI, which they say U.S. Bank uses in its contact centres, transcribed their customer-service calls in real time, analysed them with natural language processing and generated suggestions to the agent, without their prior consent. They say they gave account numbers, a date of birth and a home address on the calls, made between about December 2025 and August 2026. The claims are allegations; The CourtListener index of the docket, checked on 21 October 2026, listed the summons as returned executed on 16 October and no response from Pegasystems.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 1 source · Added 21/10/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 04/11/2026. Dataset available under CC BY 4.0.