Skip to main content

NOPE · AI and people

AI incidents

Reports of AI-related harm and adverse experiences affecting people’s safety, wellbeing, rights and livelihoods. Explore what happened and the evidence available.

NOPE’s core concern is when AI communicates with a person, acts on their behalf, or depicts or impersonates them. The tracker is wider: it also records consequential decisions and claims about people. Each account is reviewed for publication; claims may remain uncorroborated or disputed. How we review and count cases

In this selection

Published cases
54
Countries with reported events
10
Located 41 of 54 cases · 13 unknown
Languages in checked sources
12
Recorded for 54 of 54 cases

106 cases have no reviewed AI-to-person relation yet: 79 not yet reviewed and 27 reviewed as unknown. Show these cases

These figures describe the cases collected by NOPE. Coverage varies with discovery, reporting and available evidence. They do not estimate how often AI-related harm occurs.

Response counts currently use each case’s principal recorded outcome. Further proceedings may be described in its account.

Cases in this selection, counted once in their first known event year. A series may continue beyond that year. Reporting and collection dates are excluded. NOPE has searched recent events more thoroughly than earlier years, so bar heights also reflect collection effort.

Reported severity HighMediumLow
More filters: AI relation, use, setting, sources and responses
Clear filters

54 of 404 published cases · page 2 of 3

20 Oct 2025United StatesOmnilert gun detection

Baltimore County, Maryland: school AI gun alert on a bag of chips leads to police search of a student

On a Monday evening in October 2025 (20 October by the reports' weekday references) an AI gun detection system (Omnilert) used at Kenwood High School alerted on a student holding an empty bag of chips. Police responded and searched the student and found no weapon. The student told a local television station that officers made them kneel, handcuffed them and pointed a gun at them. The school district says its security department reviewed and canceled the alert after confirming there was no weapon, and a district spokesperson said the principal did not immediately realize the alert had been canceled. County councilmembers called for a review. No outcome of a review is established in the sources.

Contextual tracker case Medium reported severity Involving minors

AI involvement supported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 29/09/2026

12 Sept 2025United StatesGaggle school monitoring

Deltona, Florida: Gaggle school-laptop alert leads to felony arrest of a 15-year-old over a typed gun threat the student said was not serious

According to a Volusia County Sheriff's Office account carried by local outlets, a 15-year-old high school student in Deltona, Florida was arrested on 12 September 2025 after typing a written threat to bring a gun to school on a school-issued laptop. The Gaggle student-monitoring software raised an alert that notified the school resource deputy, who detained the student before the student boarded the bus home. The student was arrested on a second-degree felony charge (one outlet says the charge was still to be filed). The student reportedly admitted typing the text, said it was not meant seriously and said the motive was anger about being picked on. Outcome of the charge and the exact Gaggle role in generating this alert are not reported.

Contextual tracker case Medium reported severity Involving minors

AI involvement reported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 29/09/2026

Apr 2025United StatesUnidentified facial recognition system

New York: man misidentified through facial recognition in an indecent exposure case arrested and jailed two days

Reporting from August 2025 says an NYPD facial recognition search of images from a February 2025 indecent exposure in Manhattan's Union Square produced a possible match to a man who did not fit the described suspect. The man was placed in a photo lineup, arrested in April 2025 and jailed for two days. Prosecutors dismissed the case in July 2025 after his public defenders showed he was misidentified. The man says the process of becoming a correctional officer 'kind of' froze after the arrest. The NYPD says it never arrests solely on a facial recognition match.

Contextual tracker case Medium reported severity

AI involvement reported · Causal attribution alleged · 3 sources · Added 29/09/2026

Feb 2025Event location unknownMeu INSS app

Brazil: rural worker's retirement claim rejected through the Meu INSS app after the system reportedly recorded a wrong sex

In February (2025, inferred from the article date) a retirement claim filed through Brazil's Meu INSS social security app for a former sugarcane worker in northeast Brazil was rejected. Rest of World reported that the request was turned down because the system identified the claimant as a man. The claimant, who has chronic illnesses, is quoted saying the benefit is still denied despite complete documents, and Rest of World reports that minor errors in earlier claims through the app had led to numerous rejections. The retirement claim was approved in March after INSS directors corrected the mistake, which the claimant attributed to a contact at an agricultural workers' confederation. The INSS states that automated decisions follow specified legal criteria.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 29/09/2026

4 Jun 2025 to 15 Oct 2025Event location unknownChatGPT (reported)

Argentina: appellate chamber annuls a robbery judgment and trial after the trial judge left a generative-AI chat phrase in the ruling

On 4 June 2025 a criminal judge in Esquel, Chubut province, convicted a defendant of simple robbery and imposed two years and six months of effective imprisonment. On 15 October 2025 the Penal Chamber of Esquel annulled the judgment and the trial, ordering a new trial before another judge. The chamber found that the ruling contained a pasted phrase from a generative-AI assistant (“Aquí tienes el punto IV reeditado, sin citas y listo para copiar y pegar”), that the AI had been used on the rulings on the nullity of two essential pieces of evidence, and that the judge had not exercised human supervision or recorded the use. Perfil's headline describes the assistant as ChatGPT and La Nación's text as presumably ChatGPT; the quoted ruling and the prosecution office statement refer only to a generative-AI assistant. The chamber referred the judge's conduct to the Chubut Superior Court of Justice for ethical and disciplinary review.

Contextual tracker case Low reported severity

AI involvement supported · Causal attribution supported · 3 sources, 1 underlying account · Added 29/09/2026

Aug 2025Event location unknownUnidentified AI-text detector

Student reports receiving a zero after a disputed AI-detector result

In an August 2025 first-person post, a student said they discovered a zero for a summer-course discussion assignment after a checker labelled 85% of the text AI-generated. They denied using AI to write it, reported contacting the professor, and described anger and fear of future accusations. Neither the detector output nor the school’s account was available for verification.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 1 source · Added 29/09/2026

27 Sept 2025 to 15 Oct 2025United StatesFlock Safety license plate readers

Denver, Colorado: a police sergeant cited Flock license-plate-camera records of a woman's truck passing through the town of Bow Mar to accuse her of stealing a $25 package and issued a petty-theft summons; she spent about two weeks proving she had only driven through, and the summons was voided

On 27 September 2025 a sergeant from the Columbine Valley Police Department, which polices the small town of Bow Mar, came to the south Denver home of a woman in her 40s who works in financial services and accused her of stealing a package worth about $25 from a Bow Mar doorstep on 22 September. He cited Bow Mar's Flock camera records showing her truck in town between 11:52 and 12:09, said he also had the victim's doorbell video, refused to show it to her, and issued a petty-theft summons with a December court date. She had driven through Bow Mar to a tailor's appointment. Over about two weeks she gathered her truck's camera footage and GPS records and the tailor's camera images and sent them to the police chief, who wrote on 15 October that the summons had been voided. She describes emotional distress and fear for her career. The town said the officer had a reasonable belief at the time but would face unspecified disciplinary action; it did not apologise. No source reports that the cameras misread anything.

Contextual tracker case Low reported severity Internal Action

AI involvement reported · Causal attribution supported · 6 sources, 1 underlying account · Added 29/09/2026

Mar 2024 to May 2025United StatesOtter Notetaker

United States: seven people who say they did not hold Otter accounts say Otter's AI Notetaker recorded and transcribed their Zoom and Teams meetings without their consent, including a medical call and calls with a financial professional, and kept the data to train its models; a federal court let their core privacy claims proceed

Seven people in California, Illinois and Washington state are suing Otter.ai in a consolidated class action in the Northern District of California. Each says another meeting participant used Otter's AI Notetaker on a Zoom or Microsoft Teams call they joined, and that Otter recorded, transcribed and stored their conversation without their consent; six of them date their calls between March 2024 and May 2025. They say they were not Otter account holders. The calls they describe include a medical consultation, meetings with a financial professional and work discussions. They allege that Otter keeps the recordings and uses them to train its speech-recognition models, that it captured voiceprints of the Illinois plaintiffs, and one of them says learning of the recording left him frustrated, embarrassed and stressed. On 13 August 2026 the court found that the alleged interception of private conversations was a concrete injury and let the federal wiretap, California eavesdropping and Illinois biometric claims proceed, while dismissing some claims. Otter's answer to the consolidated complaint, filed on 17 September 2026, says it lacks knowledge of the plaintiffs' experiences and denies the allegations.

Contextual tracker case Low reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 6 sources, 3 underlying accounts · Added 29/09/2026

Event date unknownEvent location unknownFacebook video face-scan check

First-person forum account: a Facebook user says a video face-scan security check failed to recognise them after their appearance changed, an automated ID check then rejected their government ID over a nickname, and they were locked out of a five-year-old account

In a public post to r/facebook on 28 September 2026, a user writes that their five-year-old Facebook account was hit with a security check that asked for a video face scan, which 'failed completely'. They say their face had changed a lot through recent life circumstances and 'The AI simply didn't recognize me.' Facebook then asked for ID, and 'the automated system instantly rejected' their government ID because their profile uses a shortened nickname. The poster says they are locked out of years of memories, friends and active Marketplace listings and are looking for a way to reach a human or download their data. Meta has said that video selfies used to regain access to compromised accounts are compared with the account's profile pictures using facial recognition; whether this check worked that way is not known. The account is uncorroborated.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 2 sources · Added 29/09/2026

Event date unknownEvent location unknownGemini note-taking in Google Meet

First-person forum account: an agency employee in England says Gemini note-taking in Google Meet kept transcribing two prospective clients after the agency's boss left the call, and that the boss passed their private post-meeting discussion to staff to shape a follow-up pitch

In a public post to r/LegalAdviceUK on 28 September 2026, an employee of a marketing agency in England writes that their boss pitched a prospective client and the client's business partner on a Google Meet call with Gemini note-taking switched on. After the boss said goodbye and left, the two business partners stayed on the call to discuss the proposal and the other agencies they were considering, and Gemini kept taking notes. The boss then sent the employee the notes and transcript, which named a competing agency and included 'personal details of who they spoke to specifically on the call', and asked for a follow-up deck built on what the partners liked and disliked. The poster believes the partners did not know they were still being transcribed. Google's help page says Meet tells all participants when notes are being taken; whether the partners noticed is not known. The account is uncorroborated.

Contextual tracker case Low reported severity

AI involvement reported · Causal attribution alleged · 4 sources, 2 underlying accounts · Added 29/09/2026

May 2025United StatesUnidentified facial recognition system

Jacksonville, Florida: a 38-year-old father was arrested at work in May 2025 and charged with soliciting a child after sheriff's investigators identified him, he says with facial-recognition tools, from photos an impostor had sent to an undercover officer; charges were dropped in August 2025 after the real sender confessed, and the family says the ordeal cost $45,000

The Florida Trib (28 September 2026, republished by the Florida Phoenix) reports that in May 2025, during the multi-agency sting Operation Rescue Our Children, a man using the Skout dating app sent an undercover officer posing as a 13-year-old girl two photos of someone else: a former friend, a supermarket assistant manager and father of two whom the Trib calls 'Nick'. Investigators told him they relied on facial-recognition tools to identify him in the pictures, he recalled, and the Trib found no indication in court documents of other investigative work before his arrest. He was handcuffed at work, charged with soliciting a child via computer and unlawful use of a two-way communications device, spent a night in jail, wore an ankle monitor, was barred from contact with his two young children for a month and a half and could not live at home for nearly three months. The account's owner, a man with a prior conviction for the same offence, admitted on 31 July 2025 using the photos; charges against the father were dropped the next day and a judge ordered the case expunged on 4 August 2025, though the records stayed publicly online for more than a year. The family says the ordeal cost $45,000 in lost wages and legal fees and traumatised the children. The sheriff's office did not respond to the Trib's questions.

Contextual tracker case High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 1 source · Added 29/09/2026

21 Sept 2026 to 25 Sept 2026FrancePangram AI-text detector

France: the Académie Goncourt removes Thélyson Orélien's bestselling novel from its prize selection, saying it is in all likelihood largely AI-generated, days after an anonymous X account publicised Pangram AI-detector scores; the author denies using AI, and the Académie also cites separate plagiarism in his older texts

On 21 September 2026 an anonymous X account, Balance ton Claude, said it had run excerpts of Thélyson Orélien's debut novel C'était ça ou mourir through the American AI-detection software Pangram, with some passages scoring up to 100 per cent probability of AI generation. On 25 September the Académie Goncourt removed the novel from the first selection of sixteen books for its 2026 prize, stating that the work is 'in all likelihood very largely the product of an artificial intelligence', based on 'the convergent result of several analyses by researchers and journalists', and also citing plagiarism in older texts by the author published in Canada (at least one short story and articles), which do not concern the novel. Orélien, a 38-year-old Canadian-Haitian writer whose novel had won the Fnac novel prize, denies using AI and says its repetitions and certain rhythms reflect his linguistic and cultural world and may be misread by automated tools. His Montreal publisher Boréal suspended promotional activities, saying it could neither confirm nor refute the allegations. Essayist Samuel Fitoussi said he was one of the people behind the account. Whether AI was used to write the novel is disputed; AI-detector reliability is itself contested in the coverage.

Contextual tracker case Medium reported severity Internal Action

AI involvement reported · Causal attribution disputed · 4 sources, 1 underlying account · Added 28/09/2026

14 Feb 2024United StatesFlock Safety license plate readers

York County, South Carolina: Iraq War veteran Steven Melvin says deputies held him at gunpoint and made him kneel for more than five minutes outside his Lake Wylie apartment complex in February 2024 after a Flock license-plate reader misread his plate and flagged his BMW as stolen; he sued in June 2026

According to a lawsuit filed on 29 June 2026 and reported by The Herald (Rock Hill), a York County sheriff's deputy stopped Steven Melvin, 42, on 14 February 2024 as he pulled into his apartment complex near Lake Wylie, after receiving a Flock license-plate-reader alert that a stolen dark-coloured BMW sedan was in the area. The deputy approached Melvin's black BMW with his gun drawn and aimed at him and made him kneel with his hands over his head for more than five minutes; after calling for backup and checking his information, the deputy determined the car was not stolen. The camera had read the first letter of his South Carolina tag incorrectly, matching a stolen BMW one letter off. A sheriff's internal-affairs review in November 2024 found the deputy's actions reasonable and blamed an illegally tinted plate cover, for which Melvin received a verbal warning; an email cited in the filing says the cameras had read his plate correctly 13 times that month. Melvin says the stop caused him trauma and emotional distress. The sheriff's office removed the case to federal court in August 2026 and denies violating his rights.

Contextual tracker case Medium reported severity Lawsuit Filed

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 28/09/2026

23 Jun 2021United StatesUnidentified facial recognition system

Maryland/Oklahoma: Kimberlee Williams, an Oklahoma woman who says she had never been to Maryland, was arrested in June 2021 and jailed about six months on bank-fraud charges in three Maryland counties after a facial-recognition search by an unknown CrimeDex respondent named her; all charges were dismissed by December 2021 and the ACLU filed complaints in April 2026

According to police and bank records reviewed by the Washington Post, in December 2019 a woman made fraudulent withdrawals at a SunTrust branch in Potomac, Maryland; branches in two other Maryland counties were also defrauded. A bank investigator posted the surveillance photos on CrimeDex, an online network of police and corporate investigators; an unknown respondent ran the image through facial-recognition software and returned Kimberlee Williams's name and photo, and the investigator told Montgomery County police that facial-recognition software had identified her. Police in Montgomery, Prince George's and Anne Arundel counties charged her in 2020 on the investigator's identification and their own visual comparison of photos (two departments also cited her old Oklahoma check-fraud convictions), without reported checks of her whereabouts; Montgomery County police did not disclose the facial-recognition search in the charging application, according to police records reviewed by the Washington Post and the ACLU. On 23 June 2021 she was arrested at the gate of Fort Sill near Lawton, Oklahoma, while accompanying her daughter on a DoorDash delivery, spent about three weeks in an Oklahoma jail, was flown to Maryland, and faced 16 charges including 12 felonies. The counties dismissed the charges one after another, in October and December 2021, after about six months in jail. Her daughter says she was depressed afterwards; the ACLU says the ordeal harmed her mental and physical health. On 14 April 2026 the ACLU and ACLU of Maryland sent complaint letters to the three departments seeking an apology and reforms.

Contextual tracker case High reported severity Media Coverage

AI involvement reported · Causal attribution alleged · 4 sources, 3 underlying accounts · Added 27/09/2026

Event date unknownBrazilUnidentified facial recognition system

Serra, Espírito Santo: a personal trainer who swapped his motorcycle for what turned out to be a rented car was told to complete a facial-recognition check 'to transfer the car's title'; police say the biometric was then used to contract a vehicle financing in his name, leaving a loss above R$100,000 (suspect arrested 22 September 2026)

The Espírito Santo Civil Police (Defa, the fraud and forgery unit) said a 27-year-old man was arrested on a warrant in Serra on 22 September 2026, suspected of defrauding a personal trainer of more than R$100,000. According to the police, the suspect offered a car in exchange for the victim's motorcycle; during the negotiation he persuaded the victim to perform a facial-recognition procedure, saying it was needed to transfer the car's ownership; the biometric was later used to contract a vehicle financing in the victim's name without his authorisation, and weeks after the exchange the victim discovered that the car he had received did not belong to the suspect and was a rental. The loss, combining the motorcycle and the fraudulently contracted financing, exceeded R$100,000. The suspect, who police say had been arrested in São Paulo in July 2025 in a 'love scam' case, was taken to the Centro de Triagem at the Rodrigo Figueiredo da Rosa prison complex and remains at the disposal of the courts. The financing provider and the facial-recognition system are not identified, and the reports do not say how the captured biometric was used to pass the financing.

Contextual tracker case Medium reported severity Criminal Charges

AI involvement reported · Causal attribution alleged · 4 sources, 1 underlying account · Added 26/09/2026

14 Aug 2021 to 14 Mar 2024United StatesSt. Louis mugshot recognition (SMRT)

St. Louis County, Missouri: Christopher Gatlin was arrested in August 2021 after officers ran a grainy bus surveillance photo through a regional facial-recognition system and was held roughly 17 months (Post-Dispatch and Bloomberg Law: about two years) on a first-degree assault charge dismissed in March 2024; his federal civil-rights suit (filed January 2025) was amended in August 2026 to add Amazon Web Services, whose Rekognition technology the complaint says underpinned the match

Christopher Gatlin was arrested on 14 August 2021 for an assault at the St. Charles Rock Road MetroLink station after a joint St. Louis County and city team uploaded a grainy, blurry surveillance photograph from a bus into the St. Louis Mugshot Recognition Technology System, a facial-recognition tool that searches stored mug shots (more than 500,000 uploaded, the suit says per the Post-Dispatch; more than 250,000 per Biometric Update via Hoodline), and built the investigation around the resulting match together with a witness identification; he was charged with first-degree assault and held roughly 17 months (the Post-Dispatch says almost two years), a county judge suppressed the witness identification as unconstitutionally suggestive, and prosecutors dismissed the charges on 14 March 2024 (Post-Dispatch; Hoodline citing Biometric Update; Bloomberg Law). Gatlin sued St. Louis County, the City of St. Louis and named officers in the US District Court for the Eastern District of Missouri on 13 January 2025; on 15 October 2025 the court denied the city's motion to dismiss and granted a detective's motion only as to one count; on 13 August 2026 the court allowed a second amended complaint adding Amazon Web Services, which the complaint says supplied the Rekognition program the system used; the county, city and officers answered on 27 August 2026, AWS's response was extended to 21 September 2026 and on 17 September it moved for a further extension to 28 September (no ruling on the docket when read), and a jury trial is set for 1 November 2027 (CourtListener docket). Amazon told the Post-Dispatch that its terms of service prohibit the use of its facial recognition technology in criminal investigations and that it would fully investigate any information that emerges in the litigation. The ACLU lists Gatlin among fourteen people known to have been wrongfully arrested in the US because police relied on erroneous facial-recognition results.

Contextual tracker case High reported severity Lawsuit Ongoing

AI involvement reported · Causal attribution alleged · 5 sources · Added 26/09/2026

Sept 2023United StatesFlock Safety license plate readers

Indianapolis: five current and former police officers were charged on 23 September 2026 with fraud and official misconduct, one also with stalking, after audits found thousands of Flock automated license-plate-reader searches with no law-enforcement purpose, including one officer's tracking of 11 people (seven women and four men) and another's 1,616 searches that included his ex-wife's plate (WISH-TV, WNDU, WFYI/WVXU, Gizmodo)

On 23 September 2026 the Marion County Prosecutor's Office charged four suspended Indianapolis Metropolitan Police Department (IMPD) officers and one former officer with fraud and official misconduct after internal audits in August and September 2026 found misuse of the department's Flock Safety automated license-plate-reader (ALPR) system; one officer was also charged with two counts of stalking. According to prosecutors, the probable cause affidavit and court documents as reported by WISH-TV, that officer made 1,396 searches with no apparent law-enforcement purpose, began searching the plate of a woman he met at a workout class in September 2023 nine days after meeting her and messaged her from a Facebook account under a false name, also tracked his ex-wife and a woman he met at her workplace (telling her he was an FBI agent), and in total conducted unauthorised surveillance of 11 people, seven women and four men. Another officer made 1,616 searches between April 2024 and April 2025 for two plates, one his ex-wife's, using another officer's credentials. The chief placed the officers on desk duty, revoked their ALPR access, suspended four and recommended their dismissal; one resigned. The department said the misuse came to light after an officer self-reported and an audit followed; the prosecutor said each count corresponds to one license plate. IMPD, which leases about 301 Flock cameras and can search a shared national network, has since required every user to sign its ALPR policy, tied each search to a case number, adopted single logins and increased audits, and said it will not reduce its cameras.

Contextual tracker case High reported severity Criminal Charges

AI involvement supported · Causal attribution supported · 5 sources, 1 underlying account · Added 25/09/2026

Event date unknownEvent location unknownChatGPT

A Norwegian child-safety organisation reports that ChatGPT's behaviour-based age estimation switched an adult staff member's account into teen mode without a request, restricting content and offering an identity check through a third-party verifier as the way out (Barnevakten, 23 September 2026)

Barnevakten, a Norwegian child-safety organisation, reported on 23 September 2026 that one of its staff members was suddenly told by ChatGPT that their account was now in teen mode. ChatGPT's own pages, as described by Barnevakten, say the system turns the filter on when a user's behaviour indicates an age under 18, reducing sensitive or potentially harmful content (graphic violence, viral challenges, sexual or violent role-play, extreme beauty ideals) and offering parental controls and a study mode. Because there is no age check at sign-up, the system estimates age afterwards from conversation topics and times of use, and Barnevakten notes that such guesses can be wrong. An adult who wants out of teen mode can go through an age check run by the company Persona, which depending on the country asks for a real-time selfie and a government ID; Barnevakten questions whether that process is privacy-safe (Persona's terms mention retention of up to three years) and advises using only age checks one trusts. The account's own experience is limited to the unexpected switch and the verification route; no further consequence is described.

Core + contextual relations Low reported severity Media Coverage

AI involvement supported · Causal attribution supported · 1 source · Added 24/09/2026

24 Jul 2026 to 26 Jul 2026IndiaUnidentified facial recognition system

Delhi: the police facial-recognition system logged at least 25 people who were in Tihar, Mandoli or Rohini jails as present at the Jantar Mantar student protests (20 to 26 July 2026), with timestamps on 24 to 26 July, on a sworn list of 2,873 persons with 'criminal antecedents' that the Supreme Court allowed police to register a fresh FIR against (Indian Express investigation, 4 September 2026)

In an affidavit of 17 August 2026 before the Supreme Court of India, Delhi Police said its Facial Recognition System (FRS) had identified 2,873 people with criminal antecedents at the Jantar Mantar protests of 20 to 26 July 2026 (2,402 through its 'Crime Kundli' biometric database and 471 through other criminal records). On 1 September the Court quashed the FIRs against the student protesters but let the police proceed against the 2,873; the police say any action will follow field verification. The Indian Express checked the 205 listed people facing murder, attempted-murder, rape or child-sexual-offence charges against police, prison and court records and found that at least 25 of them (17 accused of murder, four of rape (two or three under POCSO; the Express's narrative and its list differ), four of attempted murder) were lodged in Delhi's Tihar, Mandoli or Rohini prisons when the system logged them at the protest site with timestamps on 24, 25 and 26 July; some had been in custody for years. Delhi Police told the newspaper that further verification of the 2,873 was pending and, in its affidavit, that no action is taken solely on a facial-recognition result and that field verification follows each match. The police disclosed in 2022, in reply to a Right to Information request, that it treats a match with an 80 per cent similarity score as positive. Whether any of the 25 has since been named in the fresh FIR or visited for verification is not reported.

Contextual tracker case Medium reported severity Investigation Opened

AI involvement reported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 24/09/2026

19 Jun 2026 to 13 Aug 2026BrazilChatGPT and OpenAI moderation

São Gabriel da Palha, Espírito Santo: a 36-year-old farmer was held in pre-trial detention for 54 days after OpenAI reported his ChatGPT messages about killing his eight-year-old son to the FBI, which passed them to Brazilian authorities; a court released him on 13 August 2026 because the investigation had not been completed, with an ankle monitor and a ban on contacting the child, and no charges had been filed; he denies intending harm and his lawyer says he was talking nonsense to a chatbot

Over about two months in 2026 a 36-year-old farmer in rural São Gabriel da Palha, Espírito Santo, exchanged messages with ChatGPT that the Espírito Santo civil police describe as plans to kill his eight-year-old son, attack other people and kill himself; one message said he had offered 50,000 to someone to kill him and his son. OpenAI reported the messages to the FBI, which passed them through Brazil's Ministry of Justice cyber-operations laboratory to the state police on 16 June; the man was arrested on 19 June as he left home, a day before the date on which police believed the plan would be carried out. Police say what the platform provided was corroborated at the scene (four bottles of unidentified substances and a knotted rope were found) but that he denied intending to kill the child; his lawyer says he was talking nonsense to a chatbot and took no concrete step. After 54 days in custody a court granted habeas corpus on 13 August 2026 because the inquiry had not been concluded and no charges had been brought, imposing electronic monitoring and a ban on approaching or contacting his son and the child's mother. Police were still examining his phone and awaiting forensic results. OpenAI provided user details and his messages but not ChatGPT's replies and did not answer the BBC's question why; it told the BBC it may notify law enforcement when it detects a credible and imminent risk of harm to others. The case is recorded as an institutional response to AI use: the reported adverse consequence is the detention without charge, and the police account that the report prevented a planned killing is preserved as context.

Core + contextual relations High reported severity Investigation Opened

AI involvement supported · Causal attribution supported · 4 sources, 2 underlying accounts · Added 23/09/2026

Cases may have several effects and sources. Mixed accounts qualify when they include a reported harm or adverse experience. People are counted within individual cases where sources support a number; we do not publish a collection-wide total of distinct people.

A source’s existence, the experience it reports and AI’s causal role are separate questions. A lawsuit records allegations unless a subsequent finding establishes them.

Methodology and corrections · Subscribe via RSS · Suggest a case or correction · Find support

Last dataset update: 30/09/2026. Dataset available under CC BY 4.0.