Feb 2021United StatesGoogle CSAM image classifier
In February 2021 a San Francisco father took photos of his toddler son's medical condition after a nurse asked for photos before a video consultation; the doctor used them to diagnose the problem and prescribe antibiotics. The New York Times reported in August 2022 that when the photos were backed up from his Android phone to Google's servers, Google's artificial-intelligence tool for recognising never-before-seen child abuse images flagged them. Two days after the photos were taken his Google account was disabled for 'harmful content', which cost him more than a decade of email, contacts and photos and, through Google Fi, his phone number. Google reported him to the National Center for Missing and Exploited Children, and the San Francisco police obtained search warrants for his account; the investigator concluded that no crime had occurred. Google refused to reinstate the account after two appeals, the second with the police report, and later notified him that it was being permanently deleted. The Times reported a second father in Houston whose photos of his toddler, taken at a paediatrician's request, were also flagged; his Gmail account was disabled in the middle of buying a house, Houston police questioned and cleared him, and he did not get the account back. Google said it stood by its decisions and that its reviewers had found a further video in the San Francisco father's account that it considered problematic.
Contextual tracker case Medium reported severity Investigation Opened
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 02/11/2026
Oct 2023NetherlandsMONOcam (reported)
Dutch police use mobile smart cameras that apply artificial intelligence to photos of passing drivers to detect whether they are holding a mobile phone; a police officer then reviews each flagged photo before a fine is issued. A driver says that in October 2023, on the A2 motorway near Weert, such a camera photographed him with his right hand at his head and that he received a fine of 380 euros plus 9 euros in administration costs for holding a mobile device while driving. He says the flash photo, which he requested from the Central Judicial Collection Agency (CJIB), shows his empty hand near his face: he was scratching his head, his lease car allows hands-free calling, and he is left-handed. In a February 2024 blog post he writes that the camera was a MONOcam, that its algorithm judged that he was holding a device and that the reviewing police employee accepted that judgement, so that both the algorithm and a person erred; RTL Nieuws reported that the photo was probably taken by a MONOcam. Omroep Brabant described the fine as a mistake by the AI camera. The driver said the reviewing officer was probably biased by the algorithm's output and that a dark shadow in his hand could mislead a quick look. He lodged an objection with the Public Prosecution Service; it had not been decided when the reports appeared in February 2024, and a CJIB spokesperson, who would not comment on individual cases, suggested to RTL that he was unlikely to have to pay. No later outcome has been reported. He also told Omroep Brabant that he considers the cameras valuable for road safety, provided doubtful cases are not fined.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution alleged · 3 sources · Added 01/11/2026
23 Feb 2024United KingdomMetropolitan Police live facial recognition
On 23 February 2024 Shaun Thompson, a London community volunteer whom the 2026 judgment describes as 39, walked past a Metropolitan Police live facial recognition deployment near London Bridge station. The High Court records as not in dispute that the system detected a high level of facial similarity between images of him and the watchlist image of his brother, who was the subject of an outstanding arrest warrant, and generated an alert. According to the court's account, officers stopped, detained and questioned him and made him prove his identity, and when he declined to have his fingerprints taken he was threatened with arrest; he says the experience left him angry and distressed. Officers ended the engagement after checking police records about his brother, and he confirmed his identity with a passport photograph on his phone. Big Brother Watch, whose director was his co-claimant, says he was held for almost 30 minutes despite showing several identity documents. His judicial review claim about the stop, issued in May 2024, was withdrawn under a consent order agreed on 18 December 2024 on terms including a settlement sum paid to him. An amended challenge to the Met's revised live facial recognition policy of September 2024, brought with Big Brother Watch's director, was dismissed by the Divisional Court on 21 April 2026; the court said it was not judging the merits of the technology, and the claimants announced plans to appeal.
Contextual tracker case Medium reported severity Lawsuit Dismissed
AI involvement supported · Causal attribution established · 4 sources, 3 underlying accounts · Added 26/10/2026
13 Apr 2024BrazilUnidentified facial recognition system
During the half-time interval of the Sergipe state football championship final at the Batistão stadium in Aracaju on 13 April 2024, military police took a personal trainer from the stands to a police room after the stadium's facial recognition system flagged him as a man with an open arrest warrant; he was searched and questioned and released once police confirmed he was not the person sought (G1, his lawyer and the military police). Sergipe's governor publicly regretted 'the failure of the facial recognition tool' and suspended its use until a new protocol was adopted. In June 2024 the man sued the state for 550,000 reais in moral damages; the state argued that the Aracaju municipality, not the state, had contracted the system. In December 2025 the judge rejected that preliminary objection, according to Mangue Jornalismo, which read the court file. No final judgment is reported.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution supported · 3 sources, 2 underlying accounts · Added 24/10/2026
9 Dec 2025United StatesZeroEyes gun detection
On 9 December 2025 a Seminole County, Florida, middle school went into a Code Red lockdown and police rushed to the campus after the ZeroEyes AI weapons detection system, whose alerts are checked by the company's human analysts before police are notified, flagged a student holding a clarinet as a possible gun. According to a police report reviewed by The Washington Post (as relayed by Ars Technica) and obtained by WKMG News 6, officers expected an armed person in camouflage holding a shouldered rifle; dispatch later told them the suspected rifle was likely a band instrument, and police found the student, who was dressed as a military film character for a themed dress-up day, among panicked students hiding in the band room. Officers questioned him and found no weapon in his backpack or instrument case (Oviedo Community News, February 2026). The student said he was unaware the way he held the clarinet could trigger the alert. ZeroEyes said it had not made an error, while also treating the alert as a true positive only until officers on the ground found no rifle and then classifying it as a false positive; the district said the system worked as intended; the principal asked parents to talk to their children about the dangers of pretending to have a weapon.
Contextual tracker case Low reported severity Involving minors Media Coverage
AI involvement reported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 23/10/2026
Dec 2019 to Jul 2020United StatesUnidentified facial recognition system
In a complaint filed in federal court in Pennsylvania on 19 December 2023, the US Federal Trade Commission alleged that the pharmacy chain Rite Aid used facial recognition in its stores to match customers against a database of people it suspected of shoplifting or other wrongdoing, and that staff acted on the match alerts by following, searching, ejecting and publicly accusing customers and by calling the police. The FTC says many alerts were false positives: employees recorded thousands of false-positive alerts between December 2019 and July 2020, staff stopped and searched an 11-year-old girl on a false match, and employees called the police on a Black woman matched to an image of a white woman with blonde hair. Rite Aid agreed to a proposed order barring it from using facial recognition in retail stores for five years, without admitting or denying the allegations.
Contextual tracker case Medium reported severity Regulatory Action
AI involvement reported · Causal attribution alleged · 2 sources, 1 underlying account · Added 22/10/2026
Nov 2025ChinaUnidentified image tool
Police in Yangpu district, Shanghai, say a customer extorted restaurants with medical records he had forged using AI software; Xinhua dates his first successful claim to November 2025. In the police account (Shangguan News, 26 February 2026) he claimed to have fallen ill after eating at a barbecue restaurant, showed a hospital visit record and medical invoice, and demanded 2,000 yuan in medical costs, threatening complaints and publicity; the restaurant paid. Police checked with other diners and the hospital, found he had no hospital record and the materials were forged, and say he confessed to using AI software to alter images of other people's medical records, replacing the name, date and amount. Police say he succeeded twice and failed twice, obtaining 2,500 yuan, and that he also filed complaints to market regulators with the forged material to pressure the restaurants. According to Xinhua's June report and the Procuratorate Daily, the Yangpu District People's Court convicted him of extortion and sentenced him to four months' criminal detention, suspended for four months, and a 2,000 yuan fine.
Contextual tracker case Low reported severity Criminal Charges
AI involvement supported · Causal attribution established · 3 sources · Added 17/10/2026
Event date unknownBrazilUnidentified facial recognition system
Folha Vitória reported on 29 September 2026, citing the Espírito Santo Civil Police, that a 39-year-old man was arrested on 28 September on a preventive warrant after an inquiry into qualified theft by electronic fraud against an 81-year-old man in the north-west of the state. According to the police, the suspect, who worked as a security guard at a dance venue, invited the man to his home on the pretext of making a free-entry card, kept his bank card, obtained personal data and photographed his face. The police say he used the images to get past the facial recognition of the banking app and enable access to the account on his own phone, then reset security passwords, redeemed investments and made Pix transfers without the victim's knowledge, diverting R$6,080. The victim is described as illiterate. The police say the suspect had prior records and was serving a sentence under a progressive regime. Folha do ES and Tribuna Norte Leste carried the same police account but could not be read.
Contextual tracker case Low reported severity Criminal Charges
AI involvement reported · Causal attribution alleged · 1 source · Added 07/10/2026
26 Sept 2026United StatesFlock Safety license plate readers
WEKU, WKYT and LEX 18 reported that Lexington police surrounded a couple's home in the early hours of 26 September 2026 while investigating a reported assault in a road-rage incident. The victim had described a dark pickup truck and gave no license plate. The Lexington Police Department said officers searched its Flock camera network using the description, that only one return matched at that time of day, and that this led to the response to the residence. Doorbell video showed several police cars, spotlights and an officer with a gun unholstered at the door. Officers told the couple they were not suspects and left after about ten minutes. Police said they determined the truck was not the suspect vehicle, placed no charges and described the visit as following up a lead, not a misidentification. The residents said the response frightened them and a 94-year-old relative inside the home.
Contextual tracker case Low reported severity Media Coverage
AI involvement supported · Causal attribution supported · 3 sources · Added 05/10/2026
2 Aug 2020United StatesUnidentified license plate reader
On 2 August 2020 Aurora police officers stopped an SUV they believed to be stolen, ordered the woman driving it and four children to lie on the ground at gunpoint, and handcuffed two of the children. The Denver Post reported that a license plate reader at an Aurora intersection had alerted police because the SUV had the same plate number as a stolen motorcycle from Montana, and that officers did not check the reading or the vehicle description. Prosecutors declined to charge the officers in January 2021 and called what happened unacceptable and preventable. The department said all officers were repeating training on license plate scanners. Sentinel Colorado reported that the department's system had flagged the SUV, which carried Colorado plates, and that the City of Aurora agreed in February 2024 to a $1.9 million settlement with the woman and the children to resolve a lawsuit over the officers' actions. One officer was suspended for 160 hours. The woman said the stop destroyed her mentally and that one of the children became withdrawn.
Contextual tracker case Medium reported severity Involving minors Lawsuit Settled
AI involvement reported · Causal attribution supported · 2 sources · Added 05/10/2026
Jun 2026United StatesFlock Safety license plate readers
An automotive journalist for The Drive wrote that on a Sunday afternoon in late June four Plymouth police cars boxed in the Range Rover press vehicle the journalist was testing, in a Kohl's parking lot. Officers ordered the journalist and the journalist's wife out, patted the journalist down, questioned both and said the plates were stolen. According to the account, officers said they had tracked the vehicle for days through Flock license-plate cameras and acted on a camera alert that morning. The couple were released after about an hour, once the manufacturer explained that a similar plate had been reported stolen in California. In a follow-up, Flock's chief communications officer said the stolen plate had been entered without its two middle digits and that the system matched what it was asked to find. The spokesperson said an alert does not equal probable cause. The police chief acknowledged that officers did not get it right. A second journalist with a similar plate was later stopped in Nebraska.
Contextual tracker case Low reported severity Media Coverage
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 05/10/2026
Feb 2026United StatesFlock Safety license plate readers
KATV reported on 18 March 2026 that in February a Flock license-plate-reader camera in Sherwood, Arkansas flagged a black Chevrolet Tahoe as stolen. An officer stopped the car in a Kohl's parking lot, drew his weapon and detained the driver; a second officer arrived and the passenger, who was in the back seat next to a one-month-old child, was also detained. According to the incident report, the plate the camera matched belonged to the stolen vehicle in its system and the stopped car was a different vehicle: the camera's read was off by one letter. The officers released both people once they realized the mistake. After the incident the Sherwood Police Department set up a Flock transparency portal.
Contextual tracker case Medium reported severity Internal Action
AI involvement reported · Causal attribution supported · 1 source · Added 04/10/2026
Jun 2025United StatesFlock Safety license plate readers
In June 2025 Morristown, Tennessee, police stopped a couple driving their 3-year-old granddaughter to a doctor's appointment, held them at gunpoint and handcuffed them both. The grandmother's personalized plate spelled a nickname with the letter O; a Ford F-150 reported stolen in Claiborne County carried the same word spelled with a zero. Business Insider reported in March 2026 that officers received a Flock alert that the plate was stolen, that the Flock investigative summary recorded the couple's plate with a zero, and that the stolen pickup had already been recovered but was never removed from the system. The police department told WATE that the officer ran the tag as displayed, with an O, and that with either character it showed as stolen in the crime information database; the police chief told Business Insider that officers relied on the National Crime Information Center as protocol requires. The grandfather told WATE that he thought he might be shot and felt humiliated, and the grandmother said she was crying as she heard her granddaughter calling for her.
Contextual tracker case Medium reported severity Media Coverage
AI involvement reported · Causal attribution disputed · 2 sources · Added 04/10/2026
16 Apr 2021United StatesFlock Safety license plate readers (reported)
At about 5:30 a.m. on 16 April 2021, according to a lawsuit reported by The Almanac, an automated license-plate reader in Atherton, California, misread the dirt-obscured plate of a driver's car, reading its letter H as M, and matched it to a reported stolen vehicle. Atherton police followed the car for several minutes without visually verifying the plate, then made a high-risk felony stop, ordering him at gunpoint to throw his keys out of the window, get out and lie on his stomach to be handcuffed. He sued three officers in 2022 for unreasonable seizure and excessive force; the officers denied the allegations and the injuries he claimed, and the case was settled on 16 March 2023 for $45,000. Business Insider, citing police records, reported in March 2026 that the misread came from a Flock camera and that officers noted the Flock cameras had misread the plate; an Atherton police commander said the plate was obstructed by dirt and that the town denies wrongdoing.
Contextual tracker case Medium reported severity Lawsuit Settled
AI involvement supported · Causal attribution supported · 2 sources · Added 04/10/2026
Event date unknownUnited StatesFlock Safety license plate readers
KAKE News reported on 30 January 2024 that a Kansas couple whose minivan carries a four-digit University of Kansas alumni specialty plate were pulled over twice after Flock cameras flagged their plate number as belonging to a stolen vehicle. A stolen GMC pickup had a temporary tag with the same number, and the stolen-vehicle entry recorded the wrong plate type. In Colwich, Kansas, police stopped the wife after an alert from a Flock camera at the edge of town; the officer knew her vehicle and the problem was quickly found. About a month later, according to the husband, another Flock camera alerted police in Catoosa, Oklahoma, where officers blocked the couple's van in a parking lot, pointed drawn guns at them, ordered the husband out and onto his knees and handcuffed him. He said he was scared, and the couple say they worry such a stop could have devastating consequences for someone. Wichita police told KAKE that Flock cameras report only the plate's numbers and letters, not its type, and that the department had spoken with Flock about training its AI to recognize plate backgrounds.
Contextual tracker case Medium reported severity Media Coverage
AI involvement supported · Causal attribution supported · 1 source · Added 04/10/2026
23 Jul 2023United StatesFlock Safety license plate readers
On 23 July 2023 Española police officers pulled over a car driven by a 21-year-old woman with her 12-year-old sister as a passenger, after a Flock Safety camera at an intersection flagged the car's plate as belonging to a vehicle stolen in Rio Rancho. According to the sisters' lawsuits, reported by the Santa Fe New Mexican in January 2024, the camera had read a 2 on the plate as a 7, and officers handcuffed both sisters and placed them in the backs of separate police vehicles before discovering the error; the older sister had asked an officer to call their mother, who lived nearby, to collect the girl. The suits sought damages for anxiety, fear, worry and restriction of movement. Business Insider, which reviewed the body-camera footage and incident report, reported in March 2026 that officers said the number was obscured by a license plate cover although it is visible in the footage, and that the family settled with the city in 2025.
Contextual tracker case Medium reported severity Involving minors Lawsuit Settled
AI involvement supported · Causal attribution supported · 2 sources · Added 04/10/2026
11 Apr 2024United StatesFlock Safety license plate readers
On 11 April 2024 Toledo police officers stopped a pickup truck after a Flock license-plate camera alerted them to a stolen plate. According to the police report and body-camera footage reported by 13abc and ABC News, the camera had misread the plate, which was not stolen. Officers drew their guns, ordered the driver out and to the ground, and a K-9 handler released a police dog as he began to kneel. The driver told ABC News he was bitten seven times on his forearm and elbow, was traumatized and could not work; he was arrested and charged with obstruction, resisting arrest and, later, failure to comply. Prosecutors dropped all charges in August 2024. The department found the dog deployment within policy and reprimanded the officer who made the stop for failing to visually verify the plate against the reader's information. Business Insider reported in March 2026 that police records show the camera read a 7 on the plate as a 2, that the man lost feeling in his fingers, gave up his lawn-care business and forklift work, sold his truck and was evicted, and that he had sued the officer and the city and settled in October for $35,000.
Contextual tracker case High reported severity Lawsuit Settled
AI involvement supported · Causal attribution supported · 5 sources, 3 underlying accounts · Added 04/10/2026
17 Sept 2023United StatesUnidentified facial recognition system
Jason Killinger, a UPS truck driver, alleges in a federal civil-rights complaint filed in July 2025 that on 17 September 2023 the Peppermill Casino in Reno reported to police that its AI facial recognition software had identified him as a man barred from the casino months earlier. According to the complaint, casino security handcuffed him, and the responding Reno police officer, told the system had found a 100 percent match, did not examine his other identification and took him to jail as an unidentified person, where fingerprints confirmed who he was. The complaint says he was handcuffed for about four hours, starting in the casino security office, spent about eleven hours in police and jail custody, and was treated the next day for bruised wrists. According to the complaint, he was then charged with trespassing, and a prosecutor dismissed the charge without prejudice at the bench trial. Casino.org reports that he settled a suit against the casino. In March 2026 the court let him add the City of Reno and a municipal liability claim over facial recognition policies, but refused a new wrongful arrest claim against the officer on qualified immunity grounds. In September 2026 the ACLU, the ACLU of Nevada and the Innocence Project filed a proposed amicus brief supporting him. His September 2026 motion for partial summary judgment says a Reno police detective later concluded that the match was wrong and that he and the barred man were different people, and it cites a declaration by a former casino security officer, who worked there from about October 2024, that the system often alerted at 100 percent on the wrong people; in a declaration reported by Casino.org, the officer said he had never known the system to misidentify anyone. The case is ongoing.
Contextual tracker case Medium reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 9 sources, 3 underlying accounts · Added 04/10/2026
15 Sept 2026IndiaUnidentified traffic-violation detection camera
On 15 September 2026 a man was riding his wife's electric scooter alone in Bengaluru, from Hebbal towards Tin Factory, wearing a helmet and carrying a guitar on his back. An AI-enabled Bengaluru Traffic Police camera on the Outer Ring Road photographed him, and the next day an e-challan of ₹500 was generated for a pillion rider not wearing protective headgear; the photograph attached to it showed no passenger, only the guitar bag. The rider posted the challan on X and asked the traffic police to revoke it. A senior traffic police officer told Deccan Herald that the bag's position apparently led the AI-based system to classify it as a person sitting behind the rider, after which the system appears to have detected a helmet violation and generated the challan. Bengaluru Traffic Police replied that the violation could be rectified and gave an email address and phone numbers, and the joint commissioner of police (traffic) told the Times of India that the violation would be revoked if the complaint was found true. Whether it was revoked is not reported.
Contextual tracker case Low reported severity Media Coverage
AI involvement supported · Causal attribution supported · 4 sources, 3 underlying accounts · Added 02/10/2026
8 Jan 2026United KingdomUnidentified facial recognition system
The Guardian, in a joint report with Liberty Investigates, reported on 25 February 2026 that Alvi Choudhury, a 26-year-old software engineer, was arrested at his home in Southampton in January 2026 on suspicion of a £3,000 burglary in Milton Keynes, about 100 miles away, and held in custody for nearly 10 hours. Thames Valley Police had used automated retrospective facial recognition software, which matched him with CCTV footage of the burglary suspect. Choudhury says the man in the footage looked about 10 years younger and had different features. Thames Valley Police wrote to him that the arrest may have been the result of bias within facial recognition technology, and told the Guardian that the decision rested on the investigating officers’ own visual assessment and was not influenced by racial profiling. Choudhury is claiming damages from Thames Valley Police and Hampshire Constabulary.
Contextual tracker case Medium reported severity
AI involvement supported · Causal attribution disputed · 4 sources, 3 underlying accounts · Added 29/09/2026