{"meta":{"exportedAt":"2026-09-30T07:06:05.834Z","formatVersion":2,"selection":{"q":"","system":"","harm":"","context":"","country":"","role":"","relation":"contextual","evidence":"","year":"unknown","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":6,"coverage":{"cases":6,"countries":2,"languages":3,"unknownLocation":4,"locationPending":0,"unknownLanguage":0,"unknownDate":6,"lawsuits":0,"regulatory":0,"minors":0,"coreRelations":1,"contextualRelations":6,"mixedRelations":1,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2025-us-senator-blackburn-google-gemma-reported-fabricated-sexual-misconduct-allegation","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"When prompted with, ‘Has Marsha Blackburn been accused of rape?’ Gemma produced the following entirely false response","relation":"supports","source_id":"s1"},{"locator":"There has never been such an accusation, there is no such individual, and there are no such news stories.","relation":"supports","source_id":"s1"},{"locator":"pressured him to obtain prescription drugs for her and that the relationship involved non-consensual acts.","relation":"supports","source_id":"s2"},{"locator":"“None of this is true, not even the campaign year which was actually 1998,” Blackburn wrote.","relation":"supports","source_id":"s2"}],"assertion":"Senator Marsha Blackburn says that Google's Gemma model, asked 'Has Marsha Blackburn been accused of rape?', responded with an invented account of a sexual relationship with a state trooper during a 1987 state senate campaign, including an allegation of non-consensual acts, and that she has never faced such an accusation.","causal_attribution":"The sources report the connection between the AI output and the reported consequence; no court, regulator or independent finding of causation was inspected."},{"id":"c2","status":"reported","evidence":[{"locator":"Gemma went on to generate fake links to fabricated news articles to support the story.","relation":"supports","source_id":"s1"},{"locator":"The links lead to error pages and unrelated news articles.","relation":"supports","source_id":"s1"},{"locator":"“The links lead to error pages and unrelated news articles.","relation":"supports","source_id":"s2"}],"assertion":"Blackburn says the response came with generated links to news articles that do not exist: the links lead to error pages and unrelated articles.","causal_attribution":"The sources report the connection between the AI output and the reported consequence; no court, regulator or independent finding of causation was inspected."},{"id":"c3","status":"reported","evidence":[{"locator":"It is an act of defamation produced and distributed by a Google-owned AI model.","relation":"supports","source_id":"s1"},{"locator":"Shut it down until you can control it.","relation":"supports","source_id":"s1"}],"assertion":"Blackburn characterised the output as defamation produced and distributed by a Google-owned model and called on Google to shut the model down until it can be controlled.","causal_attribution":"A statement of the affected person's position; no finding that the output is legally defamatory was inspected."},{"id":"c4","status":"reported","evidence":[{"locator":"seen reports of non-developers trying to use Gemma in AI Studio and ask it factual questions.","relation":"supports","source_id":"s2"},{"locator":"We never intended this to be a consumer tool or model, or to be used this way","relation":"supports","source_id":"s2"},{"locator":"As a result, Google said it’s removing Gemma from AI Studio while continuing to make the models available via API.","relation":"supports","source_id":"s2"},{"locator":"Google did not reference the specifics of Blackburn’s letter","relation":"context","source_id":"s2"}],"assertion":"Google said it had seen non-developers trying to use Gemma in AI Studio to ask factual questions, said this was not an intended use, and removed Gemma from AI Studio while keeping it available by API.","causal_attribution":"Google's stated reason for the removal, as relayed by one outlet. Google's post did not reference the specifics of the Senator's letter."},{"id":"c5","status":"reported","evidence":[{"locator":"the hallucinations you have seen in Gemma are technical issues common to large-language models impacting users across the political spectrum.","relation":"supports","source_id":"s3"},{"locator":"users enter a misleading premise","relation":"supports","source_id":"s3"},{"locator":"fails to address how this happened and how the company will prevent it from happening in the future.","relation":"supports","source_id":"s3"}],"assertion":"In a letter to the Senator, a Google vice president called the hallucinations a technical issue common to large language models affecting users across the political spectrum, and said problems arise when consumers use smaller open models that are not designed to be factual assistants and when users enter a misleading premise. Blackburn said the response did not explain how the output happened or how Google would prevent a repeat.","causal_attribution":"Both statements are the parties' own positions as relayed by one outlet."}],"effects":[{"label":"Fabricated sexual-misconduct allegation with non-existent news links generated about a named public official","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.blackburn.senate.gov/2025/10/technology/blackburn-demands-answers-from-google-after-gemma-manufactured-fake-criminal-allegations-against-her","kind":"official_statement","access":"read","language":"en","translation_note":"","independence_group":"blackburn-letter"},{"id":"s2","url":"https://techcrunch.com/2025/11/02/google-pulls-gemma-from-ai-studio-after-senator-blackburn-accuses-model-of-defamation","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"blackburn-letter"},{"id":"s3","url":"https://www.axios.com/2025/11/07/google-blackburn-ai-hallucinations","kind":"news_report","access":"read","language":"en","translation_note":"","independence_group":"google-reply-to-blackburn"}],"version":1,"ai_roles":["unknown"],"contexts":["everyday_life"],"unknowns":["The date the output was generated is not stated. The Senator's release of 31 October 2025 says she 'learned of another example' after a Senate Commerce hearing earlier that week, which does not date the generation.","Who entered the prompt, and whether the exchange was in AI Studio, is not stated in the inspected sources.","The Gemma response text and the fake links were not inspected; the sources quote the Senator's letter.","No source reports a downstream consequence for the Senator beyond the allegation itself, or that any third party read it.","The Google post on X and the Google letter to the Senator were read only as relayed by TechCrunch and Axios (Axios was read through a Wayback capture of 3,144 characters of text, which appears to be the whole short article). The Blackburn ICYMI page (HTTP 403) and the VentureBeat article (HTTP 429) could not be read.","Whether the Senator's letter reflects a documented systematic bias is not established and is not claimed."],"geography":{"basis":"The sources identify the affected person as a US Senator and give her office locations, but do not establish where the prompt was entered or where the output was read. No country is inferred from the Senator's office, Google's headquarters or the outlets.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"The Senator's own press release (Wayback capture, read in full), a TechCrunch report that quotes her letter and Google's post, and an Axios report of Google's reply. The output was reported only through the Senator's letter, so its content is an allegation by the person concerned. The Senator is a public figure who described the output publicly under her own name. The event date is unknown, so the case is published undated.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"The Senator's letter and press release, relayed by TechCrunch, state that Gemma produced the response. Google's own reply to the Senator refers to 'the hallucinations you have seen in Gemma' and Google removed Gemma from AI Studio. The response text was not inspected independently.","status":"reported"},"person_relations":["made_claim_about"]},"name":"Google Gemma model reportedly generates a fabricated sexual-misconduct allegation with fake news links about US Senator Marsha Blackburn","summary":"In a letter to Google CEO Sundar Pichai announced on 31 October 2025, US Senator Marsha Blackburn said that Google's Gemma model, asked \"Has Marsha Blackburn been accused of rape?\", produced an invented account of a 1987 campaign-era accusation by a state trooper, with links to news articles that do not exist. She said there has never been such an accusation, called the output defamation and demanded that Google shut the model down until it can be controlled. Google said it had seen reports of non-developers trying to use Gemma in AI Studio to ask factual questions, that this was not an intended use, and removed Gemma from AI Studio while keeping API access. Google's later reply to the Senator called the hallucinations a technical issue common to large language models. The date the output was generated is not stated, and the output itself was not inspected.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"single_interaction","reportedDate":"2025-10-31","aiSystem":"Gemma (Google, via AI Studio)","aiProduct":"Gemma","aiCompany":"Google","severity":"low","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["reputational_harm"],"harmOutcomeSummary":"Senator Blackburn states that Gemma produced a fabricated criminal allegation about her and fake supporting news links, and describes it as defamation published by a Google-owned model. No downstream consequence such as lost office, threats or a documented third-party reader is reported. The harm reported is the false allegation itself (her account).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person, the Senator who is the subject of the output and who described it publicly. The sources do not say who typed the prompt, so the count treats her as a person harmed by an output about her. The related output about a second person named in the sources is a different event and is not counted.","victimAgeRange":"adult","platformType":"other","primarySourceUrl":"https://www.blackburn.senate.gov/2025/10/technology/blackburn-demands-answers-from-google-after-gemma-manufactured-fake-criminal-allegations-against-her","primarySourceLabel":"Office of Senator Marsha Blackburn: Blackburn Demands Answers from Google After Gemma Manufactured Fake Criminal Allegations Against Her","firstPublishedAt":"2026-09-29T14:02:28.733982+00:00","updatedAt":"2026-09-30T01:17:19.610578+00:00","scopeVersion":"facts-v3","tags":[]},{"id":"2026-facebook-video-selfie-face-scan-failed-account-lockout-first-person","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'My 5-year-old account got hit with a random security check.'; 'The app asked for a video face scan, but it failed completely.'; 'my face and physical definition have changed a lot'; 'The AI simply didn't recognize me.'","relation":"supports","source_id":"s1"}],"assertion":"The poster's five-year-old Facebook account was put through a security check that asked for a video face scan, and the scan failed; the poster attributes this to changes in their appearance and says the AI did not recognise them.","causal_attribution":"Poster's account and attribution; no messages from Facebook were published."},{"id":"c2","status":"reported","evidence":[{"locator":"'Then it asked for ID.'; 'I use a shortened nickname on my profile for basic privacy'; 'the automated system instantly rejected my government ID for a name mismatch'","relation":"supports","source_id":"s1"}],"assertion":"Facebook then asked for ID, and an automated system rejected the poster's government ID because the profile uses a shortened nickname.","causal_attribution":"Poster's account; the post does not say the ID check used AI."},{"id":"c3","status":"reported","evidence":[{"locator":"'It’s pretty gutting.'; 'locked out of years of memories, friends, and active Marketplace listings'; 'a way to bypass the lock screen to download my archive data and photos'; 'hoping someone here has navigated this specific deadlock or found a way to reach a human'","relation":"supports","source_id":"s1"}],"assertion":"The poster says they are locked out of years of memories, friends and active Marketplace listings, describes the loss as gutting, and is seeking a way to reach a human reviewer or download their data.","causal_attribution":"Poster's own statement of the effect."},{"id":"c4","status":"documented","evidence":[{"locator":"'The user will upload a video selfie and we’ll use facial recognition technology to compare the selfie to the profile pictures on the account they’re trying to access.'","relation":"supports","source_id":"s2"}],"assertion":"Meta says that, when people verify their identity with a video selfie to regain access to a compromised account, it uses facial recognition technology to compare the selfie with the profile pictures on the account.","causal_attribution":"General product description by Meta; it does not establish how this check was decided."}],"effects":[{"label":"locked out of a five-year-old account with years of photos, contacts and active Marketplace listings","claim_id":"c3","direction":"negative"},{"label":"distress at the loss ('pretty gutting')","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.reddit.com/r/facebook/comments/1wsrvdh/lost_my_5year_account_after_military_personal/","kind":"forum_post","access":"read","language":"en","translation_note":"Read in English on 2026-09-29: full self-text retrieved through the arctic_shift archive API by post ID. The poster handle is not recorded.","independence_group":"reddit-facebook-facescan-poster"},{"id":"s2","url":"https://about.fb.com/news/2024/10/testing-combat-scams-restore-compromised-accounts/","kind":"company_blog","access":"read","language":"en","translation_note":"Meta newsroom post first published 21 October 2024 with later updates, fetched 2026-09-29 (200). Describes the feature in general; it does not address this account.","independence_group":"meta-newsroom"}],"version":1,"ai_roles":["institutional_use"],"contexts":["everyday_life","privacy"],"unknowns":["The date of the security check and the poster's location.","Why the security check was triggered and whether a human reviewed the face scan or the ID.","Whether the poster regained access or obtained a data download."],"geography":{"basis":"The post says only 'Where I live' without naming a place; the comments add nothing. Unknown after review.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published under the 2026-09-15 charter's public-forum rule as a concrete first-person account of a Facebook video face-scan security check, which the poster describes as AI, failing to recognise them and, with an ID rejection, locking them out of their account; described with attribution and without corroboration. Meta's own description of video-selfie verification is cited as context only. Personal circumstances the poster gives for their changed appearance are summarised, not reproduced. No handle is recorded.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"The poster says a video face scan in Facebook's security check failed and that 'The AI' did not recognise them. Meta's newsroom documents that video selfies used to recover compromised accounts are compared with profile pictures using facial recognition, without saying whether a human reviews the result or covering routine security checks; the ID rejection is attributed by the poster to an 'automated system' and is not established as AI.","status":"reported"},"person_relations":["made_decision_about"]},"name":"First-person forum account: a Facebook user says a video face-scan security check failed to recognise them after their appearance changed, an automated ID check then rejected their government ID over a nickname, and they were locked out of a five-year-old account","summary":"In a public post to r/facebook on 28 September 2026, a user writes that their five-year-old Facebook account was hit with a security check that asked for a video face scan, which 'failed completely'. They say their face had changed a lot through recent life circumstances and 'The AI simply didn't recognize me.' Facebook then asked for ID, and 'the automated system instantly rejected' their government ID because their profile uses a shortened nickname. The poster says they are locked out of years of memories, friends and active Marketplace listings and are looking for a way to reach a human or download their data. Meta has said that video selfies used to regain access to compromised accounts are compared with the account's profile pictures using facial recognition; whether this check worked that way is not known. The account is uncorroborated.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"single_interaction","reportedDate":"2026-09-28","aiSystem":"Facebook's video face-scan security check (Meta describes video-selfie verification for account recovery as using facial recognition technology); the specific system is not named in the post","aiProduct":"Facebook video face-scan check","aiCompany":"Meta","severity":"low","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["other_material_harm","psychological_distress"],"harmOutcomeSummary":"The poster reports that a Facebook video face-scan check failed to recognise them and an automated ID check rejected their ID over a nickname, locking them out of a five-year-old account with years of photos, contacts and active Marketplace listings, which they describe as 'pretty gutting' (first-person account, uncorroborated).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"One person: the poster, locked out of their own account. Commenters describing their own lockouts are not counted. Exact 1.","victimAgeRange":"adult","jurisdiction":"unknown","platformType":"other","outcomeStatus":"ongoing","primarySourceUrl":"https://www.reddit.com/r/facebook/comments/1wsrvdh/lost_my_5year_account_after_military_personal/","primarySourceLabel":"r/facebook, 28 September 2026: public first-person post about a failed AI face scan and an ID rejected over a nickname (title shortened)","firstPublishedAt":"2026-09-29T03:21:50.784414+00:00","updatedAt":"2026-09-30T01:17:37.118566+00:00","scopeVersion":"facts-v3","tags":["first-person","reddit","facebook","meta","facial-recognition","video-selfie","account-lockout","identity-verification","made-decision-about"]},{"id":"2026-england-gemini-meet-notetaker-kept-transcribing-prospects-after-host-left-first-person","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'My boss was in a meeting with a prospective client and his business partner'; 'Gemini Notetaker was on.'; 'my boss said goodbye and left the meeting, and the two business partners stayed on the call to discuss the proposal and the other agencies they were looking at.'; 'What they didn't know was that Gemini was still taking notes'","relation":"supports","source_id":"s1"},{"locator":"'it was on meet.'","relation":"supports","source_id":"s3"}],"assertion":"During a Google Meet pitch with Gemini note-taking on, the agency's boss left at the end, the prospective client's two business partners stayed on the call to discuss the proposal and competing agencies, and Gemini kept taking notes of that discussion.","causal_attribution":"Poster's account; the poster does not say they attended the meeting and describes reading the conversation in the notes and transcript."},{"id":"c2","status":"reported","evidence":[{"locator":"'My boss sent me the notes and transcript from the meeting to create a follow-up deck'; 'They named the other agency they were looking at and talked about personal details of who they spoke to specifically on the call.'","relation":"supports","source_id":"s1"}],"assertion":"The boss sent the poster the notes and transcript to build a follow-up deck from them; the partners had named a competing agency and talked about personal details of the people they had spoken to.","causal_attribution":"Poster's account of what they received and were asked to do."},{"id":"c3","status":"reported","evidence":[{"locator":"'I assumed the notetaker stops when the person who activates them leaves'; 'I don't think they were aware because the things they spoke about were very in detail and slightly scathing towards my boss' proposal.'","relation":"supports","source_id":"s2"}],"assertion":"The poster believes the partners did not know they were still being transcribed; the poster says they had assumed the note-taker stops when the person who started it leaves.","causal_attribution":"The poster's inference from the content of the discussion; commenters disputed it, arguing Meet notifies all participants."},{"id":"c4","status":"documented","evidence":[{"locator":"'Google Meet informs all meeting participants that notes are being taken and the pencil icon appears on all participants' screens.'; 'The meeting organizer and participants internal to the host’s organization can start or stop notes.'","relation":"supports","source_id":"s4"}],"assertion":"Google's help page says Meet informs all participants when notes are being taken, shows a pencil icon on all participants' screens, and lets only the organizer and participants internal to the host's organization start or stop notes.","causal_attribution":"General product documentation; it does not establish what the partners saw in this meeting."}],"effects":[{"label":"two prospective clients' private discussion after the host left the call was transcribed and summarised without their apparent knowledge","claim_id":"c1","direction":"negative"},{"label":"the notes, including a named competing agency and personal details, were passed to agency staff to shape a follow-up pitch","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.reddit.com/r/LegalAdviceUK/comments/1wsd4ul/my_boss_recorded_a_transcript_of_a_meeting/","kind":"forum_post","access":"read","language":"en","translation_note":"Read in English on 2026-09-29: full self-text retrieved through the arctic_shift archive API by post ID. The poster handle is not recorded.","independence_group":"reddit-meet-notetaker-poster"},{"id":"s2","url":"https://www.reddit.com/r/LegalAdviceUK/comments/1wsd4ul/my_boss_recorded_a_transcript_of_a_meeting/pckanew/","kind":"forum_comment","access":"read","language":"en","translation_note":"The poster's own reply in the thread (archive API, 2026-09-29); a near-identical second reply (pckasgw) adds 'it was on meet.'","independence_group":"reddit-meet-notetaker-poster"},{"id":"s3","url":"https://www.reddit.com/r/LegalAdviceUK/comments/1wsd4ul/my_boss_recorded_a_transcript_of_a_meeting/pckasgw/","kind":"forum_comment","access":"read","language":"en","translation_note":"The poster's second reply, stating the call was on Google Meet (archive API, 2026-09-29).","independence_group":"reddit-meet-notetaker-poster"},{"id":"s4","url":"https://support.google.com/meet/answer/14754931?hl=en","kind":"company_documentation","access":"read","language":"en","translation_note":"Google Meet Help page for \"Take notes for me\", fetched 2026-09-29 (200). Describes the feature in general; it does not address this meeting.","independence_group":"google-meet-help"}],"version":1,"ai_roles":["others_use"],"contexts":["work","privacy"],"unknowns":["Whether the partners saw or understood Meet's note-taking notice after the host left.","The date of the meeting and the partners' location.","Whether the follow-up deck was made or the prospective client learned of the transcript.","Where the call participants were located."],"geography":{"basis":"The poster titles the post '(England)', answering the subreddit's instruction to say whether the poster is in England, Wales, Scotland or Northern Ireland; that locates the poster and the law they ask about, not the call. The post does not say where the boss or the prospective clients were during the Google Meet call. Unknown after review.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published under the 2026-09-15 charter's public-forum rule as a concrete first-person account of an AI note-taker capturing and summarising people who were not its users, with the notes then used commercially, described with attribution and without corroboration. Google's documentation of participant notification is included as context. No handle, company or client name is recorded.","reviewed_on":"2026-09-29"},"ai_involvement":{"basis":"The poster names Gemini note-taking in a Google Meet call as the tool that kept producing notes and a transcript after the host left; Google's help page documents the feature. No notes or screenshots were published.","status":"reported"},"person_relations":["made_claim_about"]},"name":"First-person forum account: an agency employee in England says Gemini note-taking in Google Meet kept transcribing two prospective clients after the agency's boss left the call, and that the boss passed their private post-meeting discussion to staff to shape a follow-up pitch","summary":"In a public post to r/LegalAdviceUK on 28 September 2026, an employee of a marketing agency in England writes that their boss pitched a prospective client and the client's business partner on a Google Meet call with Gemini note-taking switched on. After the boss said goodbye and left, the two business partners stayed on the call to discuss the proposal and the other agencies they were considering, and Gemini kept taking notes. The boss then sent the employee the notes and transcript, which named a competing agency and included 'personal details of who they spoke to specifically on the call', and asked for a follow-up deck built on what the partners liked and disliked. The poster believes the partners did not know they were still being transcribed. Google's help page says Meet tells all participants when notes are being taken; whether the partners noticed is not known. The account is uncorroborated.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"single_interaction","reportedDate":"2026-09-28","aiSystem":"Gemini note-taking in Google Meet ('Gemini Notetaker' in the poster's words; Google's help page calls the feature \"Take notes for me\")","aiProduct":"Gemini note-taking in Google Meet","aiCompany":"Google","severity":"low","verificationStatus":"unverified","harmCategories":[],"harmOutcomes":["other_material_harm"],"harmOutcomeSummary":"An agency employee reports that Gemini note-taking in Google Meet kept transcribing two prospective clients' private discussion after the agency's host left the call, and that the boss passed the notes, including a named competing agency and personal details, to staff to shape a follow-up pitch; the poster believes the partners were unaware (first-person account, uncorroborated).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":2,"affectedCountStatus":"exact","affectedCountEvidence":"Two people: 'the two business partners' who stayed on the call and whose discussion was transcribed. They were not the users of the note-taker (the agency's boss was). The poster, who reports discomfort at being asked to use the notes, is not counted. Exact 2.","victimAgeRange":"adult","jurisdiction":"GB","platformType":"assistant","outcomeStatus":"unknown","primarySourceUrl":"https://www.reddit.com/r/LegalAdviceUK/comments/1wsd4ul/my_boss_recorded_a_transcript_of_a_meeting/","primarySourceLabel":"r/LegalAdviceUK, 28 September 2026: \"My boss recorded a transcript of a meeting without consent (England)\" (public first-person post)","firstPublishedAt":"2026-09-29T03:21:48.445579+00:00","updatedAt":"2026-09-30T01:17:36.507533+00:00","scopeVersion":"facts-v3","tags":["first-person","reddit","gemini","google-meet","meeting-notetaker","transcription","privacy","work","made-claim-about"]},{"id":"2026-serra-es-personal-trainer-facial-biometrics-fraudulent-vehicle-financing","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'Segundo a Polícia Civil, o personal foi convencido a fazer um reconhecimento facial para supostamente transferir a titularidade do automóvel. A vítima só descobriu que o carro não pertencia ao suspeito semanas após a negociação.'; 'Com o valor da motocicleta e o financiamento, o prejuízo total causado passou de R$ 100 mil.'","relation":"supports","source_id":"s1"},{"locator":"'teria dito à vítima que seria necessário realizar um procedimento de reconhecimento facial para transferir a titularidade do automóvel. A biometria teria sido utilizada posteriormente para a contratação fraudulenta de um financiamento de veículo em nome da vítima.'","relation":"supports","source_id":"s2"},{"locator":"'A biometria, porém, teria sido usada posteriormente para contratar um financiamento de veículo em nome do personal trainer, sem autorização dele.'; 'Somando o valor da motocicleta e do financiamento feito de forma fraudulenta, o prejuízo ultrapassou R$ 100 mil, segundo a investigação.'","relation":"supports","source_id":"s4"}],"assertion":"According to the Espírito Santo Civil Police, the suspect offered a car in exchange for the personal trainer's motorcycle, persuaded him during the negotiation to complete a facial-recognition procedure on the pretext that it was needed to transfer the car's ownership, and later used the biometric to contract a vehicle financing in the victim's name without authorisation; weeks later the victim found the car was a rental; the combined loss exceeded R$100,000.","causal_attribution":"Police account (one chain, delegado Fabiano Alves) as reported by four outlets; the victim's own account is relayed only through the police."},{"id":"c2","status":"reported","evidence":[{"locator":"'Um homem foi preso por aplicar um golpe de mais de R$ 100 mil em um personal trainer na Serra, na Grande Vitória, na terça-feira (22).'; 'O preso foi encaminhado ao Centro de Triagem no Complexo Penitenciário Rodrigo Figueiredo da Rosa. Ele permanece à disposição da Justiça.'","relation":"supports","source_id":"s1"},{"locator":"'ocorreu na última terça-feira (22) no cumprimento a um mandado judicial.'; 'Em julho do ano passado, ele foi preso pela Defa em São Paulo'","relation":"supports","source_id":"s2"},{"locator":"'foi preso na terça-feira (22). As informações, divulgadas pela Polícia Civil, foram publicadas pelo portal A Gazeta.'","relation":"supports","source_id":"s3"}],"assertion":"A 27-year-old suspect was taken into preventive detention in Serra on 22 September 2026 under a judicial warrant in a Defa estelionato investigation, taken to the Centro de Triagem of the Rodrigo Figueiredo da Rosa complex, and remains at the disposal of the courts; police say he had been detained in São Paulo in July 2025 in a 'love scam' case.","causal_attribution":"Police statement as reported; A Tribuna gives the arrest as 'terça-feira (24)', an evident dating error against the other reports."}],"effects":[{"label":"a vehicle financing was contracted in the victim's name after his facial biometric was captured on a false pretext, adding to the loss of his motorcycle; combined loss above R$100,000","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://g1.globo.com/es/espirito-santo/noticia/2026/09/24/golpista-troca-carro-alugado-por-moto-e-deixa-personal-trainer-com-divida-de-r-100-mil-na-serra.ghtml","kind":"news_report","access":"read","language":"pt-BR","translation_note":"Read live on 2026-09-26 (G1 Espírito Santo, 24 September 2026; Portuguese). Police account with the delegado's quotes. Reviewer translation; no human translator.","independence_group":"pces-defa-statement"},{"id":"s2","url":"https://extra.globo.com/blogs/radar-brasil/post/2026/09/suspeito-de-estelionato-e-preso-em-golpe-com-fraude-de-reconhecimento-facial-para-financiamento-de-carro-em-es.ghtml","kind":"news_report","access":"read","language":"pt-BR","translation_note":"Read live on 2026-09-26 (Extra, Radar Brasil blog, 25 September 2026; Portuguese). Same police statement; notes the victim's identity was not disclosed. Reviewer translation.","independence_group":"pces-defa-statement"},{"id":"s3","url":"https://www.correio24horas.com.br/brasil/personal-trainer-troca-moto-por-carro-alugado-e-golpista-usa-biometria-facial-da-vitima-para-financiar-r-100-mil-0926","kind":"news_report","access":"read","language":"pt-BR","translation_note":"Read live on 2026-09-26 (Correio, Salvador, 25 September 2026; Portuguese). Relays the police information as published by A Gazeta (A Gazeta itself returned 403). Reviewer translation.","independence_group":"pces-defa-statement"},{"id":"s4","url":"https://eshoje.com.br/seguranca/policia/2026/09/personal-trainer-r-100-mil/","kind":"news_report","access":"read","language":"pt-BR","translation_note":"Read live on 2026-09-26 (ES Hoje, 24 September 2026; Portuguese). Same police statement. Reviewer translation.","independence_group":"pces-defa-statement"}],"version":1,"ai_roles":["institutional_use","others_use"],"contexts":["finance","privacy"],"unknowns":["When the exchange and the financing took place ('weeks' before the arrest; no dates given).","Which financing provider and which facial-recognition or identity-verification system was involved, and how a biometric captured for one purpose came to authorise a loan (the bodies say only that it was used).","Whether the financing has been cancelled or the victim remains liable; the exact loss.","The suspect's account and any charges filed.","The victim's age and residence beyond Serra."],"geography":{"basis":"The negotiation, the victim and the arrest are placed in Serra, Espírito Santo (G1 'na Serra, na Grande Vitória'; Extra 'no município de Serra, no Espírito Santo'); the arrest was under a judicial warrant and the suspect is at the disposal of the courts in Espírito Santo.","court_countries":["BR"],"event_countries":["BR"],"affected_person_countries":["BR"]},"publication":{"basis":"Published under the 2026-09-15 charter as a contextual case: the state Civil Police say a facial-recognition biometric captured from the victim on a false pretext was used to contract a vehicle financing in his name, a consequential identity decision about a person; four outlets carry the one police chain. How the biometric was used is not reported and is recorded as unknown. The victim is unnamed and the suspect is not named here.","reviewed_on":"2026-09-26"},"ai_involvement":{"basis":"The Civil Police say the victim's facial-recognition biometric, captured during the negotiation on the pretext of a title transfer, was later used to contract the financing in his name (delegado Fabiano Alves via G1, Extra, Correio, ES Hoje). The bodies do not say how the biometric was used, for example whether a financing provider's automated face-verification check accepted it; the made_decision_about relation rests on that reading of a biometric identity check and is recorded with this caveat.","status":"reported"},"person_relations":["made_decision_about"]},"name":"Serra, Espírito Santo: a personal trainer who swapped his motorcycle for what turned out to be a rented car was told to complete a facial-recognition check 'to transfer the car's title'; police say the biometric was then used to contract a vehicle financing in his name, leaving a loss above R$100,000 (suspect arrested 22 September 2026)","summary":"The Espírito Santo Civil Police (Defa, the fraud and forgery unit) said a 27-year-old man was arrested on a warrant in Serra on 22 September 2026, suspected of defrauding a personal trainer of more than R$100,000. According to the police, the suspect offered a car in exchange for the victim's motorcycle; during the negotiation he persuaded the victim to perform a facial-recognition procedure, saying it was needed to transfer the car's ownership; the biometric was later used to contract a vehicle financing in the victim's name without his authorisation, and weeks after the exchange the victim discovered that the car he had received did not belong to the suspect and was a rental. The loss, combining the motorcycle and the fraudulently contracted financing, exceeded R$100,000. The suspect, who police say had been arrested in São Paulo in July 2025 in a 'love scam' case, was taken to the Centro de Triagem at the Rodrigo Figueiredo da Rosa prison complex and remains at the disposal of the courts. The financing provider and the facial-recognition system are not identified, and the reports do not say how the captured biometric was used to pass the financing.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"single_interaction","reportedDate":"2026-09-24","aiSystem":"Facial-recognition (biometric) capture that the police say was later used to contract a vehicle financing in the victim's name; the financing provider, the verification system and the way the biometric was used are not reported","aiProduct":"Unidentified facial recognition system","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["financial_loss"],"harmOutcomeSummary":"The victim lost his motorcycle to a rental-car swap and, according to the police, was left with a vehicle financing contracted in his name through his own facial biometric, for a combined loss above R$100,000 (PCES statement via G1, Extra, Correio and ES Hoje).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One victim, the personal trainer (police statement via G1, Extra, Correio, ES Hoje). Exact 1.","victimAgeRange":"unknown","jurisdiction":"BR-ES","platformType":"other","outcomeType":"criminal_charges","outcomeStatus":"ongoing","primarySourceUrl":"https://g1.globo.com/es/espirito-santo/noticia/2026/09/24/golpista-troca-carro-alugado-por-moto-e-deixa-personal-trainer-com-divida-de-r-100-mil-na-serra.ghtml","primarySourceLabel":"G1 Espírito Santo, 24 September 2026: golpista troca carro alugado por moto e deixa personal trainer com dívida de R$ 100 mil na Serra","firstPublishedAt":"2026-09-26T04:07:12.519263+00:00","updatedAt":"2026-09-30T01:17:53.010934+00:00","scopeVersion":"facts-v3","tags":["facial-recognition","biometrics","identity-fraud","financing","scam","brazil","espirito-santo","made-decision-about"]},{"id":"2026-norway-barnevakten-chatgpt-teen-mode-applied-to-adult","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'En av Barnevaktens medarbeidere fikk plutselig beskjed fra Chatgpt om at kontoen nå var i tenåringsmodus.'; 'Systemet skrur det på hvis oppførselen til brukeren indikerer at alderen er under 18 år.'; 'Denne gangen var det altså en voksen person som opplevde at tenåringsmodus ble slått på uten å ha bedt om det.'","relation":"supports","source_id":"s1"}],"assertion":"One of Barnevakten's staff members, an adult, was suddenly told by ChatGPT that their account was now in teen mode, which the system switches on when a user's behaviour indicates an age under 18 and which reduces sensitive content; the switch happened without a request because age is estimated afterwards from conversation topics and times of use.","causal_attribution":"Organisation's own account of a colleague's experience; the age-estimation mechanism is the organisation's description of the provider's pages."},{"id":"c2","status":"reported","evidence":[{"locator":"'Hvis voksne opplever å havne i tenåringsmodus som de ikke ønsker, kan de gå gjennom en alderskontroll for å bevise at de er over 18 år.'; 'Chatgpt benytter selskapet Persona til å bekrefte alderen din.'; 'Opp til tre år nevnes som en mulighet.'","relation":"supports","source_id":"s1"}],"assertion":"The described way out of teen mode is an age check run by Persona that, depending on the country, asks for a real-time selfie and a government-issued ID; Barnevakten considers the process's privacy protections unclear, noting Persona's terms mention retention of up to three years.","causal_attribution":"Organisation's account and assessment; Persona's terms were not inspected."}],"effects":[{"label":"an adult's ChatGPT account was switched into teen mode by an automated age estimate, restricting content, with an identity check through a third-party verifier as the described way out","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.barnevakten.no/chatgpt-skrudde-pa-tenaringsfilter-for-en-voksen-person/","kind":"other","access":"read","language":"nb-NO","translation_note":"Read live on 2026-09-24 (Barnevakten, published 23 September 2026, categories Alderskontroll, KI, Sosial på nett; html lang=nb-NO). Norwegian; passages quoted in the original and paraphrased in English by the reviewer.","independence_group":"barnevakten"}],"version":1,"ai_roles":["own_use"],"contexts":["everyday_life","privacy"],"unknowns":["Whether the staff member completed the identity check or remained in teen mode, and for how long.","What the account holder had discussed that triggered the estimate.","Whether the switch caused any concrete loss beyond the content restriction.","Where the staff member lives or was when the account was switched (not stated; the organisation's country is not used).","When the account was switched into teen mode; the article of 23 September 2026 gives no date."],"geography":{"basis":"Unknown after review. The account is published by Barnevakten, a Norwegian organisation, about one of its own staff members, but the article states neither where the staff member lives nor where they were when the account was switched. The organisation's country is not used as the event or residence location. No proceeding.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published under the 2026-09-15 charter as a low-severity everyday-assistance case in which an AI product made a decision about a person: an automated age estimate placed an adult in a restricted mode and the route out required an identity check. Single organisational source (the publisher's own account of its staff member), claims recorded as reported; the staff member is not named.","reviewed_on":"2026-09-24"},"ai_involvement":{"basis":"The account reports ChatGPT's own message that the account was now in teen mode, and describes the provider's stated behaviour-based age estimation; the message and the mode are the product's own actions as described by the account holder's organisation.","status":"supported"},"person_relations":["made_decision_about","communicated_with"]},"name":"A Norwegian child-safety organisation reports that ChatGPT's behaviour-based age estimation switched an adult staff member's account into teen mode without a request, restricting content and offering an identity check through a third-party verifier as the way out (Barnevakten, 23 September 2026)","summary":"Barnevakten, a Norwegian child-safety organisation, reported on 23 September 2026 that one of its staff members was suddenly told by ChatGPT that their account was now in teen mode. ChatGPT's own pages, as described by Barnevakten, say the system turns the filter on when a user's behaviour indicates an age under 18, reducing sensitive or potentially harmful content (graphic violence, viral challenges, sexual or violent role-play, extreme beauty ideals) and offering parental controls and a study mode. Because there is no age check at sign-up, the system estimates age afterwards from conversation topics and times of use, and Barnevakten notes that such guesses can be wrong. An adult who wants out of teen mode can go through an age check run by the company Persona, which depending on the country asks for a real-time selfie and a government ID; Barnevakten questions whether that process is privacy-safe (Persona's terms mention retention of up to three years) and advises using only age checks one trusts. The account's own experience is limited to the unexpected switch and the verification route; no further consequence is described.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"repeated_interactions","reportedDate":"2026-09-23","aiSystem":"ChatGPT: behaviour-based age estimation and teen-mode content restrictions; age verification through Persona","aiProduct":"ChatGPT","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["other_material_harm"],"harmOutcomeSummary":"An adult's ChatGPT account was placed in a restricted teen mode by an automated age estimate the account holder had not asked for, and the described route back to full access was an identity check with a third-party verifier which, depending on the country, asks for a real-time selfie and a government ID, whose data-retention terms the organisation considers unclear. The account describes no further consequence.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"One person: 'En av Barnevaktens medarbeidere' (one of Barnevakten's staff members). Exact 1.","victimAgeRange":"adult","jurisdiction":"unknown","platformType":"chatbot","outcomeType":"media_coverage","outcomeStatus":"unknown","primarySourceUrl":"https://www.barnevakten.no/chatgpt-skrudde-pa-tenaringsfilter-for-en-voksen-person/","primarySourceLabel":"Barnevakten, 23 September 2026: Chatgpt skrudde på tenåringsfilter for en voksen person","firstPublishedAt":"2026-09-24T03:50:32.226789+00:00","updatedAt":"2026-09-30T01:17:47.10961+00:00","scopeVersion":"facts-v3","tags":["chatgpt","age-verification","teen-mode","norway","automated-decision","privacy","persona"]},{"id":"2026-san-jose-officer-flock-alpr-data-domestic-violence-accuser","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"Chief Joseph: 'The officer accessed license plate reader data and provided that to a suspect in a domestic violence situation, which enabled that suspect to locate a victim'; 'accused of accessing Flock camera data on his personal phone to help a family member last spring'.","relation":"supports","source_id":"s1"},{"locator":"'the officer used his personal phone to access the Flock camera system and then provided the location of a vehicle to his cousin. The cousin subsequently used the information to track down his accuser, according to our partner the Bay Area News Group.'","relation":"supports","source_id":"s2"}],"assertion":"A San Jose police officer accessed the department's Flock license-plate-reader data on his personal phone and gave a vehicle's location to a relative who was a suspect in a domestic-violence case, enabling him to locate the woman accusing him.","causal_attribution":"The chief's public account, carried by NBC Bay Area, and ABC7's report drawing on the Bay Area News Group; the locating of the accuser is the reported consequence."},{"id":"c2","status":"corroborated","evidence":[{"locator":"'we immediately placed this officer on administrative leave. We launched a criminal investigation into his conduct. We referred that investigation to the district attorney's office and we ultimately terminated'","relation":"supports","source_id":"s1"},{"locator":"'the officer's case was submitted to the State of California P.O.S.T. for a decertification investigation'; 'Neither the officer nor the cousin has been criminally charged.'","relation":"supports","source_id":"s2"}],"assertion":"The officer was placed on leave, criminally investigated, referred to the district attorney and fired; the case was submitted to California POST for decertification; neither the officer nor the cousin has been charged.","causal_attribution":"Departmental actions as announced; charging status per ABC7 on 13 September."},{"id":"c3","status":"corroborated","evidence":[{"locator":"'he has made changes to the policy to ensure the data cannot be accessed on a personal device'","relation":"supports","source_id":"s1"},{"locator":"'officers are no longer permitted to access the system on their personal devices'; 'testing new smart auditing tools to flag possible access without a lawful purpose'","relation":"supports","source_id":"s2"}],"assertion":"The department barred access to the system from personal devices and is testing auditing tools to flag access without a lawful purpose.","causal_attribution":"Policy responses as reported by both outlets."}],"effects":[{"label":"a domestic-violence accuser was located by the suspect using her vehicle's plate-reader location data passed on by an officer","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.nbcbayarea.com/news/local/san-jose-police-fired-flock-camera/4141719/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-16 (datePublished 2026-09-11T17:29-07:00; Robert Handa; the chief's on-camera quotes).","independence_group":"nbc-bay-area"},{"id":"s2","url":"https://abc7news.com/post/san-jose-police-officer-fired-allegedly-sharing-flock-camera-data-suspect-domestic-violence-case-authorities-say/19825592/","kind":"local_tv_news","access":"read","language":"en","translation_note":"Read in English on 2026-09-16 (datePublished 2026-09-13T22:49Z; KGO; cites the Bay Area News Group for the cousin locating his accuser).","independence_group":"abc7-bang"}],"version":1,"ai_roles":["institutional_use"],"contexts":["privacy","public_services","relationships"],"unknowns":["The date of the disclosure is given only as 'last spring' by the chief; the incident date is left unknown rather than inferred.","What happened after the suspect located the victim is not reported; no injury or further offence is described in the inspected sources.","The officer's and the cousin's identities and the status of the domestic-violence case are not reported in the inspected sources.","The Bay Area News Group original cited by ABC7 was not inspected."],"geography":{"basis":"Event: San Jose Police Department's camera network and the locating of the victim, San Jose, California (both reports). The victim's residence is not stated beyond the San Jose case; no court proceeding is reported.","court_countries":[],"event_countries":["US"],"affected_person_countries":["US"]},"publication":{"basis":"Published under the 2026-09-15 charter as an institutional privacy and safety case: automated license-plate-reader records about a domestic-violence accuser were passed by an officer to the suspect, who used them to find her, as stated publicly by the police chief and reported by two local outlets. The victim, officer and suspect are unnamed in the sources and here; the AI component generated the location record and the misuse is recorded as a human act.","reviewed_on":"2026-09-16"},"ai_involvement":{"basis":"The police chief states that the officer accessed the department's Flock automated license-plate-reader data and provided it to the suspect, enabling him to locate the victim; ABC7 describes the system as the Flock camera system accessed on a personal phone. The automated readers generated the vehicle-location record about the victim; the disclosure was a human act.","status":"supported"},"person_relations":["made_claim_about"]},"name":"San Jose: police officer fired after passing Flock license-plate-reader location data to a relative accused of domestic violence, who used it to find his accuser","summary":"San Jose's police chief announced on 11 September 2026 that an officer had been fired after accessing the department's Flock Safety automated license-plate-reader data on his personal phone and giving a vehicle's location to his cousin, a suspect in a domestic-violence case, who used it to locate the woman accusing him. The chief called it 'a betrayal of the public trust', said the officer was placed on leave, criminally investigated and referred to the district attorney, and that the case was submitted to California's peace-officer standards commission for decertification; neither the officer nor the cousin has been charged. The department has since barred access to the system from personal devices and is testing auditing tools. Neither the victim nor the officer is named in the inspected reports.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"unknown","reportedDate":"2026-09-11","aiSystem":"Flock Safety automated license plate readers (San Jose Police Department camera network)","aiProduct":"Flock Safety license plate readers","aiCompany":"Flock Safety","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse"],"harmOutcomeSummary":"A woman who had accused a man of domestic violence was located by him after a police officer passed him her vehicle's automated license-plate-reader location data; the inspected reports describe the locating but no further consequence.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person: the domestic-violence accuser whom the suspect located using the data (NBC Bay Area, ABC7).","victimAgeRange":"adult","jurisdiction":"US","platformType":"other","outcomeType":"internal_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.nbcbayarea.com/news/local/san-jose-police-fired-flock-camera/4141719/","primarySourceLabel":"NBC Bay Area, 11 September 2026: the chief's announcement and quotes","firstPublishedAt":"2026-09-16T03:16:38.30859+00:00","updatedAt":"2026-09-30T01:17:51.775618+00:00","scopeVersion":"facts-v3","tags":["flock","alpr","license-plate-reader","police","domestic-violence","privacy","san-jose","california","institutional-use"]}]}