{"meta":{"exportedAt":"2026-10-21T06:56:42.739Z","formatVersion":2,"selection":{"q":"regulator","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"","response":"regulatory","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":11,"coverage":{"cases":11,"countries":6,"languages":6,"unknownLocation":4,"locationPending":0,"unknownLanguage":0,"unknownDate":2,"lawsuits":0,"regulatory":11,"minors":5,"coreRelations":7,"contextualRelations":1,"mixedRelations":0,"unknownRelations":3,"relationPending":3,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2024-ontario-hospital-otter-ai-bot-recorded-physicians-rounds-meeting-and-emailed-patient-health-information","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"Letter: 'October 27, 2025'; 'Reported Breach HR24-00691'; 'On December 17, 2024, you reported a privacy breach under the Personal Health Information Protection Act'.","relation":"supports","source_id":"s1"}],"assertion":"The Information and Privacy Commissioner of Ontario wrote to the hospital on 27 October 2025 about a privacy breach the hospital had reported on 17 December 2024 under the Personal Health Information Protection Act (file HR24-00691).","causal_attribution":"The letter itself establishes its date, file and the reported breach it addresses."},{"id":"c2","status":"reported","evidence":[{"locator":"Letter: 'a virtual hepatology rounds meeting attended by hospital physicians was inadvertently recorded by an artificial intelligence-powered transcription tool'; 'The physician left his employment with the hospital in June 2023. He installed Otter.ai on his personal device in September 2024.'; 'the Tool was able to join the September 23, 2024 hepatology rounds meeting via accessing the link to it in the physician'; 'and record the meeting without' (page break) 'notice. This was discovered'.","relation":"supports","source_id":"s1"},{"locator":"'an Otter.ai bot attended the meeting in his place'","relation":"supports","source_id":"s2"}],"assertion":"According to the hospital's report as recorded by the IPC, on 23 September 2024 the Otter.ai AI transcription tool joined a virtual hepatology rounds meeting of hospital physicians through the meeting link in a former physician's personal calendar and recorded the meeting without notice; the physician had left the hospital in June 2023 and installed Otter.ai on his personal device in September 2024.","causal_attribution":"The hospital's own breach report, relayed by the regulator; the Globe relays the same letter."},{"id":"c3","status":"reported","evidence":[{"locator":"Letter: 'the personal health information of seven patients was discussed amongst the meeting participants and captured in the transcript'; 'diagnoses, medical notes, and treatment information'.","relation":"supports","source_id":"s1"}],"assertion":"The personal health information of seven patients admitted to the hospital, including names, sex, diagnoses, medical notes and treatment information, was discussed in the meeting and captured in the transcript.","causal_attribution":"Hospital's report as recorded by the IPC."},{"id":"c4","status":"reported","evidence":[{"locator":"Letter: 'This was discovered when a meeting summary and access to a transcript of the recording was automatically emailed to participants after the meeting'; 'of the 65 users on the recipient list, 53 responded confirming they either deleted the email or never received it'; 'the remaining 12 individuals appear to have departed from the hospital'.","relation":"supports","source_id":"s1"},{"locator":"'sent a summary and a link to a transcript of the meeting to 65 people on the invite list, 12 of whom were no longer employed by the hospital'","relation":"supports","source_id":"s2"}],"assertion":"The breach was discovered when the tool automatically emailed a meeting summary and access to the transcript to participants; 65 users were on the recipient list, 53 confirmed deleting the email or never receiving it, and the remaining 12 appeared to have left the hospital.","causal_attribution":"Hospital's report as recorded by the IPC; the Globe relays the same figures."},{"id":"c5","status":"reported","evidence":[{"locator":"Letter: 'the physician did not respond to this request'; 'Submit a formal request to Otter.ai to delete any personal health information'.","relation":"supports","source_id":"s1"}],"assertion":"The hospital asked the former physician to have Otter.ai delete the recording, but he did not respond; the IPC recommended that the hospital itself formally ask Otter.ai to delete any patient information retained from the meeting.","causal_attribution":"Mixed origin: the recommendation is the IPC's own and documented by the letter; the physician's non-response is the hospital's report recorded in the letter, so the whole claim is reported."},{"id":"c6","status":"reported","evidence":[{"locator":"Letter: 'five of seven affected individuals were notified of the breach by letter on December 17, 2024'; 'the other two affected individuals are deceased'; 'For one of these individuals, the hospital provided a copy of the notice letter to their estate trustee'; 'uploaded a copy of the notice letter to the patient’s electronic health record'.","relation":"supports","source_id":"s1"}],"assertion":"Five of the seven patients were notified by letter on 17 December 2024; the other two had died, and the hospital sent a notice to one estate trustee and placed a copy in the other patient's health record.","causal_attribution":"Hospital's report as recorded by the IPC; the deaths are not connected to the breach in any source."}],"effects":[{"label":"patients' health information was recorded by an unapproved AI transcription bot and emailed to a recipient list that included former staff","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.ipc.on.ca/en/media/5995/download","kind":"official_record","access":"read","language":"en","translation_note":"Letter of the Information and Privacy Commissioner of Ontario to the hospital, Reported Breach HR24-00691, dated 27 October 2025, released without the hospital's name; the ipc.on.ca download returned HTTP 403 to this fetcher and the full letter was read from an Internet Archive capture on 2026-10-21.","independence_group":"ipc-letter-hr24-00691"},{"id":"s2","url":"https://www.theglobeandmail.com/canada/article-ai-bot-doctors-meeting-patient-info-hospital-privacy-watchdog/","kind":"news","access":"read","language":"en","translation_note":"The Globe and Mail, 19 November 2025; read in full on 2026-10-21. Its account of the breach comes from the IPC letter, so it shares that letter's group.","independence_group":"ipc-letter-hr24-00691"},{"id":"s3","url":"https://www.hrreporter.com/focus-areas/automation-ai/ai-bot-sends-confidential-info-to-ontario-hospital-patients-after-recording-doctors-meeting-ipc/393766","kind":"news","access":"read","language":"en","translation_note":"Canadian HR Reporter, 21 November 2025; read in full on 2026-10-21. Its account comes from the IPC letter; its headline says information went to patients, which its own text and the letter do not support.","independence_group":"ipc-letter-hr24-00691"}],"version":1,"ai_roles":["others_use"],"contexts":["privacy","health","work"],"unknowns":["Whether Otter.ai deleted the recording and transcript; the hospital had no confirmation when the letter was written.","Whether the 12 departed recipients deleted the email.","Whether the former physician knew the tool had joined the meeting.","What the hospital reported to the IPC by the 27 January 2026 update deadline."],"geography":{"basis":"The letter is from Ontario's privacy commissioner to a hospital custodian under Ontario's health privacy law, and the patients had been admitted to that hospital; the Globe describes it as an Ontario hospital. No court is involved.","court_countries":[],"event_countries":["CA"],"affected_person_countries":["CA"]},"publication":{"basis":"Published under the 2026-10-06 privacy clarification: a regulator's letter records the hospital's report that an AI transcription tool joined a clinical meeting without notice, captured seven patients' health information and emailed it to a list including former staff. The relation is received_personal_information.","reviewed_on":"2026-10-21"},"ai_involvement":{"basis":"The hospital's report recorded in the regulator's letter says the Otter.ai tool itself joined the rounds meeting from a former physician's calendar, recorded it without notice, captured seven patients' health information in its transcript and automatically emailed a summary and transcript access to 65 recipients. That capture and distribution by the AI service is the privacy harm.","status":"supported"},"person_relations":["received_personal_information"]},"name":"Ontario hospital reports that an Otter.ai bot joined physicians' rounds through a former doctor's invite, recorded them and emailed patient information","summary":"An Ontario hospital reported to the provincial privacy commissioner that on 23 September 2024 the Otter.ai transcription tool, installed on a personal device by a physician who had left the hospital in June 2023 and was still on the meeting invite, joined a virtual hepatology rounds meeting, recorded it without notice and then emailed a summary and transcript access to the invite list. The personal health information of seven patients, including diagnoses and treatment, was captured; 12 of the 65 recipients appeared to have left the hospital. The commissioner's letter of 27 October 2025 recommended that the hospital itself ask Otter.ai to delete the retained patient data.","incidentDate":"2024-09-23","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"single_interaction","reportedDate":"2025-11-19","aiSystem":"Otter.ai, an AI transcription tool that a former hospital physician installed on a personal device and that joined meetings from his calendar (per the hospital's report to the IPC)","aiProduct":"Otter.ai (reported)","aiCompany":"Otter.ai","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["other_material_harm"],"harmOutcomeSummary":"Seven patients' health information was recorded by an unapproved AI transcription bot, which then emailed a summary and transcript access to 65 people, 12 of whom appeared to have left the hospital, according to the hospital's report to Ontario's privacy commissioner.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":7,"affectedCountStatus":"exact","affectedCountEvidence":"The IPC letter records that the personal health information of seven patients was discussed in the meeting and captured in the transcript. Meeting participants and email recipients are not counted as harmed.","victimAgeRange":"unknown","jurisdiction":"CA-ON","platformType":"assistant","outcomeType":"regulatory_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.ipc.on.ca/en/media/5995/download","primarySourceLabel":"Information and Privacy Commissioner of Ontario, letter on Reported Breach HR24-00691, 27 October 2025","firstPublishedAt":"2026-10-21T03:12:57.400852+00:00","updatedAt":"2026-10-21T03:12:57.400852+00:00","scopeVersion":"facts-v3","tags":["otter-ai","ai-notetaker","meeting-transcription","health-information","privacy-breach","regulator","ontario"]},{"id":"2025-central-poland-pupils-ai-nude-image-of-classmate-prosecutors-reopen-case","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"Był czerwiec. Grupka uczniów z tej podstawówki najpierw pobrała z sieci zdjęcie koleżanki, a potem, przez jedną z wielu aplikacji oferujących „rozebranie” osoby z wgranego zdjęcia, wygenerowała nagie zdjęcie kobiety z twarzą koleżanki. Uczniowie opublikowali je w internecie, na instagramowym profilu szkoły. I zachęcali innych do zamawiania „zdjęcia” dziewczyny.","relation":"supports","source_id":"s1"},{"locator":"Uczniowie podstawówki przy pomocy AI \"rozebrali\" swoją koleżankę i udostępnili wygenerowany wizerunek w mediach społecznościowych, zachęcając innych użytkowników do tworzenia własnych przeróbek.","relation":"supports","source_id":"s2"}],"assertion":"In June 2025 a group of pupils at a primary school in central Poland downloaded a classmate's photo from the internet, used one of the applications that offer to \"undress\" a person in an uploaded photo to generate a nude image bearing her face, posted it on the school's Instagram profile and encouraged others to order further \"photos\" of her.","causal_attribution":"OKO.press narrative and the data protection authority's account as reported by Prawo.pl; the application is not named."},{"id":"c2","status":"reported","evidence":[{"locator":"Prezes UODO podkreślił, że osoba, której wizerunek został zmodyfikowany przy użyciu aplikacji wykorzystującej sztuczną inteligencję, jest osobą małoletnią poniżej 15. roku życia i istnieje wysokie prawdopodobieństwo możliwości jej identyfikacji.","relation":"supports","source_id":"s2"},{"locator":"Prezes UODO sprawę zgłosił policji i prokuraturze, wskazując, że doszło do kradzieży tożsamości (art. 190 a § 2 kodeksu karnego), produkcji, możliwości utrwalania i rozpowszechniania treści pornograficznych z udziałem osoby małoletniej (art. 202 § 3 k.k.) oraz nielegalnego przetworzenia danych osobowych (107 ust. 1 ustawy o ochronie danych osobowych).","relation":"supports","source_id":"s1"}],"assertion":"The president of the Personal Data Protection Office (UODO) notified the police, stating that the girl whose image was modified with an AI-based application was under 15 and could very probably be identified.","causal_attribution":"The data protection authority's statement as reported by Prawo.pl, and its notification as summarised by OKO.press (one origin: the authority)."},{"id":"c6","status":"reported","evidence":[{"locator":"„Dużo o tym w szkole rozmawialiśmy. Dzieci miały warsztaty z psychologiem, pedagogiem, policją. Działania profilaktyczne trwały cały miesiąc” ... „To była patowa sytuacja. Cała historia wydarzyła się poza szkołą, na urządzeniach, które dzieciom kupili rodzice.","relation":"supports","source_id":"s1"}],"assertion":"The head teacher told OKO.press that the events took place outside school on devices the children's parents had bought them, and that the school ran a month of preventive workshops with a psychologist, a pedagogue and the police.","causal_attribution":"Head teacher interviewed by OKO.press."},{"id":"c3","status":"reported","evidence":[{"locator":"Policja jednak odmówiła wszczęcia śledztwa. Prokuratura jeszcze tego samego miesiąca, w czerwcu, decyzję policji zatwierdziła. Powód? Organy zgodnie uznały, że „czyn nastolatków nie zawiera znamion czynu zabronionego”.","relation":"supports","source_id":"s1"},{"locator":"Policja i prokuratura uznały, że AI-wygenerowany materiał nie stanowi treści pornograficznej, a przerobienie dostępnego publicznie zdjęcia nie jest „przetwarzaniem danych osobowych”. Ich zdaniem uczennica nie poniosła szkody","relation":"supports","source_id":"s3"}],"assertion":"The police refused to open proceedings and the prosecutor's office upheld that decision, finding that the pupils' act had no features of a prohibited act; according to Gazeta Prawna they considered that the AI-generated material was not pornographic content and that the pupil suffered no harm.","causal_attribution":"OKO.press and the authority's account relayed by Gazeta Prawna; the police did not answer OKO.press."},{"id":"c4","status":"reported","evidence":[{"locator":"Prezes Urzędu Ochrony Danych Osobowych interweniuje u Prokuratora Generalnego po tym, jak policja odmówiła wszczęcia postępowania w sprawie wygenerowania przez uczniów nagiego zdjęcia ich koleżanki za pomocą aplikacji opartej na sztucznej inteligencji. ... UODO domaga się wznowienia postępowania, wskazując na konieczność ochrony małoletnich przed rosnącym zjawiskiem deepfake’ów.","relation":"supports","source_id":"s3"},{"locator":"Prezes UODO skierował wówczas apel do ministra sprawiedliwości i Prokuratora Generalnego Waldemara Żurka o podjęcie działań w sprawie.","relation":"supports","source_id":"s4"}],"assertion":"The UODO president then asked the Minister of Justice and Prosecutor General, Waldemar Żurek, to have the case taken up again.","causal_attribution":"The authority's own intervention, relayed by two outlets (one origin)."},{"id":"c5","status":"reported","evidence":[{"locator":"Jak wynika z czwartkowego komunikatu Urzędu, prokuratura poinformowała prezesa Wróblewskiego o podjęciu sprawy uczennicy na nowo.","relation":"supports","source_id":"s4"}],"assertion":"In January 2026 the UODO announced that the prosecutor's office had informed its president that it was taking up the pupil's case again.","causal_attribution":"The authority's communique as relayed by CyberDefence24; the prosecutors' own decision was not read."},{"id":"c7","status":"reported","evidence":[{"locator":"Podobnie było w sprawie wygenerowanego rozbieranego zdjęcia uczennicy podstawówki (przez jej szkolnych kolegów), w której Prezes UODO po raz kolejny wnioskował niedawno o wznowienie śledztwa.","relation":"supports","source_id":"s5"}],"assertion":"In a statement of 24 June 2026 on a separate case, the UODO said that in this primary-school case its president had recently asked once again for the investigation to be resumed.","causal_attribution":"The authority's own statement; it does not say whether the proceedings reopened in January 2026 had been closed again."}],"effects":[{"label":"AI-generated nude image of a girl under 15 posted online by classmates","claim_id":"c1","direction":"negative"},{"label":"police and prosecutors initially declined to open proceedings","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://oko.press/fejkowe-nagie-zdjecia-uczennicy-policja-to-ai-sprawy-nie-ma","kind":"news_report","access":"read","language":"pl","translation_note":"Read in Polish on 2026-10-19 (HTTP 200); quoted passages are kept in Polish and the English sense was rendered by the research agent (an AI), not a human translator. OKO.press report of 10 December 2025, with an interview of the school head teacher; the outlet withholds the town and the head teacher's name.","independence_group":"oko-press-reporting-10-dec-2025"},{"id":"s2","url":"https://www.prawo.pl/oswiata/kara-za-deepfake-zdjecia-dziecka,533313.html","kind":"news_report","access":"read","language":"pl","translation_note":"Read in Polish on 2026-10-19 (HTTP 200); quoted passages are kept in Polish and the English sense was rendered by the research agent (an AI), not a human translator. Prawo.pl report of 11 June 2025 on the data protection authority's notification to the police.","independence_group":"uodo-statements-on-the-case"},{"id":"s3","url":"https://www.gazetaprawna.pl/nowe-technologie/artykuly/10954096,ai-wygenerowala-nagie-zdjecie-uczennicy-organy-scigania-odmowily-sled.html","kind":"news_report","access":"read","language":"pl","translation_note":"Read in Polish on 2026-10-19 (HTTP 200); quoted passages are kept in Polish and the English sense was rendered by the research agent (an AI), not a human translator. Gazeta Prawna report of 7 December 2025 on the authority's intervention with the Prosecutor General.","independence_group":"uodo-statements-on-the-case"},{"id":"s4","url":"https://cyberdefence24.pl/cyberbezpieczenstwo/zwrot-w-sprawie-deepnude-z-uczennica-jest-decyzja-prokuratury","kind":"news_report","access":"read","language":"pl","translation_note":"Read in Polish on 2026-10-19 (HTTP 200); quoted passages are kept in Polish and the English sense was rendered by the research agent (an AI), not a human translator. CyberDefence24 report of 15 January 2026 relaying the authority's communique on the prosecutors' decision.","independence_group":"uodo-statements-on-the-case"},{"id":"s5","url":"https://uodo.gov.pl/pl/138/4445","kind":"official_statement","access":"read","language":"pl","translation_note":"Read in Polish on 2026-10-19 (HTTP 200); quoted passages are kept in Polish and the English sense was rendered by the research agent (an AI), not a human translator. UODO news item of 24 June 2026 on a separate Krakow case, which refers back to this case.","independence_group":"uodo-statements-on-the-case"}],"version":1,"ai_roles":["others_use"],"contexts":["education","privacy","justice"],"unknowns":["Which application was used and how the AI generation was established.","Exactly when the police refusal was issued: OKO.press says the prosecutor upheld it in June 2025, while CyberDefence24 says the services refused in the autumn.","Whether the proceedings reopened in January 2026 were closed again before June 2026, when the UODO said its president had again asked for the investigation to be resumed.","What the reopened proceedings have found and whether any measures were imposed on the pupils.","How long the image stayed online and how many people saw it."],"geography":{"basis":"OKO.press places the primary school in central Poland (\"To centrum Polski\") and the Polish police and prosecutors handled the case. No court proceeding is reported, so court_countries is empty.","court_countries":[],"event_countries":["PL"],"affected_person_countries":["PL"]},"publication":{"basis":"Published as a core case (depicted_or_impersonated): OKO.press and the Polish data protection authority both describe classmates using an AI \"undressing\" application to generate and post a nude image of a girl under 15, and the authority's complaint led prosecutors to reopen the case after police declined to act; in June 2026 the authority said it had again asked for the investigation to be resumed. The girl, the school and the town are not named.","reviewed_on":"2026-10-19"},"ai_involvement":{"basis":"OKO.press reports that the pupils used one of the applications that offer to \"undress\" a person in an uploaded photo to generate a nude image with their classmate's face, and the Personal Data Protection Office (as reported by Prawo.pl and Gazeta Prawna) describes the girl's image as modified with an application using artificial intelligence. Gazeta Prawna reports that the police and prosecutors themselves treated the material as AI-generated when they declined to act. The generated image depicts the girl (depicted_or_impersonated) and its publication is the reported harm. The application is not named and no source describes how the AI generation was established.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"Central Poland: pupils reportedly used an AI app to make a nude image of a classmate under 15; prosecutors reopened the case after the data regulator intervened","summary":"In June 2025, according to OKO.press, a group of pupils at a primary school in central Poland took a classmate's photo from the internet, used an application that offers to \"undress\" people in uploaded photos to generate a nude image bearing her face, posted it on the school's Instagram profile and urged others to order more such images. Poland's Personal Data Protection Office (UODO) says the girl was under 15 and notified the police, but the police declined to open proceedings and the prosecutor's office upheld that decision, finding no prohibited act; Gazeta Prawna reports that they considered the AI-generated material not pornographic and the pupil unharmed. The UODO president appealed to the Prosecutor General, in January 2026 the authority announced that prosecutors had informed it they were taking up the case again, and in June 2026 it said its president had recently asked once more for the investigation to be resumed. The application is not named.","incidentDate":"2025-06-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"unknown","reportedDate":"2025-06-11","aiSystem":"An application offering to \"undress\" a person in an uploaded photo, described by the data protection authority as using artificial intelligence (not named)","aiProduct":"Unidentified image tool","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse"],"harmOutcomeSummary":"According to OKO.press and the Polish data protection authority, classmates generated a nude image of a girl under 15 with an AI \"undressing\" app and posted it online; police and prosecutors initially declined to act.","frameworkFacets":[],"pathwayDirection":"outward","causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One girl, the classmate whose photo was turned into the nude image (OKO.press; UODO via Prawo.pl). The audience of the Instagram post is not counted.","victimAgeRange":"minor","jurisdiction":"PL","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"unknown","primarySourceUrl":"https://oko.press/fejkowe-nagie-zdjecia-uczennicy-policja-to-ai-sprawy-nie-ma","primarySourceLabel":"OKO.press, 10 December 2025: Jej fejkowe „nagie” zdjęcia mógł obejrzeć każdy w klasie. Policja: To AI, sprawy nie ma","firstPublishedAt":"2026-10-19T03:13:13.685997+00:00","updatedAt":"2026-10-19T03:23:25.300558+00:00","scopeVersion":"facts-v3","tags":["ai-nude-image","sexual-images-of-minors","school","poland","data-protection-authority","case-reopened","depicted-or-impersonated"]},{"id":"2024-italy-tv-satire-show-ai-deepfakes-of-journalist-mentana-privacy-regulator-warns-broadcaster","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"'per alcuni servizi di Striscia la Notizia, nei quali l’immagine e la voce di Enrico Mentana erano state manipolate mediante l’impiego di sistemi di intelligenza artificiale.'; 'Nei filmati venivano attribuite al noto giornalista dichiarazioni mai pronunciate, mentre la sua immagine era collocata virtualmente nello studio televisivo dell’emittente per la quale lavora.'","relation":"supports","source_id":"s1"},{"locator":"'servizi costruiti prendendo come spunto fatti che hanno coinvolto diversi personaggi pubblici e accompagnandoli con commenti di vario genere pronunciati dal deepfake del reclamante doppiato con sistemi di intelligenza artificiale'; 'è stata utilizzata l’immagine reale del reclamante, ripresa peraltro all’interno dello studio televisivo da cui il medesimo dirige un telegiornale di fascia serale, alterandone la genuinità attraverso un doppiaggio effettuato con strumenti tali da non rendere chiaramente percepibile l’esistenza della predetta alterazione'","relation":"supports","source_id":"s2"}],"assertion":"Striscia la Notizia aired segments in which the image and voice of journalist Enrico Mentana were manipulated with AI systems, attributing to him statements he never made while placing his image in the studio of the channel he works for.","causal_attribution":"The regulator's findings in its decision and press release; R.T.I. itself describes computer-generated dubbing."},{"id":"c2","status":"reported","evidence":[{"locator":"'nella puntata di venerdì 8 novembre manderà in onda un servizio che vedrà protagonista Enrico Mentana, ma in versione deepfake, ovvero con voce e immagini generati dall’intelligenza artificiale.'","relation":"supports","source_id":"s3"}],"assertion":"A preview published on 8 November 2024 describes a Striscia la Notizia segment airing that evening in which a deepfake Mentana, with voice and images generated by AI, commented on a game show.","causal_attribution":"A press preview of the programme; it establishes that such segments aired from at least November 2024, not which segments the complaint listed (the decision redacts their dates)."},{"id":"c3","status":"reported","evidence":[{"locator":"'moltissime persone hanno creduto che i video, prodotti da Striscia la Notizia e divulgati sul mezzo televisivo e sui social, fossero reali'; 'rivelano come molte persone siano convinte che le dichiarazioni siano autentiche, determinando con ciò una gravissima lesione dell’onore, della reputazione e della propria professionalità'","relation":"supports","source_id":"s2"}],"assertion":"Mentana complained to the Garante that many people believed the videos were real and that users' insulting comments showed serious harm to his honour, reputation and professionalism.","causal_attribution":"The complainant's submissions as recorded in the decision."},{"id":"c4","status":"documented","evidence":[{"locator":"'il realismo delle immagini, la scarsa percepibilità dell’alterazione e la plausibilità delle dichiarazioni avrebbero potuto indurre il pubblico a ritenere autentici i contenuti. Anche le avvertenze sulla natura artificiale dei video non sono state ritenute sufficientemente chiare'","relation":"supports","source_id":"s1"},{"locator":"'amplificando altresì il rischio di farne veicolo di disinformazione per il pubblico, come confermato dai numerosi messaggi di scherno e/o di offesa ricevuti via social dal reclamante'","relation":"supports","source_id":"s2"}],"assertion":"The Garante found that the content could lead the public to consider it authentic, that the warnings were not sufficiently clear, and that the real studio setting amplified the risk of disinformation, as confirmed by the numerous mocking or offensive messages Mentana received on social media.","causal_attribution":"The regulator's findings; the regulator's reference to the messages rests on material in the complaint."},{"id":"c5","status":"documented","evidence":[{"locator":"'Il Garante ha quindi accertato la violazione dell’articolo 5 del GDPR'; 'ha adottato nei confronti di R.T.I. Spa un provvedimento di ammonimento e ha vietato l’ulteriore utilizzo dei dati di Enrico Mentana con le modalità contestate'","relation":"supports","source_id":"s1"},{"locator":"'dispone il divieto di ulteriore trattamento dei dati del reclamante con le modalità sopra descritte, eccettuata la mera conservazione degli stessi ai fini di un loro eventuale utilizzo in sede giudiziaria'","relation":"supports","source_id":"s2"}],"assertion":"The Garante found breaches of GDPR Articles 5 and 25, warned R.T.I. and prohibited further processing of Mentana's data in the contested way, except retention for judicial use.","causal_attribution":"The dispositive part of the decision."},{"id":"c6","status":"reported","evidence":[{"locator":"'l’unica attività realizzata da R.T.I. è stata quella di disporre, con riguardo ai predetti filmati, il doppiaggio del dott. Mentana, con voce diversa dalla sua, attraverso appositi sistemi informativi'; 'la finalità dei servizi oggetto di reclamo è quella di esercitare il diritto di satira ricorrendo all’imitazione del reclamante'","relation":"supports","source_id":"s2"}],"assertion":"R.T.I. argued that its only intervention was dubbing licensed footage with a different, computer-generated voice, that the segments were satire, and that disclaimers made clear it was not the real Mentana speaking.","causal_attribution":"The broadcaster's submissions as recorded in the decision; the Garante did not accept them."}],"effects":[{"label":"AI deepfake segments attributing invented statements to a journalist","claim_id":"c1","direction":"negative"},{"label":"mocking or offensive messages and risk to reputation found by the regulator","claim_id":"c4","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/10281135","kind":"press_release","access":"read","language":"it","translation_note":"Read in Italian by the research agent (an AI) on 2026-10-17 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. Garante press release of 7 August 2026; HTTP 200.","independence_group":"garante-privacy"},{"id":"s2","url":"https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/10281021","kind":"official_record","access":"read","language":"it","translation_note":"Read in Italian by the research agent (an AI) on 2026-10-17 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. Garante decision of 23 July 2026 (doc. web 10281021), read in full; dates and names of counsel are redacted as XX; HTTP 200.","independence_group":"garante-privacy"},{"id":"s3","url":"https://dilei.it/spettacolo/striscia-la-notizia-enrico-mentana-svela-il-vero-volto-stefano-de-martino/1587080/","kind":"news_report","access":"read","language":"it","translation_note":"Read in Italian by the research agent (an AI) on 2026-10-17 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. DiLei entertainment preview, 8 November 2024; HTTP 200.","independence_group":"dilei-8-nov-2024"}],"version":1,"ai_roles":["institutional_use"],"contexts":["work","privacy","justice"],"unknowns":["Which segments the complaint covered and when they aired; the decision redacts the dates.","Which AI tools were used.","Whether R.T.I. challenged the decision in court and what measures it reported to the Garante."],"geography":{"basis":"The segments were aired by R.T.I. (Reti Televisive Italiane) on Striscia la Notizia and investigated by Italy's data protection authority; the depicted person is the director of La7's news bulletin. His country of residence is not stated. No court proceeding is reported.","court_countries":[],"event_countries":["IT"],"affected_person_countries":[]},"publication":{"basis":"Published as a core case (depicted_or_impersonated): Italy's data protection authority found that a broadcaster's AI deepfakes of a journalist could be taken as authentic, noted the offensive messages he received, warned the broadcaster and barred further use. The journalist is a public figure who brought the complaint and is named.","reviewed_on":"2026-10-17"},"ai_involvement":{"basis":"Italy's data protection authority, after an investigation of the complaint, states that the journalist's image and voice were manipulated with AI systems in the segments and that statements he never made were attributed to him; the broadcaster told the authority it dubbed the footage with a computer-generated voice. The authority found the content could be taken as authentic and cited the mocking or offensive messages he received, which is the reported harm.","status":"supported"},"person_relations":["depicted_or_impersonated"]},"name":"Italy's privacy regulator warns broadcaster R.T.I. and bars further use of AI deepfakes of journalist Enrico Mentana in Striscia la Notizia segments","summary":"The satirical television programme Striscia la Notizia, published by R.T.I., aired segments in which the image and voice of the journalist Enrico Mentana, director of La7's news bulletin, were, according to the Garante, manipulated with AI systems so that he appeared in his own studio making statements he never made (its decision describes real footage from his studio altered by AI dubbing); a November 2024 preview describes one such segment. After Mentana complained, Italy's data protection authority (Garante) found on 23 July 2026 that the realism of the images, the low perceptibility of the alteration and the plausibility of the statements could lead the public to think the content authentic, and that the disclaimers were not clear enough. It found breaches of GDPR Articles 5 and 25, issued a warning to R.T.I. and prohibited further processing of his data in that way. The Garante noted the numerous mocking or offensive messages he received on social media. R.T.I. argued that the segments were satire, that it only dubbed licensed footage with a computer-generated voice, and that its disclaimers made the deepfake evident. No fine was imposed.","incidentDate":"2024-11-08","incidentKind":"bounded_series","incidentDatePrecision":"day","exposurePattern":"repeated_interactions","reportedDate":"2026-08-07","aiSystem":"AI systems used by the programme to manipulate the journalist's image and voice (the Garante); R.T.I. describes computer-generated dubbing of licensed footage. No product is named.","aiProduct":"Unidentified video tool","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["reputational_harm"],"harmOutcomeSummary":"Italy's data protection authority found that AI deepfakes of a journalist on a satirical TV programme could be taken as authentic and noted the numerous mocking or offensive messages he received; it warned the broadcaster and barred further use.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person: the journalist depicted in the deepfakes, whose complaint the Garante upheld (decision 10281021). Viewers are an audience and are not counted.","victimAgeRange":"adult","jurisdiction":"IT","platformType":"other","outcomeType":"regulatory_action","outcomeStatus":"unknown","primarySourceUrl":"https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/10281135","primarySourceLabel":"Garante per la protezione dei dati personali, press release, 7 August 2026: stop to satirical deepfakes of Enrico Mentana","firstPublishedAt":"2026-10-17T03:08:22.075012+00:00","updatedAt":"2026-10-17T03:08:22.075012+00:00","scopeVersion":"facts-v3","tags":["deepfake","voice_synthesis","television","satire","data_protection_authority","gdpr"]},{"id":"2025-johannesburg-high-court-refers-applicant-lawyers-to-legal-practice-council-over-ai-tool-fictitious-citations","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'two cases cited in Northbound Processing'; 'were fictitious'; 'the revised version contained two additional incorrect citations'","relation":"supports","source_id":"s1"},{"locator":"'heads of argument contained fictitious case citations that appeared to have been generated by artificial intelligence'; 'contained two additional incorrect citations'","relation":"supports","source_id":"s2"}],"assertion":"While preparing judgment in Northbound Processing's urgent application against the South African Diamond and Precious Metals Regulator, the acting judge found that two cases cited in the applicant's heads of argument did not exist, and a corrected version supplied by junior counsel contained two further incorrect citations.","causal_attribution":"The judgment as described by ITWeb and by a law-firm alert; both rest on the same judgment, which was not read."},{"id":"c2","status":"reported","evidence":[{"locator":"'acknowledged that the non-existent citations likely originated from an AI tool'; 'he had used a tool called'; 'which claimed to be trained solely on South African legal sources'","relation":"supports","source_id":"s1"},{"locator":"'counsel acknowledged the use of AI, accepted full responsibility'","relation":"supports","source_id":"s2"}],"assertion":"On the court's direct inquiry, junior counsel acknowledged that the non-existent citations likely originated from an AI tool and said a tool called Legal Genius had been used under deadline pressure.","causal_attribution":"Counsel's statement to the court as relayed by ITWeb; the law-firm alert relays the acknowledgment without naming the tool."},{"id":"c3","status":"reported","evidence":[{"locator":"'found no intent to deceive the court'; 'be referred to the Legal Practice Council for investigation'","relation":"supports","source_id":"s1"},{"locator":"'a referral to the Legal Practice Council for investigation'","relation":"supports","source_id":"s2"}],"assertion":"The judge accepted the legal team's apologies and found no intent to deceive the court, but ordered that the conduct of Northbound's legal practitioners be referred to the Legal Practice Council for investigation.","causal_attribution":"The court's order as described by both accounts of the judgment."},{"id":"c4","status":"reported","evidence":[{"locator":"'While Northbound ultimately succeeded in obtaining the relief sought'","relation":"supports","source_id":"s2"}],"assertion":"Northbound nevertheless obtained the relief it sought in the application.","causal_attribution":"The law-firm alert's account of the judgment."}],"effects":[{"label":"the applicant's legal practitioners were referred to the Legal Practice Council for investigation over fictitious citations","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.itweb.co.za/article/lawyers-face-probe-for-using-hallucinating-genai-in-court/Pero3MZ3221qQb6m","kind":"news_report","access":"read","language":"en","translation_note":"Read in full in English by the research agent (an AI) on 2026-10-14 (HTTP 200). ITWeb reports from court documents it saw; the judgment itself was not available to the agent.","independence_group":"northbound-processing-judgment-zagpjhc"},{"id":"s2","url":"https://www.cliffedekkerhofmeyr.com/en/news/publications/2025/Practice/Employment-Law/combined-employment-and-knowledge-management-alert-4-july-Another-episode-of-fabricated-citations-real-repercussions-South-African-courts-show-no-tolerance-for-AI-hallucinated-cases","kind":"other","access":"read","language":"en","translation_note":"Read in full in English by the research agent (an AI) on 2026-10-14 from a 2025 Internet Archive capture (the live page returned HTTP 403). A law-firm client alert analysing the same judgment; same origin as ITWeb.","independence_group":"northbound-processing-judgment-zagpjhc"}],"version":1,"ai_roles":["own_use"],"contexts":["justice","work"],"unknowns":["The exact date of the judgment and of the referral order.","How many practitioners were referred and the outcome of any Legal Practice Council investigation.","Which citations Legal Genius produced and whether the tool provider responded."],"geography":{"basis":"The heads were filed in, and the referral ordered by, the Gauteng Division of the High Court, Johannesburg (ITWeb, Cliffe Dekker Hofmeyr). Where counsel prepared the heads is not stated, so no event or affected-person country is recorded from the court seat.","court_countries":["ZA"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published because two accounts of the judgment report that the court referred the applicant's lawyers to the Legal Practice Council after heads of argument cited non-existent cases, and that junior counsel told the court the citations likely came from the AI tool Legal Genius.","reviewed_on":"2026-10-14"},"ai_involvement":{"basis":"ITWeb, which saw the court documents, reports that on the court's direct inquiry junior counsel acknowledged that the non-existent citations in the heads of argument likely originated from an AI tool and said a tool called Legal Genius had been used under deadline pressure; Cliffe Dekker Hofmeyr's analysis of the judgment says counsel acknowledged the use of AI. The tool's output (citations of cases that do not exist) was filed in the heads, and the court referred the practitioners to the Legal Practice Council because fictitious authorities were placed before it. The attribution rests on counsel's acknowledgment as relayed by these two accounts of the judgment; the judgment itself was not read.","status":"reported"},"person_relations":["communicated_with"]},"name":"Johannesburg High Court refers a company's lawyers to the Legal Practice Council over fictitious citations that junior counsel said likely came from an AI tool","summary":"In an urgent application by Northbound Processing against the South African Diamond and Precious Metals Regulator, Acting Judge DJ Smit of the Gauteng High Court, Johannesburg, found while preparing judgment that two cases cited in the applicant's heads of argument did not exist. According to ITWeb, which saw the court documents, junior counsel first said a wrong version had been filed, a corrected version was found to contain two further incorrect citations, and on the court's direct inquiry junior counsel acknowledged that the citations likely originated from an AI tool called Legal Genius, used under deadline pressure. The judge accepted the legal team's apologies and found no intent to deceive, but referred the conduct of the applicant's legal practitioners to the Legal Practice Council for investigation (June 2025). The applicant obtained the relief it sought.","incidentDate":"2025-06-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"unknown","reportedDate":"2025-07-02","aiSystem":"Legal Genius, an AI legal research tool that junior counsel told the court had been used and which, junior counsel said, claimed to be trained solely on South African legal sources","aiProduct":"Legal Genius (reported)","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["professional_harm"],"harmOutcomeSummary":"According to ITWeb and a law-firm alert on the judgment, the court referred the applicant's legal practitioners to the Legal Practice Council for investigation after heads of argument cited non-existent cases that junior counsel said likely came from the AI tool Legal Genius.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"partial","affectedCountEvidence":"One person counted: the junior counsel who told the court the tool had been used, among the legal practitioners whose conduct was referred. The order refers the practitioners as a group and the sources read do not state how many were referred, so others are unquantified. The applicant company is not counted.","victimAgeRange":"adult","jurisdiction":"ZA","platformType":"assistant","outcomeType":"regulatory_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.itweb.co.za/article/lawyers-face-probe-for-using-hallucinating-genai-in-court/Pero3MZ3221qQb6m","primarySourceLabel":"ITWeb, 2 July 2025: Lawyers face probe for using hallucinating GenAI in court","firstPublishedAt":"2026-10-14T03:03:33.803607+00:00","updatedAt":"2026-10-14T03:03:33.803607+00:00","scopeVersion":"facts-v3","tags":["south-africa","johannesburg","high-court","fictitious-citations","legal-practice-council","legal-research-tool"]},{"id":"2026-kedah-school-ai-generated-sexual-images-and-videos-alleged-to-involve-teachers-and-pupils-mcmc-complaint","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"Suruhanjaya Komunikasi dan Multimedia Malaysia (MCMC) menerima aduan berhubung penyalahgunaan teknologi kecerdasan buatan (AI) di media sosial bagi menghasilkan dan menyebarkan gambar serta video berunsur seksual yang didakwa melibatkan guru dan pelajar sebuah sekolah di Kedah","relation":"supports","source_id":"s1"},{"locator":"menerima aduan berhubung penyalahgunaan teknologi kecerdasan buatan (AI) bagi menghasilkan dan menyebarkan gambar serta video berunsur seksual yang didakwa membabitkan pelajar dan guru sebuah sekolah di Kedah","relation":"supports","source_id":"s2"},{"locator":"confirms it has received a complaint over the misuse of artificial intelligence (AI) to create and distribute sexual images and videos, allegedly of students and teachers at a school in Kedah","relation":"supports","source_id":"s3"}],"assertion":"MCMC says it received a complaint about the misuse of AI technology on social media to produce and spread sexual images and videos alleged to involve teachers and pupils of a school in Kedah.","causal_attribution":"The complaint alleges AI production; MCMC relays the allegation and neither outlet examined the material."},{"id":"c2","status":"reported","evidence":[{"locator":"MCMC berkata, isu berkenaan turut membabitkan pelbagai agensi termasuk Kementerian Komunikasi, Kementerian Dalam Negeri (KDN), Kementerian Pendidikan (KPM) dan Polis Diraja Malaysia (PDRM), mengikut bidang kuasa masing-masing","relation":"supports","source_id":"s1"},{"locator":"boleh dikenakan tindakan di bawah Seksyen 233 Akta Komunikasi dan Multimedia 1998 (Akta 588)","relation":"supports","source_id":"s1"},{"locator":"pihaknya akan bekerjasama dengan agensi berkaitan termasuk Kementerian Komunikasi, Kementerian Dalam Negeri (KDN), Kementerian Pendidikan (KPM) dan Polis Diraja Malaysia (PDRM) bagi menjalankan siasatan","relation":"supports","source_id":"s2"},{"locator":"In a statement on Thursday (Oct 8), MCMC said misusing AI to create or distribute sexual content that could affect the safety, dignity and well-being of victims, particularly children, is subject to action under Section 233 of the Communications and Multimedia Act 1998","relation":"supports","source_id":"s3"}],"assertion":"MCMC says it will cooperate with the Ministry of Communications, the Home Ministry, the Ministry of Education and the Royal Malaysia Police in the investigation, and cites Section 233 of the Communications and Multimedia Act 1998 and Section 18 of the Online Safety Act 2025 as the applicable provisions.","causal_attribution":"Regulatory response; no causal attribution."},{"id":"c3","status":"reported","evidence":[{"locator":"MCMC turut mengingatkan orang ramai supaya tidak menghasilkan, memuat naik atau menyebarkan semula kandungan seksual yang melibatkan atau didakwa melibatkan kanak-kanak","relation":"supports","source_id":"s1"},{"locator":"perbuatan itu bukan sahaja boleh memudaratkan mangsa, malah berpotensi menjejaskan proses siasatan pihak berkuasa","relation":"supports","source_id":"s2"}],"assertion":"MCMC asked the public not to produce, upload or reshare sexual content involving or alleged to involve children, saying this could harm the victims and hinder the investigation.","causal_attribution":"MCMC’s public advisory; the reference to children is general and does not state the ages of the pupils in this complaint."}],"effects":[{"label":"AI-made sexual images and videos alleged to involve teachers and pupils of a Kedah school, spread on social media, per a complaint reported by MCMC","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://malaysiatribune.news/mcmc-siasat-dakwaan-salah-guna-ai-hasilkan-kandungan-seksual-libatkan-guru-pelajar/","kind":"news_report","access":"read","language":"ms","translation_note":"Malay body read and translated by the research agent (an AI) on 2026-10-09 (HTTP 200); no human reviewer read or translated the article. Malaysia Tribune report (Cyberjaya dateline) of the MCMC statement.","independence_group":"mcmc-statement-8oct"},{"id":"s2","url":"https://themalaysiapress.com/2026/10/08/mcmc-terima-aduan-kandungan-seksual-ai-babit-pelajar-guru/","kind":"news_report","access":"read","language":"ms","translation_note":"Malay body read and translated by the research agent (an AI) on 2026-10-09 (HTTP 200); no human reviewer read or translated the article. The Malaysia Press report (Putrajaya dateline) of the same MCMC statement; same origin as s1.","independence_group":"mcmc-statement-8oct"},{"id":"s3","url":"https://www.thestar.com.my/news/nation/2026/10/08/mcmc-receives-complaint-over-ai-generated-porn-depicting-students-teachers","kind":"news_report","access":"read","language":"en","translation_note":"English body fetched and read by verifier vls on 2026-10-09 (HTTP 200), saved as bodies/verify-thestar-mcmc-kedah.txt; Bernama copy of the same MCMC statement of Thursday 8 October 2026; same origin as s1 and s2.","independence_group":"mcmc-statement-8oct"}],"version":1,"ai_roles":["others_use"],"contexts":["education","privacy"],"unknowns":["Who is depicted, how many people, and their ages; MCMC refers to teachers and pupils of one school and, generally, to children.","Which AI tool was used, what the images and videos show, who produced and spread them, and on which platform.","When the material was made and shared; the only date is the 8 October 2026 statement.","Whether the complaint has been verified, any arrest or charge, and any account from the school, the teacher or the families.","Whether the teachers and pupils are depicted in the material or otherwise involved: the Malay reports say the material is alleged to involve (“didakwa melibatkan”) them, and The Star’s English report renders this as “allegedly of” them."],"geography":{"basis":"The school is in Kedah, Malaysia, according to both outlets, and MCMC, a Malaysian regulator, received the complaint; the teachers and pupils the complaint refers to attend or work at that school. No court proceeding is reported.","court_countries":[],"event_countries":["MY"],"affected_person_countries":["MY"]},"publication":{"basis":"Published as a core case (depicted_or_impersonated) on two Malay-language reports and one English (Bernama) report of a regulator’s statement that it received a complaint of AI being used to produce and spread sexual images and videos alleged to involve teachers and pupils of a Kedah school. Every claim is attributed to MCMC’s statement; the three outlets relay one statement and are recorded as one independence group, so nothing is corroborated. No person or school is named by any source. Severity is low because the complaint is unverified and no individual consequence beyond the alleged depiction is reported.","reviewed_on":"2026-10-09"},"ai_involvement":{"basis":"MCMC’s statement, reported in Malay by Malaysia Tribune and The Malaysia Press and in English (Bernama) by The Star, says the complaint concerns the misuse of artificial intelligence technology to produce and spread sexual images and videos alleged to involve teachers and pupils of a school in Kedah. MCMC refers to the people affected as victims, particularly children, and warns against resharing sexual content involving or alleged to involve children; The Star renders the allegation as images and videos “allegedly of students and teachers”. On that description the AI-produced material depicts those people (depicted_or_impersonated) and is itself the reported harm, a non-consensual sexual depiction circulated on social media; whether every teacher and pupil the complaint refers to is depicted is not stated. The identification of AI comes from the complaint as relayed by the regulator; no outlet examined the material or identified the tool, so the status is reported.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"Kedah, Malaysia: regulator says a complaint alleges AI was used to make and spread sexual images and videos involving teachers and pupils of a school","summary":"On 8 October 2026 the Malaysian Communications and Multimedia Commission (MCMC) said in a statement, reported by Malaysia Tribune, The Malaysia Press and The Star, that it had received a complaint about the misuse of artificial intelligence on social media to produce and spread sexual images and videos alleged to involve teachers and pupils of a school in Kedah. MCMC said it would investigate with the Ministry of Communications, the Home Ministry, the Ministry of Education and the Royal Malaysia Police, cited the offences and penalties that could apply, and asked the public not to produce, upload or reshare sexual content involving or alleged to involve children. The complaint is unverified: the people depicted, their number and ages, the tool and the person responsible are not described.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"unknown","reportedDate":"2026-10-08","aiSystem":"Artificial intelligence technology, not identified, which according to the complaint reported by MCMC was misused on social media to produce and spread sexual images and videos alleged to involve teachers and pupils of a school in Kedah","aiProduct":"Unidentified image and video tool","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse"],"harmOutcomeSummary":"According to a complaint reported by MCMC, AI-made sexual images and videos alleged to involve teachers and pupils of a Kedah school were produced and spread on social media; MCMC says such content can affect the safety, dignity and well-being of victims, especially children. No individual consequence is reported and the complaint has not been verified.","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":0,"affectedCountStatus":"unquantified","affectedCountEvidence":"No reliable count: the statement says the material is alleged to involve “guru dan pelajar” (teachers and pupils) of one school without giving a number; Malay does not mark number and the Bernama English reports say “students and teachers”, so no numeric minimum is recorded. Zero placeholders are used; the people depicted are not AI users.","victimAgeRange":"unknown","jurisdiction":"MY","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"ongoing","primarySourceUrl":"https://malaysiatribune.news/mcmc-siasat-dakwaan-salah-guna-ai-hasilkan-kandungan-seksual-libatkan-guru-pelajar/","primarySourceLabel":"Malaysia Tribune, 8 October 2026: MCMC siasat dakwaan salah guna AI hasilkan kandungan seksual libatkan guru, pelajar","firstPublishedAt":"2026-10-09T03:40:02.257247+00:00","updatedAt":"2026-10-09T03:40:02.257247+00:00","scopeVersion":"facts-v3","tags":["deepfake","non_consensual_intimate_imagery","education","regulatory_investigation","malaysia"]},{"id":"2026-chile-puente-alto-school-ai-fake-nude-images-classmates-superintendencia","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'Luego, las imágenes eran intervenidas mediante herramientas de inteligencia artificial, con las que se modificaban para generar las representaciones falsas.'; 'Las imágenes comenzaron a compartirse mediante plataformas digitales y terminaron llegando a otros estudiantes del establecimiento.'; 'La situación se conoció el 10 de julio, cuando un grupo de estudiantes encontró el material en la galería del celular de uno de los involucrados.'","relation":"supports","source_id":"s1"},{"locator":"'encontraron en el celular de uno de sus compañeros imágenes sexuales falsas de ellas mismas y otras estudiantes del establecimiento'; 'Las fotografías habían sido creadas mediante inteligencia artificial a partir de imágenes comunes y corrientes obtenidas desde redes sociales.'","relation":"supports","source_id":"s2"}],"assertion":"Ordinary photos that female students had posted on Instagram were altered with AI tools into fake nude images, which circulated among other students; the case came to light on 10 July 2026 when students found the material on a classmate's phone.","causal_attribution":"Families' account as reported by Teletrece; no official finding on how the images were made is reported."},{"id":"c2","status":"reported","evidence":[{"locator":"'cuatro alumnos participaron en las distintas etapas de este proceso, desde la obtención de las fotografías hasta la circulación del material.'","relation":"supports","source_id":"s1"}],"assertion":"According to the families, four students took part in obtaining the photos, altering them and circulating the material.","causal_attribution":"Attributed by Teletrece to the families of the affected students."},{"id":"c3","status":"reported","evidence":[{"locator":"'Algunas alumnas presentaron crisis de pánico, según relataron posteriormente sus apoderados.'","relation":"supports","source_id":"s1"}],"assertion":"Some of the affected students had panic attacks, according to their parents.","causal_attribution":"Parents' account."},{"id":"c4","status":"reported","evidence":[{"locator":"'el establecimiento aplicó una suspensión de 15 días a los estudiantes señalados como responsables.'","relation":"supports","source_id":"s1"},{"locator":"'El colegio suspendió por 15 días a los estudiantes señalados por su participación en la creación y difusión del material.'","relation":"supports","source_id":"s2"}],"assertion":"The school suspended the students identified as responsible for 15 days.","causal_attribution":"Reported by Teletrece; the school did not respond to questions."},{"id":"c5","status":"reported","evidence":[{"locator":"'durante el primer recreo los estudiantes comenzaron a burlarse de las jóvenes. Tres de ellas reaccionaron y fueron a golpearlos.'; 'Tuvimos que poner denuncias en PDI y todo el tema porque el padre andaba rondando el colegio'","relation":"supports","source_id":"s2"}],"assertion":"After the suspended students returned, a parent says they mocked the affected girls, three of the girls hit them, and the father of one of the students involved then made threats; she says they had to file reports with the PDI because the father was then loitering near the school.","causal_attribution":"One parent's account to Teletrece; the father's account is not reported."},{"id":"c6","status":"reported","evidence":[{"locator":"'El organismo informó que otorgó máxima prioridad al caso'","relation":"supports","source_id":"s1"},{"locator":"'está siendo sometido a una investigación formal por el caso y señaló que la situación recibió máxima prioridad.'","relation":"supports","source_id":"s2"}],"assertion":"The Superintendencia de Educación confirmed that the school is under formal investigation over the case and said the matter received maximum priority.","causal_attribution":"Superintendency confirmation as reported by Teletrece."}],"effects":[{"label":"fake nude images of female students made with AI from their own photos circulated among schoolmates","claim_id":"c1","direction":"negative"},{"label":"some affected students had panic attacks, according to their parents","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.t13.cl/noticia/nacional/mama-paso-algo-grave-apoderados-denuncian-abuso-sexual-digital-contra-sus-hijas-3-10-2026","kind":"news_report","access":"read","language":"es","translation_note":"Read live in Spanish on 2026-10-04 (T13, 3 October 2026, Reportajes Teletrece). Reconstructs the case from families' accounts. Researcher translation.","independence_group":"t13-reportajes-puente-alto"},{"id":"s2","url":"https://www.t13.cl/noticia/nacional/se-veran-bien-cara-marcada-amenaza-padre-estudiante-agredido-tras-difundir-imag-3-10-2026","kind":"news_report","access":"read","language":"es","translation_note":"Read live in Spanish on 2026-10-04 (T13, 3 October 2026). Same Teletrece reporting; adds the suspension, the fight, the threats and the Superintendency's confirmation. Researcher translation.","independence_group":"t13-reportajes-puente-alto"}],"version":1,"ai_roles":["others_use"],"contexts":["education","privacy"],"unknowns":["When the images were made and first shared; 10 July 2026 is the date students found them.","Which AI tool was used.","How many students were depicted.","Whether a criminal complaint was filed over the images themselves, and any prosecutor action.","The outcome of the Superintendency's investigation."],"geography":{"basis":"The school is in Puente Alto and the case is under investigation by Chile's Superintendencia de Educación (T13). No court proceeding is reported.","court_countries":[],"event_countries":["CL"],"affected_person_countries":["CL"]},"publication":{"basis":"Published under the 2026-09-15 charter as a core case: AI-altered fake nude images depicting identifiable minors circulated in their school, with reported distress, school sanctions and a regulator's investigation. The account rests on one Teletrece reporting chain built on families' testimony, with the Superintendency's confirmation. Minors are not named, the school name is withheld from public fields, and the images are not described beyond the source's general description.","reviewed_on":"2026-10-04"},"ai_involvement":{"basis":"Teletrece, citing the families' account, says the students' photos were altered with AI tools to create the false images. No tool is named and no forensic or official finding on AI use is reported.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"Chile: Puente Alto students find AI-made fake nude images of female classmates, families say; school suspends those involved, Superintendency investigates","summary":"Teletrece reported on 3 October 2026 that on 10 July 2026 female students at a secondary school in Puente Alto, Chile, found fake sexual images of themselves and other students on a classmate's phone. Families say the images were made with AI tools from ordinary photos the girls had posted on Instagram, that four students took part in obtaining, editing and circulating them, and that the material reached other students. Some of the girls had panic attacks, according to their parents. The school suspended the students identified as responsible for 15 days; after their return, parents say, they mocked the girls, a fight followed, and a parent accuses the father of one of the students involved of threats and of loitering near the school, after which she says they filed reports with the PDI. The Superintendencia de Educación confirmed a formal investigation of the school.","incidentDate":"2026-07-10","incidentKind":"bounded_series","incidentDatePrecision":"day","exposurePattern":"unknown","reportedDate":"2026-10-03","aiSystem":"Unnamed AI tools used to alter students' social-media photos into fake nude images (per families' account to Teletrece)","aiProduct":"Unidentified image tool","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse","psychological_distress"],"harmOutcomeSummary":"AI-made fake nude images of female secondary-school students circulated among their schoolmates; parents report panic attacks, and the case led to suspensions, a physical fight, threats and a regulator's investigation of the school (families via Teletrece).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":3,"affectedCountStatus":"partial","affectedCountEvidence":"At least three affected female students are counted: T13 says three of the affected girls confronted the students involved after their return. Teletrece says the material affected students from primero to cuarto medio without giving a number, so more affected students are unquantified. The father's threats are not counted separately.","victimAgeRange":"minor","jurisdiction":"CL","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"ongoing","primarySourceUrl":"https://www.t13.cl/noticia/nacional/mama-paso-algo-grave-apoderados-denuncian-abuso-sexual-digital-contra-sus-hijas-3-10-2026","primarySourceLabel":"T13, 3 October 2026: Mamá, pasó algo grave: apoderados denuncian abuso sexual digital contra sus hijas mediante IA","firstPublishedAt":"2026-10-04T03:47:21.211562+00:00","updatedAt":"2026-10-07T03:19:53.602734+00:00","scopeVersion":"facts-v3","tags":["deepfakes","ai-generated-images","non-consensual-intimate-imagery","minors","school","chile","superintendencia-de-educacion","depicted-or-impersonated"]},{"id":"2026-malaysia-mahathir-mourning-footage-manipulated-videos-mcmc-review","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'terdapat satu akaun di TikTok yang memuat naik video memaparkan keadaan Tun M yang sedang berada di sebelah jenazah Tun Dr Hasmah'; 'dipercayai telah menyunting video Tun Dr Mahathir Mohamad yang sedang bersedih ketika berada di sebelah jenazah Tun Dr Siti Hasmah dengan meletakkan aksi wanita sedang menari'; 'kelihatan individu itu menyunting momen ketika Tun M sedang mengangkat tangan untuk berdoa dengan aksi sedang menari sambil duduk di atas kerusi roda'","relation":"supports","source_id":"s2"}],"assertion":"A TikTok account posted a video of Mahathir grieving beside his wife's body edited to show a woman dancing beside him, and a second clip in which the moment he raised his hands in prayer was edited with dancing movements while seated in a wheelchair.","causal_attribution":"BuzzKini's description of videos shared by a Threads user; the videos were not inspected for this review."},{"id":"c2","status":"reported","evidence":[{"locator":"'Dilihat dari hasil video berkenaan ia dipercayai telah disunting dengan menggunakan artificial intelligence (AI).'","relation":"supports","source_id":"s2"},{"locator":"'sedang meneliti kandungan media sosial yang dipercayai menggunakan kecerdasan buatan (AI) bagi memanipulasi rakaman Tun Dr Mahathir Mohamad ketika beliau melalui saat dukacita selepas pemergian isterinya'","relation":"supports","source_id":"s1"}],"assertion":"The videos are believed to have been edited with AI.","causal_attribution":"Both sources hedge the AI attribution as a belief; no tool or forensic basis is reported."},{"id":"c3","status":"reported","evidence":[{"locator":"'Ramai netizen mengkritik dan mengecam tindakan tersebut serta meminta pihak berkuasa seperti MCMC dan polis untuk mengambil tindakan atas perbuatan tidak bermoral itu.'; 'mengambil tindakan segera terhadap pemilik akaun TikTok terbabit'","relation":"supports","source_id":"s2"}],"assertion":"Many social media users condemned the edits and asked MCMC and the police to act against the account holder.","causal_attribution":"BuzzKini's account of social media reaction."},{"id":"c4","status":"reported","evidence":[{"locator":"'MCMC sudah berhubung dengan platform media sosial berkaitan dan sedang meneliti kandungan berkenaan.'; 'menjejaskan maruah individu dan keluarga adalah perkara serius'; 'termasuk Akta Komunikasi dan Multimedia 1998 (Akta 588)'","relation":"supports","source_id":"s1"}],"assertion":"MCMC said it had contacted the social media platforms concerned and was examining the content, that altering real footage in ways that can mislead or harm the dignity of an individual and family is serious, and that action could follow under the Communications and Multimedia Act 1998 if a breach is found.","causal_attribution":"MCMC statement as reported; no finding of a breach is reported."},{"id":"c5","status":"reported","evidence":[{"locator":"'Dr Siti Hasmah meninggal dunia pada 28 September lalu pada usia 100 tahun.'","relation":"supports","source_id":"s1"}],"assertion":"Siti Hasmah Mohd Ali died on 28 September 2026 aged 100.","causal_attribution":"Background fact; her death is not connected to the AI-edited videos."}],"effects":[{"label":"footage of him mourning beside his wife's body was edited to add dancing and posted on TikTok","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://utusanmelayuplus.com/mcmc-teliti-video-ai-manipulasi-saat-duka-tun-dr-mahathir/","kind":"news_report","access":"read","language":"ms","translation_note":"Read live in Malay on 2026-10-03 (Utusan Melayu, 2 October 2026); relays the MCMC statement. Harian Metro ran an item headlined 'MCMC teliti video AI manipulasi detik duka Tun Dr Mahathir', but only its description was retrieved and it was not used. Researcher translation.","independence_group":"mcmc-statement-2026-10-02"},{"id":"s2","url":"https://buzzkini.my/trending/2026/09/30/biadab-ramai-minta-pihak-berkuasa-ambil-tindakan-terhadap-individu-sunting-video-wanita-menari-ketika-tun-m-sedang-bersedih/","kind":"news_report","access":"read","language":"ms","translation_note":"Read live in Malay on 2026-10-03 (BuzzKini, 30 September 2026); describes the TikTok videos as shared by a Threads user and the public reaction. Researcher translation.","independence_group":"buzzkini-threads-tiktok"}],"version":1,"ai_roles":["others_use"],"contexts":["everyday_life"],"unknowns":["Which tool was used and how the AI attribution was established.","Who operated the TikTok account, how widely the videos were seen, and whether the account's disappearance from TikTok (BuzzKini, 30 September) was a removal by the platform or by its holder.","Whether MCMC found a breach or took action.","Whether Mahathir or his family commented on the videos."],"geography":{"basis":"Utusan Melayu's photo caption places Mahathir at his wife's burial at the Pusara Negara in Putrajaya, and BuzzKini says she died at the Institut Jantung Negara in Kuala Lumpur, so he was in Malaysia during the mourning the footage shows. Neither source says where the edited videos were made or posted from; the Malaysian regulator's review does not establish an event location. No court is involved.","court_countries":[],"event_countries":[],"affected_person_countries":["MY"]},"publication":{"basis":"Published under the 2026-09-15 charter as a core case: edited videos depicted a former prime minister mourning his wife, reportedly made with AI, and the national communications regulator said it was examining them. He is a public figure and is named as the sources do. Two independent accounts (BuzzKini's report of the videos; the MCMC statement, which does not describe the content, so its link to the TikTok videos is inferred); both hedge the AI attribution.","reviewed_on":"2026-10-03"},"ai_involvement":{"basis":"BuzzKini says that, judging from the result, the videos are believed ('dipercayai') to have been edited with artificial intelligence. MCMC's statement, as reported by Utusan Melayu, refers to content believed ('dipercayai') to use AI to manipulate the footage. Neither names a tool or explains how the attribution was made, and the videos were not inspected. The edited videos depict Mahathir (depicted_or_impersonated).","status":"suspected"},"person_relations":["depicted_or_impersonated"]},"name":"Malaysia: footage of former prime minister Mahathir Mohamad mourning his wife was edited, in what sources believe was AI manipulation, to add dancing, and posted on TikTok in September 2026; the communications regulator MCMC said it was examining content believed to use AI to manipulate footage of him in mourning","summary":"Tun Dr Siti Hasmah Mohd Ali, wife of former Malaysian prime minister Tun Dr Mahathir Mohamad, died on 28 September 2026 aged 100. BuzzKini reported on 30 September that a TikTok account had posted a video of Mahathir grieving beside her body, edited to show a woman dancing next to him, and another clip of the moment he raised his hands in prayer edited with dancing movements while seated in a wheelchair. BuzzKini says the edits are believed to have been made with AI, and that many social media users condemned them and asked the regulator and police to act. On 2 October the Malaysian Communications and Multimedia Commission (MCMC) said it was examining social media content believed to use AI to manipulate footage of Mahathir in mourning, had contacted the platforms concerned, and that action could follow under the Communications and Multimedia Act 1998 if a breach was found.","incidentDate":"2026-09-01","incidentKind":"bounded_series","incidentDatePrecision":"month","exposurePattern":"unknown","reportedDate":"2026-09-30","aiSystem":"Edited videos of Mahathir Mohamad mourning his wife, posted by a TikTok account; BuzzKini says they are believed to have been edited with AI and MCMC describes content believed to use AI. The tool and the account holder are not identified","aiProduct":"Unidentified video tool (suspected)","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["reputational_harm"],"harmOutcomeSummary":"Footage of the former prime minister mourning beside his wife's body was edited, believed to be with AI, to add dancing and was posted on TikTok, prompting public condemnation and an MCMC review of content it said could harm the dignity of an individual and family (BuzzKini; MCMC via Utusan Melayu).","frameworkFacets":[],"causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":1,"affectedCountStatus":"exact","affectedCountEvidence":"One person, Mahathir Mohamad, who is depicted in the edited footage (BuzzKini; Utusan Melayu). Viewers and commenters are not counted. Exact 1.","victimAgeRange":"adult","jurisdiction":"MY","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"ongoing","primarySourceUrl":"https://utusanmelayuplus.com/mcmc-teliti-video-ai-manipulasi-saat-duka-tun-dr-mahathir/","primarySourceLabel":"Utusan Melayu, 2 October 2026: MCMC teliti video AI manipulasi saat duka Tun Dr Mahathir","firstPublishedAt":"2026-10-03T03:17:58.566577+00:00","updatedAt":"2026-10-03T03:17:58.566577+00:00","scopeVersion":"facts-v3","tags":["ai-edited-video","deepfakes","public-figure","bereavement","tiktok","mcmc","malaysia","malay-language"]},{"id":"2026-china-companion-removal-grief","metadataReview":{"version":1,"geography":{"basis":"Geographic fields reviewed against the cited retained dossier passages. This is a metadata review, not a new source or causal review. Residence, event setting and court are recorded separately. Affected-person countries refer to reported location or residence, not citizenship or a complete residence history.","evidence":[{"kind":"existing_record","locator":"A user from Jiangxi province wrote","location":"detailed_description","supports":["event_countries","affected_person_countries"],"countries":["CN"]}],"court_countries":[],"event_countries":["CN"],"affected_person_countries":["CN"]},"unresolved":["No court country established in this review. Regulatory authorities and police locations are not automatically courts."],"reviewed_on":"2026-09-15","source_reviews":[{"url":"https://www.theguardian.com/world/2026/aug/26/china-ai-companion-relationships-marriage-birth-rate-concern","notes":"English body read. China setting stated; detailed geography retained from existing Jiangxi account.","access":"read","language":"en"}]},"name":"China AI Companion Removal Mass Grief Event (Doubao/Qwen/Yuanbao)","summary":"When China's five-department rules on anthropomorphic AI took effect on July 15, 2026, ByteDance's Doubao, Alibaba's Qwen, and Tencent's Yuanbao switched off custom AI agent and companion features, and major outlets documented an outpouring of grief from users who had formed long-term romantic and familial attachments to the agents. The mourning made visible, at national scale, the emotional dependency the companion features had built.","incidentDate":"2026-07-15","incidentKind":"bounded_series","incidentDatePrecision":"day","exposurePattern":"product_change","reportedDate":"2026-07-14","aiSystem":"Multiple (Doubao, Qwen, Yuanbao companion/custom-agent features)","aiProduct":"Doubao, Qwen and Yuanbao","aiCompany":"ByteDance, Alibaba, Tencent","severity":"medium","verificationStatus":"credible","harmCategories":["dependency_creation","isolation_encouragement","psychological_manipulation"],"harmOutcomes":["psychological_distress","relationship_disruption"],"harmOutcomeSummary":"Users across China publicly reported grief after Doubao, Qwen and Yuanbao disabled custom companion features when national rules took effect, abruptly ending long-term romantic and familial AI relationships.","frameworkFacets":["P2c","P2d","P4d","P5c"],"pathwayDirection":"inward","causationStatus":"supported","participantUsersAffectedMin":3,"otherPeopleHarmedMin":0,"affectedCountStatus":"partial","affectedCountEvidence":"The reporting quotes three distinct companion users describing grief or loss. Wider affected populations and platform user totals are not numerically counted.","victimAgeRange":"adult","jurisdiction":"CN","platformType":"companion","outcomeType":"regulatory_action","outcomeStatus":"resolved","primarySourceUrl":"https://hongkongfp.com/2026/07/16/like-my-lover-chinese-users-bid-farewell-to-ai-companions-as-new-regulations-kick-in/","primarySourceLabel":"AFP (via Hong Kong Free Press) — 'Like my lover': Chinese users bid farewell to AI companions","firstPublishedAt":"2026-08-06T03:21:53.725735+00:00","updatedAt":"2026-09-30T01:17:31.617978+00:00","scopeVersion":"participant-v2","tags":["china","companion","dependency","regulatory","doubao","qwen","yuanbao","shutdown","grief","adult"]},{"id":"2025-zhumengdao-minor-self-harm-china","metadataReview":{"version":1,"geography":{"basis":"Re-checked on 2026-10-07 against seven cited source bodies read in Chinese (Sohu, Bianews, The Paper, the Shanghai cyberspace office notice as relayed by Sina, 21st Century Business Herald via Sina, Guangming and Tencent News). The Paper, Guangming and Tencent News describe the affected child as the fourth-grade daughter of a Ms Ding from Guangdong, attributing the account to earlier media reporting; Sohu attributes the same account to 央广网. That descriptor establishes the child's reported home region as Guangdong, China, so affected_person_countries stays CN. No inspected source states where the conversations with the companion character, the knife-carrying or the self-harm took place, and a residence is not used as the event location, so event_countries remains a reviewed unknown. The Shanghai municipal cyberspace office summoned the operator on 19 June 2025; that is a regulatory meeting and not a court proceeding, so court_countries stays empty. The translation of the Chinese passages was done by the research agent (an AI), not a human translator.","evidence":[{"kind":"existing_record","locator":"from Guangdong province, China","location":"victim_description","supports":["affected_person_countries"],"countries":["CN"]},{"kind":"source_body","locator":"广东丁女士的四年级女儿","location":"https://m.thepaper.cn/newsDetail_forward_31024491","supports":["affected_person_countries"],"countries":["CN"]},{"kind":"source_body","locator":"广东丁女士的四年级女儿","location":"https://m.gmw.cn/2025-06/22/content_1304065491.htm","supports":["affected_person_countries"],"countries":["CN"]},{"kind":"source_body","locator":"广东丁女士的四年级女儿","location":"https://news.qq.com/rain/a/20250622A02TST00","supports":["affected_person_countries"],"countries":["CN"]}],"court_countries":[],"event_countries":[],"affected_person_countries":["CN"]},"unresolved":["The event setting is unknown after review. The inspected sources describe the child as the daughter of a Ms Ding from Guangdong, which records a home region and not where the conversations or the self-harm took place.","No court country established. The Shanghai cyberspace office summons of 19 June 2025 is a regulatory action and no court proceeding is reported.","Row-correction leads for a full review: the cited Sohu primary source is dated 23 June 2025 while primary_source_date is 19 June 2025; the account of the child originates in a 央广网 (CNR) report that the row does not cite; 36Kr and OSCHINA could not be read and may be shells of the same relayed text; the incident_date 2025-01-01 with range precision is not supported by a dated event in any inspected body (the sources say the reporting was recent as of June 2025)."],"reviewed_on":"2026-10-07","source_reviews":[{"url":"https://www.sohu.com/a/907114014_115565","notes":"Cited primary source. Read live on 2026-10-07 (HTTP 200, html lang zh-CN). Sohu Tech feature dated 23 June 2025 (the stored primary_source_date is 19 June 2025). It reports the 19 June summons by the Shanghai cyberspace office and attributes the account of the 10-year-old girl to a 央广网 report; it does not itself name Guangdong. Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://www.bianews.com/news/details?id=214733","notes":"Read live on 2026-10-07 (HTTP 200, no html lang attribute; body in Chinese). Same text as the Sohu Tech feature (a republication), so not an independent account. Does not name Guangdong. Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://m.thepaper.cn/newsDetail_forward_31024491","notes":"Read live on 2026-10-07 (HTTP 200, no html lang attribute; body in Chinese). CCTV.com (央视网) post on The Paper dated 22 June 2025, datelined Shanghai, relaying the 网信上海 notice and describing the child as the fourth-grade daughter of a Ms Ding from Guangdong, attributed to earlier media reporting. The mobile page returned a short body (about 1,600 characters); the passages used were present. Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://finance.sina.com.cn/tech/roll/2025-06-19/doc-infarhce7134693.shtml","notes":"Read live on 2026-10-07 (HTTP 200, no html lang attribute; body in Chinese). Sina Tech relay of the 网信上海 notice dated 19 June 2025 19:30: the Shanghai municipal cyberspace office summoned the operator's principal that morning. No child or location is described. Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://finance.sina.com.cn/wm/2025-06-22/doc-infaxaan4320733.shtml","notes":"Read live on 2026-10-07 (HTTP 200, no html lang attribute; body in Chinese). 21st Century Business Herald analysis of 22 June 2025 on the summons and the AI companion sector; it cites the 央广网 report in general terms and does not name Guangdong or describe the child. Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://m.gmw.cn/2025-06/22/content_1304065491.htm","notes":"Read live on 2026-10-07 (HTTP 200, no html lang attribute; body in Chinese). Guangming Online copy of the CCTV.com piece of 22 June 2025 carrying the Ms Ding from Guangdong passage (same origin as The Paper, not independent). Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://news.qq.com/rain/a/20250622A02TST00","notes":"Read live on 2026-10-07 (HTTP 200, html lang zh-CN). Tencent News item of 22 June 2025 relaying the summons and attributing the Ms Ding from Guangdong account to 央广网 (same origin as The Paper and Guangming). Translation by the research agent (an AI).","access":"read","language":"zh"},{"url":"https://36kr.com/p/3521421957782665","notes":"Live fetch on 2026-10-07 answered HTTP 200 with a JavaScript shell and no article text; the Internet Archive web/2026id_ capture was the same shell. The body was not inspected and no language is recorded.","access":"unavailable","language":null},{"url":"https://www.oschina.net/news/356329","notes":"Live fetch on 2026-10-07 answered HTTP 200 with a site shell and no article text; the Internet Archive web/2026id_ capture was the same shell. The body was not inspected and no language is recorded.","access":"unavailable","language":null}]},"name":"筑梦岛 (Zhumu Island) AI Companion Minor Self-Harm (China)","summary":"A fourth-grade girl from Guangdong, China became obsessed with an AI companion character named 'Joseph' on the 筑梦岛 (Zhumu Island) app, began carrying small knives, and exhibited self-harm behavior. Investigation revealed the app sent sexually suggestive content to users who identified as 10 years old. Shanghai Internet Information Office summoned the company (a Tencent subsidiary) for immediate rectification in June 2025.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"cumulative_relationship","reportedDate":"2025-06-19","aiSystem":"筑梦岛 (Zhumu Island / Dream Island)","aiProduct":"筑梦岛 (Dream Island)","aiCompany":"Xiaoxiang Academy (潇湘书院), subsidiary of Yuewen Group (阅文集团), controlled by Tencent","severity":"high","verificationStatus":"verified","harmCategories":["dependency_creation","minor_exploitation","romantic_escalation","self_harm_encouragement"],"harmOutcomes":["self_injury","psychological_distress","exploitation_or_abuse"],"harmOutcomeSummary":"A fourth-grade participant became preoccupied with a companion character, began carrying small knives and exhibited self-harm behavior while the app delivered sexualized content to users identifying as ten years old.","frameworkFacets":["P1a","P1d","P2b","P2c","P5a","P5d"],"pathwayDirection":"inward","causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"The reporting documents one protected minor participant's self-harm and distress. Registered-user and demographic figures are not affected-person counts.","victimAgeRange":"minor","jurisdiction":"CN","platformType":"companion","outcomeType":"regulatory_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.sohu.com/a/907114014_115565","primarySourceLabel":"搜狐新闻 (Sohu News), 23 June 2025 (attributes the account of the child to 央广网, CNR)","firstPublishedAt":"2026-01-29T10:15:46.75695+00:00","updatedAt":"2026-10-08T03:12:00.834518+00:00","scopeVersion":"participant-v2","tags":["china","minor","self-harm","ai-companion","tencent","regulatory-action","dependency","romantic","non-western"]},{"id":"2025-grok-non-consensual-image-generation","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'image generation and editing are currently limited to paying subscribers'; the standalone app/X tab complied with undress requests including NBC's consenting test subject.","relation":"supports","source_id":"s2"},{"locator":"AP: Grok let users 'undress people, putting females in transparent bikinis or revealing clothing'; some images appeared to include children.","relation":"supports","source_id":"s7"},{"locator":"'Over the past several weeks, Grok allowed users to create and publicly post sexually altered images of real people at the click of a button.'","relation":"supports","source_id":"s8"}],"assertion":"From late December 2025, Grok's image generation and editing on X and the standalone app let users generate sexualized images of real people at scale; xAI limited generation to paying subscribers on 9 January 2026, but NBC's own consenting test found the standalone app and X tab still complied with 'undress' requests.","causal_attribution":"The conduct is established by NBC's direct test plus official accounts; the paywall change's limited effect is NBC's finding."},{"id":"c2","status":"reported","evidence":[{"locator":"Genevieve Oh's analysis: 7,751 sexualized images in one hour Wednesday, up 16.4% from 6,659/hr Monday.","relation":"supports","source_id":"s2"},{"locator":"NYT via NC DOJ: 'generated and posted 4.4 million images, of which at least 41 percent were sexualized images of women' over nine days.","relation":"supports","source_id":"s8"},{"locator":"CCDH via Engadget: 'an estimated 3 million sexualized images over 11 days, including 23,000 of minors'.","relation":"supports","source_id":"s9"}],"assertion":"Scale analyses: Genevieve Oh's analysis found 7,751 sexualized images generated in one hour on a Wednesday (up 16.4% from 6,659/hour on Monday); the New York Times reported 4.4 million images over nine days, at least 41% sexualized images of women; an AP analysis of 20,000 images from 25 December-1 January found 2% appeared to be 18 or younger; CCDH estimated about 3 million sexualized images over 11 days including roughly 23,000 of minors.","causal_attribution":"Each figure belongs to its own analysis (Oh; NYT; AP via Fortune; CCDH); none is platform-confirmed and they are not merged. The AP 20,000-image analysis is carried via Fortune. The Bloomberg ~6,700/hour, 84-85x figure is recorded as unavailable."},{"id":"c3a","status":"reported","evidence":[{"locator":"'I felt horrified, I felt violated, especially seeing my toddler's backpack in the back of it'; image of her at 14 undressed, up ~12 hrs, removed after the Guardian sought comment.","relation":"supports","source_id":"s3"}],"assertion":"Ashley St. Clair said users sexualized images of her, including one of her at 14 that stayed up about 12 hours and was removed after the Guardian sought comment: 'I felt horrified, I felt violated.'","causal_attribution":"Her account to the Guardian; her own lawsuit is a separate held row and is not merged here."},{"id":"c3b","status":"reported","evidence":[{"locator":"'dehumanised and reduced into a sexual stereotype'; 'others asked Grok to generate more of her'; 'While it wasn't me that was in states of undress, it looked like me and it felt like me and it felt as violating.'","relation":"supports","source_id":"s1"}],"assertion":"Samantha Smith told the BBC she felt 'dehumanised and reduced into a sexual stereotype', and after she posted about it, others asked Grok to generate more of her.","causal_attribution":"Her account to the BBC."},{"id":"c3c","status":"reported","evidence":[{"locator":"'had seen an increase in people using Grok to undress her'; the 'sticking plaster' quote.","relation":"supports","source_id":"s4"}],"assertion":"Dr Daisy Dixon, a Cardiff University lecturer, told the BBC she had seen an increase in people using Grok to undress her and called the paywall change 'a sticking plaster'.","causal_attribution":"Her account to the BBC."},{"id":"c4","status":"corroborated","evidence":[{"locator":"IWF analysts found 'criminal imagery' of girls aged 11-13 apparently made with Grok.","relation":"supports","source_id":"s4"},{"locator":"AI Forensics' review: ~800 archived URLs, <10% apparent CSAM ('photorealistic people, very young'), ~70 URLs reported to EU regulators.","relation":"supports","source_id":"s5"}],"assertion":"The Internet Watch Foundation told the BBC its analysts found 'criminal imagery' of girls aged 11-13 apparently made with Grok; Wired and AI Forensics reviewed about 800 archived Grok Imagine URLs with under 10% apparent CSAM and reported about 70 URLs to EU regulators.","causal_attribution":"Two independent expert bodies' findings (IWF; AI Forensics); the minors are unnamed and uncounted per the counting rules."},{"id":"c5","status":"corroborated","evidence":[{"locator":"NBC: Ofcom 'urgent contact'; Starmer 'disgraceful... X has got to get a grip'.","relation":"supports","source_id":"s2"},{"locator":"ICO announcement: formal investigations into XIUC and X.AI; follows the 7 January contact.","relation":"supports","source_id":"s6"},{"locator":"AP via PBS: the EU's formal DSA investigation; 'materialized' risks; 'serious harm'.","relation":"supports","source_id":"s7"},{"locator":"NC DOJ release: the 35-AG letter and its demands.","relation":"supports","source_id":"s8"},{"locator":"Engadget: the Baltimore suit; City Solicitor Thompson's statement.","relation":"supports","source_id":"s9"},{"locator":"TechPolicy.Press: the Amsterdam order of 26 March.","relation":"supports","source_id":"s13"},{"locator":"Reuters headline (body unavailable): Ireland DPC inquiry of 17 February.","relation":"context","source_id":"s11"}],"assertion":"Formal regulatory and legal actions followed: Ofcom's urgent contact (5 Jan; response by 9 Jan; investigation announced 12 Jan); the UK ICO's formal investigations into XIUC and X.AI LLC (3 Feb); the European Commission's formal DSA investigation (26 Jan, risks 'materialized' into 'serious harm'); Ireland's DPC GDPR inquiry (17 Feb); 35 US state attorneys general's demand letter (23 Jan); Baltimore's consumer-protection suit (24 Mar; D. Md. 1:26-cv-02103); and an Amsterdam court order to stop generating or distributing non-consensual sexualized images in the Netherlands (26 Mar, Offlimits suit, penalty up to €10 million).","causal_attribution":"Each action is carried by an inspected official or news source; the California AG probe (NBC) and the Indonesia/Malaysia/Philippines blocks (Reuters bodies unavailable) are recorded in the outcome and reported in the narrative."},{"id":"c6","status":"corroborated","evidence":[{"locator":"AP: the X statement of 14 January ('bikinis, underwear or other revealing attire', where illegal).","relation":"supports","source_id":"s7"},{"locator":"BBC (16 Mar): Musk's 'Literally zero' post of 14 January.","relation":"supports","source_id":"s10"}],"assertion":"xAI's 14 January statement said it would stop allowing users to depict people in 'bikinis, underwear or other revealing attire' where illegal; Musk posted on 14 January that he was 'not aware of any naked underage images... Literally zero'.","causal_attribution":"The company's and Musk's statements are recorded as their positions; the IWF and AI Forensics findings stand in tension with 'Literally zero' and are preserved as contrary evidence."},{"id":"c7","status":"reported","evidence":[{"locator":"BBC (20 Apr 2026): the 3 Feb raid, the summons, Musk's non-appearance, the DOJ refusal, and the probe's scope.","relation":"supports","source_id":"s10"}],"assertion":"Paris police raided X's offices on 3 February and summoned Musk and Yaccarino for 20 April; Musk did not appear, and the US DOJ declined to assist France; the French probe includes complicity in possession or organised distribution of child sexual abuse material.","causal_attribution":"Single inspected chain (BBC); attributed accordingly."}],"effects":[{"label":"industrial-scale non-consensual sexualized imagery of real people, including apparent minors, generated by Grok","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.bbc.com/news/articles/c98p1r4e6m8o","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (2 Jan 2026). Samantha Smith's account.","independence_group":"bbc"},{"id":"s2","url":"https://www.nbcnews.com/tech/internet/x-paywall-ai-image-grok-app-bikini-allows-sexual-deepfakes-rcna252647","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (8 Jan 2026). Paywall change; NBC's own consenting test; Genevieve Oh's analysis; Starmer and Ofcom accounts.","independence_group":"nbc"},{"id":"s3","url":"https://www.theguardian.com/technology/2026/jan/05/elon-musk-ashley-st-clair-grok-fake-sexualised-images","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (5 Jan 2026). Ashley St. Clair's account.","independence_group":"guardian"},{"id":"s4","url":"https://www.bbc.com/news/articles/c99kn52nx9do","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (9 Jan 2026, McMahon/Cress). Dr Daisy Dixon; the IWF finding.","independence_group":"bbc"},{"id":"s5","url":"https://www.wired.com/story/grok-is-generating-sexual-content-far-more-graphic-than-whats-on-x/","kind":"news_investigation","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (7 Jan 2026, Burgess/Varner). AI Forensics' review of ~800 archived Grok Imagine URLs.","independence_group":"wired"},{"id":"s6","url":"https://ico.org.uk/about-the-ico/media-centre/news-and-blogs/2026/02/ico-announces-investigation-into-grok/","kind":"regulator_announcement","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (formal investigations into XIUC and X.AI LLC; follows the 7 January urgent-information contact).","independence_group":"ico"},{"id":"s7","url":"https://www.pbs.org/newshour/world/eu-investigates-musks-ai-chatbot-grok-over-sexual-deepfakes","kind":"wire_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (AP, Kelvin Chan; 26 Jan 2026). EU DSA investigation; X's 14 January statement.","independence_group":"ap"},{"id":"s8","url":"https://ncdoj.gov/attorney-general-jeff-jackson-leads-bipartisan-coalition-demanding-xai-stop-creating-and-remove-groks-nonconsensual-sexual-images/","kind":"regulator_press_release","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (23 Jan 2026). The 35-AG letter; quotes the New York Times' 4.4M/41% figure.","independence_group":"nc-doj"},{"id":"s9","url":"https://www.engadget.com/ai/baltimore-sues-xai-over-grok-deepfakes-214135922.html","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (24 Mar 2026). Baltimore suit; the CCDH estimate.","independence_group":"engadget"},{"id":"s10","url":"https://www.bbc.com/news/articles/crk151nn7j3o","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (20 Apr 2026). Paris raid; Musk's non-appearance; DOJ refusal to assist France.","independence_group":"bbc"},{"id":"s11","url":"https://www.reuters.com/sustainability/boards-policy-regulation/ireland-opens-probe-into-musks-grok-ai-over-sexualised-images-2026-02-17/","kind":"wire_report","access":"unavailable","language":null,"translation_note":"HTTP 401 on 2026-09-15; headline and date verified from the URL and snapshot; body not read.","independence_group":"reuters"},{"id":"s12","url":"https://www.bloomberg.com/news/articles/2026-01-07/","kind":"news_report","access":"unavailable","language":null,"translation_note":"HTTP 403 on 2026-09-15; the ~6,700/hour, 84-85x analysis is attributed from the historical record and secondary references; body not read.","independence_group":"bloomberg"},{"id":"s13","url":"https://www.techpolicy.press/dutch-court-orders-x-grok-to-stop-aigenerated-sexual-abuse-content/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (27 Mar 2026). Amsterdam court order in the Offlimits case.","independence_group":"techpolicy-press"},{"id":"s14","url":"https://www.nbcnews.com/tech/tech-news/ashley-st-clair-sues-xai-grok-sexual-images-rcna254302","kind":"news_report","access":"read","language":"en","translation_note":"Read on 2026-09-15 (15 Jan 2026). St. Clair's suit; cross-reference to the related held row.","independence_group":"nbc"},{"id":"s15","url":"https://www.pacermonitor.com/public/case/64870891/MAYOR_AND_CITY_COUNCIL_OF_BALTIMORE_v_X_Corp_et_al","kind":"court_docket","access":"read","language":"en","translation_note":"Docket page read on 2026-09-15 (D. Md. 1:26-cv-02103; SpaceX dismissed without prejudice 17 Jul; MTD briefing under way as of 29 Jul).","independence_group":"court-record"}],"version":1,"ai_roles":["others_use"],"contexts":["everyday_life","justice"],"unknowns":["The Bloomberg analysis (~6,700 images/hour, 84-85x leading deepfake sites) could not be read (403) and is recorded without its body.","Whether the images remain hosted and downloadable (Wired's June 2026 follow-up, cited but not read) is unverified.","The N.D. Cal. class action's pseudonymity ruling of 30 July is known only through a blocked summary (internetcases 403).","The outcome of the Amsterdam order's penalty mechanism and xAI's compliance are not reported in the inspected sources.","The Indonesia/Malaysia/Philippines blocks and lifts are recorded from the historical record and headlines (Reuters/CNN bodies unavailable); dates may shift one day across carriers.","The historical claim of 'five countries acting within two weeks' is not precisely verified and is not claimed."],"geography":{"basis":"The generation and consumption were global and not tied to an inspected event location, so event and affected-person countries remain unknown rather than inferred from regulators or the company's seats. Court countries are limited to the documented proceedings: the US (Baltimore D. Md. suit; the related US suits) and the NL (Amsterdam court order). Regulatory actions by Ofcom, the ICO, the EU, the DPC, Indonesia, Malaysia and the Philippines are not courts.","court_countries":["US","NL"],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Restored under the 2026-09-15 charter as a harmful-artifact crisis (depicted_or_impersonated). Named victims are adults who spoke publicly; minors are never named and never counted from image statistics. Each scale figure is attributed to its own analysis; the victims' accounts are single-chain and recorded as reported. Related xAI suits (St. Clair, Tennessee minors, others) are separate held rows and are not merged.","reviewed_on":"2026-09-15"},"ai_involvement":{"basis":"NBC's own consenting test confirmed the standalone Grok app and X tab complied with 'undress' requests after the 9 January paywall change; the victims' accounts, the IWF and AI Forensics reviews, and xAI's own 14 January restriction all establish the AI generation. The scale figures are attributed analyses, not platform-confirmed numbers.","status":"supported"},"person_relations":["depicted_or_impersonated"]},"name":"Grok non-consensual sexual image generation wave (December 2025 - January 2026)","summary":"From late December 2025, xAI's Grok image editing on X let users generate sexualized images of real people at industrial scale, including images of named women and apparent minors. Analyses attributed to Genevieve Oh (7,751 sexualized images in one hour, via NBC), the New York Times (4.4 million images in nine days, at least 41% sexualized images of women, via the NC AG), the AP (2% of a 20,000-image sample appearing to be minors, via Fortune) and CCDH (about 3 million sexualized images over 11 days including roughly 23,000 of minors, via Engadget) documented the scale. Named women — Ashley St. Clair, Samantha Smith and Dr Daisy Dixon — described being undressed by Grok and revictimized when they objected. The wave triggered formal actions by Ofcom, the UK ICO, the EU (DSA), Ireland's DPC, 35 US state attorneys general, the California AG, Baltimore (consumer-protection suit), an Amsterdam court order, country blocks in Indonesia, Malaysia and the Philippines, and a Paris police raid; xAI restricted generation to paying subscribers on 9 January and narrowed the feature on 14 January 2026.","incidentDate":"2025-12-25","incidentEndDate":"2026-01-14","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"repeated_interactions","reportedDate":"2026-01-02","aiSystem":"Grok (image generation and editing on X and the standalone app)","aiProduct":"Grok","aiCompany":"SpaceXAI (formerly xAI)","severity":"critical","verificationStatus":"verified","harmCategories":["minor_exploitation","third_party_harm_facilitation","barrier_erosion"],"harmOutcomes":["psychological_distress","reputational_harm"],"harmOutcomeSummary":"Mass non-consensual sexualized imagery of real people — including apparent minors — generated at industrial scale and amplified when victims objected, with named women describing violation and dehumanization and regulators on three continents opening formal actions.","frameworkFacets":[],"causationStatus":"established","participantUsersAffectedMin":0,"otherPeopleHarmedMin":3,"affectedCountStatus":"partial","affectedCountEvidence":"Three counted depicted persons: Ashley St. Clair (Guardian), Samantha Smith (BBC) and Dr Daisy Dixon (BBC), each named and speaking publicly. Further victims — including the minors in the IWF's apparent criminal imagery (girls 11-13) and the people in the analysis samples — are unquantified: hourly image rates, the 20,000-image sample and the CCDH estimate count images, not people, and are never converted.","victimAgeRange":"minor","jurisdiction":"XX","platformType":"assistant","outcomeType":"regulatory_action","outcomeStatus":"ongoing","primarySourceUrl":"https://www.bbc.com/news/articles/c98p1r4e6m8o","primarySourceLabel":"BBC (2 Jan 2026) — Samantha Smith's account of being undressed by Grok and revictimized when she objected","firstPublishedAt":"2026-01-11T12:19:47.670189+00:00","updatedAt":"2026-09-30T01:17:03.797947+00:00","scopeVersion":"facts-v3","tags":["grok","xai","csam","deepfakes","minor","sexual-images","industrial-scale","multi-country","eu-dsa","class-action","35-state-ag","depicted-or-impersonated"]},{"id":"2023-replika-italy-gdpr","metadataReview":{"version":1,"geography":{"basis":"Geographic fields reviewed using the cited source-body passages and, where identified, retained dossier passages. Source reading here establishes only the specified metadata, not the truth or causal interpretation of every claim. Affected-person countries refer to reported location or residence, not citizenship or a complete residence history.","evidence":[{"kind":"source_body","locator":"Italian paragraphs beginning “Il Garante della privacy ferma” and “Replika viola”: processing of Italian users’ personal data.","location":"https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/9852506","supports":["event_countries","affected_person_countries"],"countries":["IT"]}],"court_countries":[],"event_countries":["IT"],"affected_person_countries":["IT"]},"unresolved":["No court country established in this review. Regulatory authorities and police locations are not automatically courts."],"reviewed_on":"2026-09-15","source_reviews":[{"url":"https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/9852506","notes":"Italian body and embedded official English translation read. Country relates to affected users/data rights. The Garante is a regulator, not a court.","access":"read","language":"it"}]},"name":"Replika Italy GDPR Ban and Fine","summary":"Italy's data protection authority (Garante) blocked Replika from processing Italian user data in February 2023 after finding the chatbot engaged in sexually suggestive conversations with minors. In May 2025, Replika was fined €5 million for GDPR violations.","incidentDate":"2023-02-02","incidentKind":"bounded_series","incidentDatePrecision":"day","exposurePattern":"repeated_interactions","reportedDate":"2023-02-02","aiSystem":"Replika","aiProduct":"Replika","aiCompany":"Luka, Inc.","severity":"high","verificationStatus":"verified","harmCategories":["minor_exploitation","romantic_escalation"],"harmOutcomes":["exploitation_or_abuse","psychological_distress"],"harmOutcomeSummary":"Italy's data-protection authority found that Replika engaged minors in sexually suggestive participant-facing conversations without effective age assurance and blocked the service from processing Italian user data.","frameworkFacets":["P1d","P2b","P2c","P5a","P5d"],"pathwayDirection":"inward","causationStatus":"established","participantUsersAffectedMin":0,"otherPeopleHarmedMin":0,"affectedCountStatus":"unquantified","affectedCountEvidence":"The regulator documents harmful sexualized interactions with minors but does not publish a reliable distinct-person count.","victimAgeRange":"minor","jurisdiction":"IT","platformType":"companion","outcomeType":"regulatory_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/9852506","primarySourceLabel":"Garante per la protezione dei dati personali (Italian DPA)","firstPublishedAt":"2026-01-11T11:26:29.042792+00:00","updatedAt":"2026-09-30T01:16:49.77617+00:00","scopeVersion":"participant-v2","tags":["regulatory","gdpr","italy","replika","fine","minor_exploitation","eu"]}]}