{"meta":{"exportedAt":"2026-10-22T09:25:37.073Z","formatVersion":2,"selection":{"q":"personal-information","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":2,"languages":2,"unknownLocation":0,"locationPending":0,"unknownLanguage":0,"unknownDate":1,"lawsuits":0,"regulatory":1,"minors":0,"coreRelations":1,"contextualRelations":1,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2022-hangzhou-man-sold-ai-face-swap-obscene-videos-of-public-figures-and-private-people-jailed-and-ordered-to-pay-public-interest-damages","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'2022年8月，杭州市萧山警方在网上巡查中获取一条线索，辖区内有人利用AI技术制作淫秽视频在网上进行大量传播，警方依法对此立案侦查，并迅速抓获了犯罪嫌疑人'","relation":"supports","source_id":"s1"}],"assertion":"Xiaoshan police opened a case in August 2022 after an online patrol found someone in the district making obscene videos with AI technology and spreading them widely online, and arrested the man.","causal_attribution":"Police and procuratorate account via CCTV."},{"id":"c2","status":"reported","evidence":[{"locator":"'利用“AI换脸”软件生成大量淫秽视频进行传播'; '还将“AI换脸”软件分为初级、中级和高级三个等级进行销售并传授使用教程，同时还提供网上非法收集的他人人脸素材'","relation":"supports","source_id":"s1"},{"locator":"'根据顾客的需要，还可以使用不同的女明星的形象，进行“私人定制”'","relation":"supports","source_id":"s2"}],"assertion":"Prosecutors said he used AI face-swap software to make obscene videos, spread them in paid groups, took custom face-swap orders and sold the software with tutorials and face material.","causal_attribution":"Procuratorate account."},{"id":"c3","status":"reported","evidence":[{"locator":"'被“AI换脸”侵害人脸敏感信息的受害者，不仅包括多位知名公众人物，还有很多不特定的普通人'; '其中就有人提出想要定制自己暗恋女生的换脸视频'","relation":"supports","source_id":"s1"},{"locator":"'“私人定制”换脸的对象，不仅包括明星，也有生活中的普通人'","relation":"supports","source_id":"s2"}],"assertion":"Prosecutors said the victims whose faces were swapped included several well-known public figures and many unspecified private people, and that one customer asked for the face of a woman he had a crush on.","causal_attribution":"Procuratorate account; no individual victim is described."},{"id":"c4","status":"reported","evidence":[{"locator":"'删除非法获取的个人信息，公开赔礼道歉、消除影响并赔偿损失共60000元'","relation":"supports","source_id":"s1"},{"locator":"'删除非法获取的个人信息，公开赔礼道歉、消除影响并赔偿损失共60000元'","relation":"supports","source_id":"s2"}],"assertion":"The Hangzhou Internet Court granted the prosecutors' public-interest claims, ordering deletion of the personal information, a public apology and 60,000 yuan for personal-information protection.","causal_attribution":"Court outcome as relayed; the judgment was not inspected."},{"id":"c5","status":"reported","evidence":[{"locator":"'2023年11月，杭州市萧山区人民法院判决被告人'; '犯制作、传播淫秽物品牟利罪，判处有期徒刑七年三个月，并处罚金6万元'","relation":"supports","source_id":"s1"},{"locator":"'有期徒刑七年三个月'","relation":"supports","source_id":"s2"}],"assertion":"In November 2023 the Xiaoshan District People's Court sentenced him to seven years and three months in prison and a 60,000-yuan fine for making and spreading obscene material for profit.","causal_attribution":"Court outcome as relayed; the judgment was not inspected."}],"effects":[{"label":"faces of public figures and private people swapped into obscene videos with AI and spread and sold without consent, per prosecutors","claim_id":"c3","direction":"negative"}],"sources":[{"id":"s1","url":"https://app.xinhuanet.com/news/article.html?articleId=50a79df8-e37c-4837-86dd-2b0deef66ca0","kind":"news_report","access":"read","language":"zh","translation_note":"Read in the original Chinese on 2026-10-22 (HTTP 200). English renderings in this record are the research agent's (an AI's) own translations; no human translator reviewed them. Xinhua app relay of CCTV's report quoting Xiaoshan prosecutors and Hangzhou Internet Court judges; no judgment inspected.","independence_group":"xiaoshan-procuratorate-and-courts-via-cctv"},{"id":"s2","url":"https://www.jinantimes.com.cn/news-216-4931256.html","kind":"news_report","access":"read","language":"zh","translation_note":"Read in the original Chinese on 2026-10-22 (HTTP 200). English renderings in this record are the research agent's (an AI's) own translations; no human translator reviewed them. New Yellow River roundup (via Jinan Times) restating the same procuratorate and court account; it also covers a separate Beijing case not used here.","independence_group":"xiaoshan-procuratorate-and-courts-via-cctv"}],"version":1,"ai_roles":["others_use"],"contexts":["privacy","justice"],"unknowns":["When the obscene face-swap videos were first made and spread; the reports give 2020 for his first use of the software and August 2022 for the police case.","How many people were depicted and who they were.","Which face-swap software was used.","The date of the Hangzhou Internet Court judgment.","Whether either judgment was appealed."],"geography":{"basis":"Xiaoshan police in Hangzhou found the videos being spread from their district and arrested the man there, and the Xiaoshan court and Hangzhou Internet Court decided the case, so the event is placed in China. Where the depicted people live is not reported.","court_countries":["CN"],"event_countries":["CN"],"affected_person_countries":[]},"publication":{"basis":"Published as a core case (depicted_or_impersonated): Hangzhou prosecutors said a man used AI face-swap software to put public figures' and private people's faces into obscene videos that he spread and sold, and he was jailed and ordered to pay public-interest damages. One reporting chain (procuratorate and courts via CCTV), read in two Chinese sources.","reviewed_on":"2026-10-22"},"ai_involvement":{"basis":"Prosecutors, an examining party, said the man used AI face-swap software to generate the obscene videos, and the courts convicted him and granted the public-interest claims on that account. The generated videos depicted the faces of public figures and private people (depicted_or_impersonated). The technical basis of the identification beyond the seized material is not described in the reports.","status":"supported"},"person_relations":["depicted_or_impersonated"]},"name":"Hangzhou: man who sold AI face-swap obscene videos, including custom swaps of private people's faces, jailed 7 years 3 months; court orders 60,000 yuan","summary":"According to Hangzhou prosecutors and courts as reported by CCTV and relayed by Xinhua in March 2024, police in Xiaoshan district opened a case in August 2022 after finding that a local man was spreading large numbers of obscene videos made with AI technology. Prosecutors said he used AI face-swap software to put faces onto obscene videos, spread them in paid social-media groups to attract customers, sold the software and tutorials, and took custom orders, swapping in the faces of public figures and of private people; one customer asked for the face of a woman he had a crush on. Victims included several well-known public figures and many unspecified private people. In a civil public-interest suit brought by prosecutors, the Hangzhou Internet Court ordered him to delete the personal information he had obtained, apologise publicly and pay 60,000 yuan for personal-information protection. In November 2023 the Xiaoshan District People's Court sentenced him to seven years and three months in prison and a 60,000-yuan fine for making and spreading obscene material for profit.","incidentKind":"bounded_series","incidentDatePrecision":"unknown","exposurePattern":"unknown","reportedDate":"2024-03-21","aiSystem":"AI face-swap software, not named in the reports, that the man used to replace faces in obscene videos and sold to others with tutorials and face material","aiProduct":"Unidentified video tool","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse"],"harmOutcomeSummary":"According to Hangzhou prosecutors, the man swapped the faces of public figures and of many private people into obscene videos without consent and spread and sold them; the courts imposed a prison term and ordered public-interest damages for the infringement of personal information.","frameworkFacets":[],"causationStatus":"established","participantUsersAffectedMin":0,"otherPeopleHarmedMin":0,"affectedCountStatus":"unquantified","affectedCountEvidence":"Prosecutors describe several well-known public figures and many unspecified private people as victims; no count is given. Group sizes (95 to 2,053 members), 1,200-plus videos and 1,600-plus images are audiences and material, not harmed people.","victimAgeRange":"unknown","jurisdiction":"CN","platformType":"other","outcomeType":"criminal_charges","outcomeStatus":"resolved","primarySourceUrl":"https://app.xinhuanet.com/news/article.html?articleId=50a79df8-e37c-4837-86dd-2b0deef66ca0","primarySourceLabel":"Xinhua app (CCTV report), 21 March 2024: AI face-swap obscene videos of actresses, court rules","firstPublishedAt":"2026-10-22T03:12:22.743729+00:00","updatedAt":"2026-10-22T03:12:22.743729+00:00","scopeVersion":"facts-v3","tags":["face-swap","sexual-deepfakes","criminal-conviction","public-interest-litigation","hangzhou","china","depicted-or-impersonated"]},{"id":"2023-victoria-child-protection-worker-entered-family-information-into-chatgpt-for-court-report-regulator-finds","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"Report: 'The Deputy Commissioner therefore found that DFFH contravened both IPP 3.1 and IPP 4.1 and determined that the contraventions were “serious”'; 'Issue a direction to Child Protection staff setting out that they are not to use any web-based or external Application Programming Interface (API)-based GenAI text tools (such as ChatGPT) as part of their official duties'; 'This action must be implemented by 5 November 2024 and maintained until 5 November 2026'.","relation":"supports","source_id":"s1"},{"locator":"'The regulator issued orders to the department, including blocking IP and domains for a range of generative AI websites, including ChatGPT, Meta AI, Gemini and Copilot.'","relation":"supports","source_id":"s2"}],"assertion":"OVIC's investigation report, published in September 2024, found that DFFH contravened Information Privacy Principles 3.1 and 4.1 over a child protection worker's use of ChatGPT, that the contraventions were serious, and issued a compliance notice requiring DFFH to direct child protection staff not to use web-based generative AI text tools and to block them until 5 November 2026.","causal_attribution":"The regulator's own report and compliance notice establish its findings and orders."},{"id":"c2","status":"documented","evidence":[{"locator":"Compliance notice: 'In or around September 2023, a Child Protection worker (CPW1) of the Organisation used'; 'ChatGPT, a web-based generative Artificial Intelligence (GenAI) tool, when drafting a Protection'. Report: 'The report had been submitted to the Children’s Court for a case concerning a young child whose parents had been charged in relation to sexual offences'; 'CPW1 admitted that they had used ChatGPT in drafting the report, but denied inputting personal information as part of this'.","relation":"supports","source_id":"s1"}],"assertion":"OVIC found that in or around September 2023 a DFFH child protection worker used ChatGPT when drafting a Protection Application Report that was submitted to the Children's Court in a case about a young child whose parents had been charged in relation to sexual offences; the worker admitted to DFFH using ChatGPT for the report.","causal_attribution":"OVIC's finding, based on indicators in the report and the worker's admission to DFFH."},{"id":"c3","status":"documented","evidence":[{"locator":"Report: 'OVIC found, on the balance of probabilities, that CPW1 input personal information, including names'; 'By entering personal and sensitive information about the mother, father, carer, and child into ChatGPT, CPW1 also disclosed this information to OpenAI (the company which operates ChatGPT)'; DFFH response: 'it is not possible to definitively confirm that personal information has ever been entered into ChatGPT by the Child Protection Practitioner who no longer works in the department'.","relation":"supports","source_id":"s1"},{"locator":"'Ovic found that, on the balance of probabilities, the worker had entered in personal information.'","relation":"supports","source_id":"s2"}],"assertion":"OVIC found on the balance of probabilities that the worker entered personal information, including names, about the child, mother, father and carer into ChatGPT, disclosing it to OpenAI; the worker denied entering personal information, and DFFH says this cannot be confirmed definitively.","causal_attribution":"A regulator's finding on the balance of probabilities, contested by the worker's denial; organisations cannot see what staff typed into ChatGPT."},{"id":"c4","status":"documented","evidence":[{"locator":"Report: 'First, the PA Report referenced how the child’s father used a particular toy, a doll, for sexual purposes.'; 'The report later referenced the same toy as a notable strength, in that the parents had provided the child with “age-appropriate toys”'; 'ChatGPT failed to properly understand the relevant context, and generated inappropriate and inaccurate content as a result'; 'these deficiencies in the report did not ultimately change the decision-making of either Child Protection or the Court in relation to the child'.","relation":"supports","source_id":"s1"},{"locator":"'But it also said the report did not change the decision-making of either the child protection agency or the court.'","relation":"supports","source_id":"s2"}],"assertion":"OVIC's report attributes inaccurate content in the report to ChatGPT: having described a doll the father had reportedly used for sexual purposes, the report later cited the same toy as a parental strength ('age-appropriate toys'), which downplayed the risk to the child; the deficiencies did not change the decisions of Child Protection or the court.","causal_attribution":"OVIC attributes the doll passage to ChatGPT from the content itself and the worker's admission of ChatGPT use."},{"id":"c5","status":"reported","evidence":[{"locator":"Report: 'DFFH arranged with the Court for the PA Report to be withdrawn and a replacement one submitted. It also notified affected parties about the incident'; 'In the present case, the mother, father, and carer variously described feelings of anxiety and being overwhelmed when informed about their information being disclosed'.","relation":"supports","source_id":"s1"}],"assertion":"According to OVIC's report, DFFH arranged with the court for the report to be withdrawn and replaced and notified the affected parties; the mother, father and carer described feelings of anxiety and being overwhelmed when told their information had been disclosed.","causal_attribution":"DFFH's account to OVIC; the family members' reactions are relayed by the regulator, not in their own words."},{"id":"c6","status":"documented","evidence":[{"locator":"DFFH response, 18 September 2024: 'I accept that there was an unauthorized use of ChatGPT by a Child Protection Practitioner'; 'when developing a Protection Application Report for court'; 'the Child Protection Practitioner who no longer works in the department'.","relation":"supports","source_id":"s1"},{"locator":"'In response, the department said it accepted the findings and would work to implement the orders. It said it no longer employed the worker.'","relation":"supports","source_id":"s2"}],"assertion":"DFFH's Secretary accepted that a child protection practitioner had used ChatGPT without authorisation for a court report and that the department breached the two privacy principles, and the department said it no longer employs the worker.","causal_attribution":"DFFH's own letter, annexed to the report."}],"effects":[{"label":"personal information about a child, the mother, father and carer was entered into ChatGPT and disclosed to OpenAI, regulator finds","claim_id":"c3","direction":"negative"},{"label":"ChatGPT-generated content in a Children's Court report downplayed the risk to the child; the report was withdrawn and replaced","claim_id":"c4","direction":"negative"},{"label":"the mother, father and carer described anxiety and being overwhelmed when told of the disclosure","claim_id":"c5","direction":"negative"}],"sources":[{"id":"s1","url":"https://ovic.vic.gov.au/wp-content/uploads/2024/11/DFFH-ChatGPT-investigation-report-20240924-Re-upload.pdf","kind":"official_record","access":"read","language":"en","translation_note":"OVIC investigation report under s8C(2)(e) of the Privacy and Data Protection Act 2014 (Vic), September 2024, with the compliance notice (Annexure A) and DFFH's response letter of 18 September 2024 (Annexure B); the PDF (re-uploaded November 2024) was read in full on 2026-10-22 from ovic.vic.gov.au (HTTP 200); the report page gives 'Last updated 24 September 2024'.","independence_group":"ovic-dffh-chatgpt-investigation"},{"id":"s2","url":"https://www.theguardian.com/australia-news/2024/sep/26/victoria-child-protection-chat-gpt-ban-ovic-report-ntwnfb","kind":"news","access":"read","language":"en","translation_note":"The Guardian (Australia), 26 September 2024, read in full on 2026-10-22 (HTTP 200). Its account comes from OVIC's report, so it shares that group. Its statement that the worker may have used ChatGPT in 100 cases does not match the report, which attributes the 100 cases to the worker's broader work unit; that statement is not relied on.","independence_group":"ovic-dffh-chatgpt-investigation"}],"version":1,"ai_roles":["institutional_use"],"contexts":["privacy","public_services","justice"],"unknowns":["Exactly what text the worker entered into ChatGPT; neither DFFH nor OVIC could see the prompts, and the input of personal information rests on a balance-of-probabilities finding.","The exact date of the ChatGPT use (the compliance notice says 'in or around September 2023') and of the court hearing.","Whether OpenAI retained or used the information entered.","Which people were affected in the 100 other cases with indicators of ChatGPT use, and whether their information was entered.","How DFFH has complied with the compliance notice since its first monitoring reports."],"geography":{"basis":"OVIC is Victoria's information regulator, DFFH is a Victorian government department, and the report says the affected child protection case went before the Children's Court, a Victorian court. The family's case was handled by the department in Victoria.","court_countries":["AU"],"event_countries":["AU"],"affected_person_countries":["AU"]},"publication":{"basis":"Published under the 2026-10-06 privacy clarification: a regulator's investigation report finds that a child protection worker entered a family's personal information into ChatGPT, without authorisation, and that ChatGPT-generated text minimising the risk to a child went into a court report. Relations: received_personal_information and made_claim_about. The case adds a statutory child protection setting, a court report and a compliance notice banning generative AI tools.","reviewed_on":"2026-10-22"},"ai_involvement":{"basis":"OVIC's report finds that ChatGPT received personal information about the child, mother, father and carer that the worker typed in, which disclosed it to OpenAI, and that ChatGPT generated report text inaccurately describing the parents' care of the child (the doll passage), which went into a report submitted to the Children's Court and downplayed the risk to the child. The finding rests on indicators in the report text, the worker's admission of ChatGPT use and colleagues' accounts; the input of personal information was found on the balance of probabilities and the worker denied it.","status":"supported"},"person_relations":["received_personal_information","made_claim_about"]},"name":"Victorian child protection worker put a family's information into ChatGPT to draft a court report that minimised risk to the child, regulator finds","summary":"Victoria's Information Commissioner (OVIC) found in a report published on 24 September 2024 that a child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT in or around September 2023 to draft a Protection Application Report submitted to the Children's Court about a young child. On the balance of probabilities, OVIC found the worker entered personal information, including names, about the child, mother, father and carer, disclosing it to OpenAI; the worker admitted using ChatGPT but denied entering personal information. OVIC found generated content in the report described a doll that the father had reportedly used for sexual purposes as a parental strength ('age-appropriate toys'), downplaying the risk to the child, although the court's and the department's decisions did not change. The report was withdrawn and replaced, and the mother, father and carer described anxiety when told of the disclosure. OVIC found serious breaches of two privacy principles and issued a compliance notice requiring DFFH to ban and block generative AI text tools for child protection staff until November 2026; DFFH accepted the breach findings.","incidentDate":"2023-09-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"single_interaction","reportedDate":"2024-09-24","aiSystem":"ChatGPT (OpenAI), used through its website by a child protection worker of Victoria's Department of Families, Fairness and Housing to draft a court report, without departmental authorisation (per OVIC's investigation report)","aiProduct":"ChatGPT","aiCompany":"OpenAI","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["other_material_harm","psychological_distress"],"harmOutcomeSummary":"OVIC found that personal information about a child, the mother, father and carer was entered into ChatGPT and disclosed to OpenAI, and that ChatGPT-generated content in a court report downplayed the risk to the child; the mother, father and carer described anxiety when told, according to OVIC's report.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":4,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"OVIC's report finds that personal and sensitive information about the mother, father, carer and child in this case was entered into ChatGPT (four people), and records that the mother, father and carer described anxiety when informed. OVIC says personal information had likely been entered in other cases too; those people are not counted. The worker, the court and DFFH staff are not counted.","victimAgeRange":"unknown","jurisdiction":"AU-VIC","platformType":"chatbot","outcomeType":"regulatory_action","outcomeStatus":"resolved","primarySourceUrl":"https://ovic.vic.gov.au/wp-content/uploads/2024/11/DFFH-ChatGPT-investigation-report-20240924-Re-upload.pdf","primarySourceLabel":"Office of the Victorian Information Commissioner: Investigation into the use of ChatGPT by a Child Protection worker (report, 24 Sep 2024)","firstPublishedAt":"2026-10-22T03:03:14.588614+00:00","updatedAt":"2026-10-22T03:03:14.588614+00:00","scopeVersion":"facts-v3","tags":["chatgpt","child-protection","court-report","privacy-regulator","unauthorised-ai-use","personal-information","victoria"]}]}